>>> kops: Building testing/kops 1.28.4-r1 (using abuild 3.12.0-r4) started Wed, 13 Mar 2024 08:47:11 +0000 >>> kops: Checking sanity of /home/buildozer/aports/testing/kops/APKBUILD... >>> kops: Analyzing dependencies... >>> kops: Installing for build: build-base kubernetes go bash (1/5) Installing kubernetes (1.29.2-r0) (2/5) Installing go (1.22.1-r0) (3/5) Installing readline (8.2.10-r0) (4/5) Installing bash (5.2.26-r0) Executing bash-5.2.26-r0.post-install (5/5) Installing .makedepends-kops (20240313.084713) Executing busybox-1.36.1-r21.trigger OK: 562 MiB in 111 packages >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Cleaning up tmpdir >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 32.7M 100 32.7M 0 0 44.1M 0 --:--:-- --:--:-- --:--:-- 44.1M >>> kops: Fetching https://distfiles.alpinelinux.org/distfiles/edge/kops-1.28.4.tar.gz >>> kops: Checking sha512sums... kops-1.28.4.tar.gz: OK >>> kops: Unpacking /var/cache/distfiles/edge/kops-1.28.4.tar.gz... fatal: not a git repository (or any of the parent directories): .git mkdir -p /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64 GOOS=linux GOARCH=amd64 go build "-trimpath" -o /home/buildozer/aports/testing/kops/src/kops-1.28.4/.build/dist/linux/amd64/kops -ldflags=all=" -X k8s.io/kops.Version=1.28.4 -X k8s.io/kops.GitVersion=" k8s.io/kops/cmd/kops go: downloading k8s.io/apimachinery v0.28.1 go: downloading github.com/aws/amazon-ec2-instance-selector/v2 v2.4.1 go: downloading github.com/spf13/viper v1.16.0 go: downloading k8s.io/api v0.28.1 go: downloading github.com/blang/semver/v4 v4.0.0 go: downloading github.com/aws/aws-sdk-go v1.49.24 go: downloading github.com/spf13/cobra v1.7.0 go: downloading github.com/spf13/pflag v1.0.5 go: downloading github.com/google/go-containerregistry v0.16.1 go: downloading helm.sh/helm/v3 v3.12.3 go: downloading k8s.io/cli-runtime v0.28.1 go: downloading go.uber.org/multierr v1.11.0 go: downloading golang.org/x/crypto v0.14.0 go: downloading k8s.io/client-go v0.28.1 go: downloading k8s.io/klog/v2 v2.100.1 go: downloading k8s.io/kubectl v0.28.1 go: downloading sigs.k8s.io/yaml v1.3.0 go: downloading github.com/cert-manager/cert-manager v1.12.3 go: downloading k8s.io/klog v1.0.0 go: downloading golang.org/x/net v0.17.0 go: downloading github.com/MakeNowJust/heredoc/v2 v2.0.1 go: downloading github.com/Masterminds/sprig/v3 v3.2.3 go: downloading github.com/scaleway/scaleway-sdk-go v1.0.0-beta.20.0.20230829075301-d16b548612e4 go: downloading github.com/apparentlymart/go-cidr v1.1.0 go: downloading github.com/MakeNowJust/heredoc v1.0.0 go: downloading golang.org/x/sync v0.3.0 go: downloading k8s.io/cloud-provider-aws v1.28.1 go: downloading github.com/Azure/azure-pipeline-go v0.2.3 go: downloading github.com/Azure/azure-storage-blob-go v0.15.0 go: downloading github.com/go-ini/ini v1.67.0 go: downloading github.com/gophercloud/gophercloud v1.6.0 go: downloading github.com/pkg/sftp v1.13.6 go: downloading golang.org/x/oauth2 v0.11.0 go: downloading google.golang.org/api v0.138.0 go: downloading gopkg.in/yaml.v2 v2.4.0 go: downloading github.com/cpuguy83/go-md2man/v2 v2.0.2 go: downloading gopkg.in/yaml.v3 v3.0.1 go: downloading github.com/fsnotify/fsnotify v1.6.0 go: downloading github.com/mitchellh/mapstructure v1.5.0 go: downloading github.com/spf13/afero v1.9.5 go: downloading github.com/spf13/cast v1.5.1 go: downloading github.com/spf13/jwalterweatherman v1.1.0 go: downloading github.com/go-logr/logr v1.2.4 go: downloading github.com/mitchellh/go-homedir v1.1.0 go: downloading github.com/imdario/mergo v0.3.15 go: downloading github.com/evanphx/json-patch v5.6.0+incompatible go: downloading k8s.io/utils v0.0.0-20230726121419-3b25d923346b go: downloading github.com/google/uuid v1.3.1 go: downloading github.com/gogo/protobuf v1.3.2 go: downloading github.com/google/gofuzz v1.2.0 go: downloading sigs.k8s.io/structured-merge-diff/v4 v4.3.0 go: downloading gopkg.in/inf.v0 v0.9.1 go: downloading github.com/sergi/go-diff v1.3.1 go: downloading sigs.k8s.io/json v0.0.0-20221116044647-bc3834ca7abd go: downloading k8s.io/kube-openapi v0.0.0-20230717233707-2695361300d9 go: downloading github.com/digitalocean/godo v1.102.1 go: downloading github.com/pelletier/go-toml v1.9.5 go: downloading github.com/Azure/azure-sdk-for-go v68.0.0+incompatible go: downloading github.com/hetznercloud/hcloud-go v1.50.0 go: downloading github.com/Azure/go-autorest/autorest v0.11.29 go: downloading github.com/Azure/go-autorest/autorest/azure/auth v0.5.12 go: downloading k8s.io/mount-utils v0.28.1 go: downloading github.com/opencontainers/go-digest v1.0.0 go: downloading github.com/docker/cli v24.0.5+incompatible go: downloading github.com/Masterminds/goutils v1.1.1 go: downloading github.com/Masterminds/semver/v3 v3.2.1 go: downloading github.com/huandu/xstrings v1.4.0 go: downloading github.com/mitchellh/copystructure v1.2.0 go: downloading github.com/shopspring/decimal v1.3.1 go: downloading github.com/Azure/go-autorest v14.2.0+incompatible go: downloading github.com/pkg/errors v0.9.1 go: downloading github.com/chai2010/gettext-go v1.0.2 go: downloading github.com/mitchellh/go-wordwrap v1.0.1 go: downloading github.com/russross/blackfriday/v2 v2.1.0 go: downloading golang.org/x/sys v0.13.0 go: downloading golang.org/x/term v0.13.0 go: downloading google.golang.org/grpc v1.57.0 go: downloading github.com/spotinst/spotinst-sdk-go v1.145.0 go: downloading gopkg.in/square/go-jose.v2 v2.6.0 go: downloading github.com/Azure/go-autorest/autorest/to v0.4.0 go: downloading golang.org/x/exp v0.0.0-20230817173708-d852ddb80c63 go: downloading github.com/mattn/go-ieproxy v0.0.1 go: downloading gopkg.in/gcfg.v1 v1.2.3 go: downloading k8s.io/cloud-provider v0.28.0 go: downloading k8s.io/component-base v0.28.1 go: downloading k8s.io/csi-translation-lib v0.28.0 go: downloading github.com/kr/fs v0.1.0 go: downloading github.com/golang/protobuf v1.5.3 go: downloading github.com/google/gnostic-models v0.6.8 go: downloading golang.org/x/time v0.3.0 go: downloading github.com/subosito/gotenv v1.4.2 go: downloading github.com/hashicorp/hcl v1.0.0 go: downloading gopkg.in/ini.v1 v1.67.0 go: downloading github.com/magiconair/properties v1.8.7 go: downloading github.com/pelletier/go-toml/v2 v2.0.8 go: downloading github.com/patrickmn/go-cache v2.1.0+incompatible go: downloading github.com/charmbracelet/bubbles v0.13.0 go: downloading github.com/charmbracelet/bubbletea v0.21.0 go: downloading github.com/charmbracelet/lipgloss v0.5.0 go: downloading github.com/evertras/bubble-table v0.14.4 go: downloading github.com/muesli/termenv v0.11.1-0.20220212125758-44cd13922739 go: downloading github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de go: downloading github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 go: downloading github.com/peterbourgon/diskv v2.0.1+incompatible go: downloading golang.org/x/text v0.13.0 go: downloading sigs.k8s.io/kustomize/api v0.13.5-0.20230601165947-6ce0bf390ce3 go: downloading sigs.k8s.io/kustomize/kyaml v0.14.3-0.20230601165947-6ce0bf390ce3 go: downloading cloud.google.com/go/compute/metadata v0.2.3 go: downloading k8s.io/cloud-provider-gcp/providers v0.27.1 go: downloading github.com/docker/distribution v2.8.2+incompatible go: downloading github.com/containerd/stargz-snapshotter/estargz v0.14.3 go: downloading github.com/mitchellh/reflectwalk v1.0.2 go: downloading github.com/moby/term v0.0.0-20221205130635-1aeaba878587 go: downloading cloud.google.com/go/compute v1.23.0 go: downloading github.com/Azure/go-autorest/autorest/adal v0.9.22 go: downloading github.com/Azure/go-autorest/tracing v0.6.0 go: downloading github.com/Azure/go-autorest/logger v0.2.1 go: downloading github.com/Azure/go-autorest/autorest/azure/cli v0.4.5 go: downloading github.com/dimchansky/utfbom v1.1.1 go: downloading github.com/json-iterator/go v1.1.12 go: downloading github.com/google/go-querystring v1.1.0 go: downloading google.golang.org/protobuf v1.31.0 go: downloading github.com/hashicorp/go-retryablehttp v0.7.4 go: downloading github.com/prometheus/client_golang v1.16.0 go: downloading github.com/moby/sys/mountinfo v0.6.2 go: downloading github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da go: downloading gopkg.in/warnings.v0 v0.1.2 go: downloading k8s.io/component-helpers v0.28.1 go: downloading github.com/jmespath/go-jmespath v0.4.0 go: downloading sigs.k8s.io/gateway-api v0.7.0 go: downloading k8s.io/apiextensions-apiserver v0.28.0 go: downloading github.com/prometheus/client_model v0.4.0 go: downloading github.com/prometheus/procfs v0.10.1 go: downloading github.com/oliveagle/jsonpath v0.0.0-20180606110733-2e52cf6e6852 go: downloading github.com/docker/docker v24.0.5+incompatible go: downloading github.com/sirupsen/logrus v1.9.3 go: downloading github.com/lucasb-eyer/go-colorful v1.2.0 go: downloading github.com/mattn/go-runewidth v0.0.13 go: downloading github.com/muesli/reflow v0.3.0 go: downloading github.com/google/btree v1.0.1 go: downloading github.com/go-openapi/swag v0.22.3 go: downloading github.com/go-openapi/jsonreference v0.20.2 go: downloading github.com/google/go-cmp v0.5.9 go: downloading github.com/davecgh/go-spew v1.1.1 go: downloading github.com/mattn/go-isatty v0.0.17 go: downloading github.com/opencontainers/image-spec v1.1.0-rc4 go: downloading google.golang.org/genproto/googleapis/rpc v0.0.0-20230807174057-1744710a1577 go: downloading github.com/klauspost/compress v1.16.5 go: downloading github.com/containerd/containerd v1.7.5 go: downloading oras.land/oras-go v1.2.4-0.20230829103011-4d0bf161925b go: downloading github.com/exponent-io/jsonpath v0.0.0-20151013193312-d6023ce2651d go: downloading github.com/sahilm/fuzzy v0.1.0 go: downloading github.com/atotto/clipboard v0.1.4 go: downloading github.com/containerd/console v1.0.3 go: downloading github.com/muesli/ansi v0.0.0-20211018074035-2e021307bc4b go: downloading github.com/muesli/cancelreader v0.2.0 go: downloading github.com/vbatts/tar-split v0.11.3 go: downloading github.com/Azure/go-autorest/autorest/date v0.3.0 go: downloading github.com/golang-jwt/jwt/v4 v4.5.0 go: downloading github.com/hashicorp/go-cleanhttp v0.5.2 go: downloading github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 go: downloading github.com/GoogleCloudPlatform/k8s-cloud-provider v1.18.1-0.20220218231025-f11817397a1b go: downloading github.com/modern-go/concurrent v0.0.0-20180306012644-bacd9c7ef1dd go: downloading github.com/modern-go/reflect2 v1.0.2 go: downloading github.com/beorn7/perks v1.0.1 go: downloading github.com/cespare/xxhash/v2 v2.2.0 go: downloading github.com/prometheus/common v0.44.0 go: downloading github.com/docker/docker-credential-helpers v0.8.0 go: downloading github.com/rivo/uniseg v0.2.0 go: downloading github.com/go-openapi/jsonpointer v0.19.6 go: downloading github.com/mailru/easyjson v0.7.7 go: downloading github.com/docker/go-connections v0.4.0 go: downloading github.com/emicklei/go-restful/v3 v3.10.2 go: downloading github.com/go-errors/errors v1.4.2 go: downloading github.com/moby/spdystream v0.2.0 go: downloading github.com/josharian/intern v1.0.0 go: downloading github.com/matttproud/golang_protobuf_extensions v1.0.4 go: downloading github.com/googleapis/gax-go/v2 v2.12.0 go: downloading github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 go: downloading github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 go: downloading github.com/xlab/treeprint v1.2.0 go: downloading github.com/google/s2a-go v0.1.5 go: downloading go.opencensus.io v0.24.0 go: downloading github.com/gorilla/mux v1.8.0 go: downloading github.com/googleapis/enterprise-certificate-proxy v0.2.5 go: downloading go.starlark.net v0.0.0-20230525235612-a134d8f9ddca go: downloading github.com/docker/go-metrics v0.0.1 go: downloading github.com/moby/locker v1.0.1 go: downloading go.opentelemetry.io/otel v1.15.0 go: downloading go.opentelemetry.io/otel/trace v1.15.0 go: downloading google.golang.org/appengine v1.6.7 go: downloading github.com/docker/go-units v0.5.0 go: downloading github.com/morikuni/aec v1.0.0 go: downloading github.com/go-logr/stdr v1.2.2 go: downloading github.com/Azure/go-autorest/autorest/validation v0.3.1 fatal: not a git repository (or any of the parent directories): .git go test -v ./... go: downloading github.com/stretchr/testify v1.8.4 go: downloading sigs.k8s.io/controller-runtime v0.16.1 go: downloading k8s.io/kubelet v0.28.1 go: downloading github.com/jacksontj/memberlistmesh v0.0.0-20190905163944-93462b9d2bb7 go: downloading github.com/weaveworks/mesh v0.0.0-20191105120815-58dbcc3e8e63 go: downloading github.com/google/go-tpm-tools v0.4.0 go: downloading github.com/google/go-tpm v0.9.0 go: downloading k8s.io/gengo v0.0.0-20230829151522-9cce18d56c01 go: downloading github.com/pmezard/go-difflib v1.0.0 go: downloading golang.org/x/tools v0.12.1-0.20230815132531-74c255bcf846 go: downloading github.com/hashicorp/go-sockaddr v1.0.2 go: downloading github.com/oklog/ulid v1.3.1 go: downloading github.com/hashicorp/memberlist v0.3.1 go: downloading github.com/armon/go-metrics v0.4.0 go: downloading github.com/hashicorp/go-msgpack v0.5.3 go: downloading github.com/hashicorp/go-multierror v1.1.1 go: downloading github.com/sean-/seed v0.0.0-20170313163322-e2103e2c3529 go: downloading github.com/miekg/dns v1.1.50 go: downloading github.com/hashicorp/errwrap v1.1.0 go: downloading github.com/evanphx/json-patch/v5 v5.6.0 go: downloading gomodules.xyz/jsonpatch/v2 v2.4.0 go: downloading github.com/hashicorp/go-immutable-radix v1.3.1 go: downloading github.com/hashicorp/golang-lru v0.5.4 go: downloading github.com/google/go-sev-guest v0.6.1 go: downloading github.com/pborman/uuid v1.2.0 go: downloading github.com/google/logger v1.1.1 go: downloading golang.org/x/mod v0.12.0 ? k8s.io/kops [no test files] ? k8s.io/kops/channels/cmd/channels [no test files] ? k8s.io/kops/channels/pkg/api [no test files] ? k8s.io/kops/cloudmock/aws/mockautoscaling [no test files] ? k8s.io/kops/cloudmock/aws/mockec2 [no test files] ? k8s.io/kops/cloudmock/aws/mockelb [no test files] ? k8s.io/kops/cloudmock/aws/mockelbv2 [no test files] ? k8s.io/kops/cloudmock/aws/mockeventbridge [no test files] ? k8s.io/kops/cloudmock/aws/mockiam [no test files] ? k8s.io/kops/cloudmock/aws/mockroute53 [no test files] ? k8s.io/kops/cloudmock/aws/mocksqs [no test files] ? k8s.io/kops/cloudmock/gce [no test files] ? k8s.io/kops/cloudmock/gce/gcphttp [no test files] ? k8s.io/kops/cloudmock/gce/mockcloudresourcemanager [no test files] ? k8s.io/kops/cloudmock/gce/mockcompute [no test files] ? k8s.io/kops/cloudmock/gce/mockdns [no test files] ? k8s.io/kops/cloudmock/gce/mockiam [no test files] ? k8s.io/kops/cloudmock/openstack/mockimage [no test files] ? k8s.io/kops/cloudmock/openstack/mocknetworking [no test files] ? k8s.io/kops/cloudmock/scaleway/mockdns [no test files] ? k8s.io/kops/cloudmock/openstack/mockloadbalancer [no test files] ? k8s.io/kops/cloudmock/gce/mockstorage [no test files] ? k8s.io/kops/cloudmock/openstack [no test files] ? k8s.io/kops/cloudmock/openstack/mockblockstorage [no test files] ? k8s.io/kops/cloudmock/openstack/mockcompute [no test files] ? k8s.io/kops/cloudmock/openstack/mockdns [no test files] === RUN Test_Filtering --- PASS: Test_Filtering (0.00s) === RUN Test_Replacement --- PASS: Test_Replacement (0.00s) === RUN Test_GetRequiredUpdates --- PASS: Test_GetRequiredUpdates (0.00s) === RUN Test_NeedsRollingUpdate I0313 08:49:50.720359 18945 addon.go:250] addon test wants to update all nodes I0313 08:49:50.722419 18945 addon.go:250] addon test wants to update workers nodes I0313 08:49:50.722657 18945 addon.go:250] addon test wants to update control-plane nodes --- PASS: Test_NeedsRollingUpdate (0.00s) === RUN Test_InstallPKI I0313 08:49:50.723092 18945 addon.go:283] installing PKI for "test" I0313 08:49:51.038367 18945 addon.go:283] installing PKI for "test" --- PASS: Test_InstallPKI (1.08s) === RUN Test_IsPKIInstalled --- PASS: Test_IsPKIInstalled (0.00s) PASS ok k8s.io/kops/channels/pkg/channels 1.161s === RUN TestGetUpdates --- PASS: TestGetUpdates (0.00s) PASS ok k8s.io/kops/channels/pkg/cmd 0.082s ? k8s.io/kops/cmd/kops/util [no test files] ? k8s.io/kops/cmd/kops-controller [no test files] ? k8s.io/kops/cmd/kops-controller/controllers [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/config [no test files] ? k8s.io/kops/cmd/kops-controller/pkg/server [no test files] ? k8s.io/kops/cmd/kops-utils-cp [no test files] ? k8s.io/kops/cmd/nodeup [no test files] ? k8s.io/kops/dns-controller/cmd/dns-controller [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/interfaces [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns/internal/stubs [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/rrstype [no test files] ? k8s.io/kops/dnsprovider/pkg/dnsprovider/tests [no test files] ? k8s.io/kops/examples/kops-api-example [no test files] ? k8s.io/kops/nodeup/pkg/model/networking [no test files] ? k8s.io/kops/nodeup/pkg/model/resources [no test files] ? k8s.io/kops/pkg/acls [no test files] ? k8s.io/kops/pkg/acls/gce [no test files] ? k8s.io/kops/pkg/apis/kops/registry [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/apis/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/apis/nodeup [no test files] ? k8s.io/kops/pkg/applylib [no test files] ? k8s.io/kops/pkg/applylib/mocks [no test files] ? k8s.io/kops/pkg/applylib/mocks/mockkubeapiserver [no test files] ? k8s.io/kops/pkg/bootstrap [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/clientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/scheme [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/internalversion/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2/fake [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3 [no test files] ? k8s.io/kops/pkg/client/simple/api [no test files] ? k8s.io/kops/pkg/client/simple [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha2 [no test files] ? k8s.io/kops/pkg/client/clientset_generated/internalclientset/typed/kops/v1alpha3/fake [no test files] ? k8s.io/kops/pkg/clouds [no test files] ? k8s.io/kops/pkg/clusteraddons [no test files] ? k8s.io/kops/pkg/commands/commandutils [no test files] ? k8s.io/kops/pkg/configserver [no test files] ? k8s.io/kops/pkg/dump [no test files] ? k8s.io/kops/pkg/kopscontrollerclient [no test files] ? k8s.io/kops/pkg/kubemanifest [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awscloudcontrollermanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsebscsidriver [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/awsloadbalancercontroller [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/certmanager [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/externaldns [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/clusterautoscaler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/karpenter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/kuberouter [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/nodeterminationhandler [no test files] ? k8s.io/kops/pkg/model/components/addonmanifests/dnscontroller [no test files] ? k8s.io/kops/pkg/model/components/kopscontroller [no test files] ? k8s.io/kops/pkg/model/domodel [no test files] ? k8s.io/kops/pkg/model/gcemodel [no test files] ? k8s.io/kops/pkg/model/hetznermodel [no test files] ? k8s.io/kops/pkg/model/scalewaymodel [no test files] ? k8s.io/kops/pkg/mutexes [no test files] ? k8s.io/kops/pkg/nodeidentity/aws [no test files] ? k8s.io/kops/pkg/nodeidentity [no test files] ? k8s.io/kops/pkg/nodeidentity/do [no test files] ? k8s.io/kops/pkg/nodeidentity/gce [no test files] ? k8s.io/kops/pkg/nodeidentity/openstack [no test files] ? k8s.io/kops/pkg/nodeidentity/hetzner [no test files] ? k8s.io/kops/pkg/nodeidentity/scaleway [no test files] ? k8s.io/kops/pkg/rbac [no test files] ? k8s.io/kops/pkg/resolver [no test files] ? k8s.io/kops/pkg/resources [no test files] ? k8s.io/kops/pkg/resources/digitalocean [no test files] ? k8s.io/kops/pkg/resources/hetzner [no test files] ? k8s.io/kops/pkg/resources/openstack [no test files] ? k8s.io/kops/pkg/resources/ops [no test files] ? k8s.io/kops/pkg/resources/scaleway [no test files] ? k8s.io/kops/pkg/resources/spotinst [no test files] ? k8s.io/kops/pkg/sshcredentials [no test files] ? k8s.io/kops/pkg/templates [no test files] ? k8s.io/kops/pkg/testutils [no test files] ? k8s.io/kops/pkg/testutils/golden [no test files] ? k8s.io/kops/pkg/testutils/testcontext [no test files] ? k8s.io/kops/pkg/tokens [no test files] ? k8s.io/kops/pkg/try [no test files] ? k8s.io/kops/pkg/values [no test files] ? k8s.io/kops/pkg/wellknownusers [no test files] ? k8s.io/kops/pkg/zones [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns [no test files] ? k8s.io/kops/pkg/wellknownoperators [no test files] ? k8s.io/kops/pkg/wellknownports [no test files] ? k8s.io/kops/protokube/pkg/etcd [no test files] ? k8s.io/kops/protokube/pkg/gossip [no test files] ? k8s.io/kops/protokube/pkg/gossip/aws [no test files] ? k8s.io/kops/proto/kops/bootstrap/v1 [no test files] ? k8s.io/kops/protokube/cmd/protokube [no test files] ? k8s.io/kops/protokube/pkg/gossip/dns/provider [no test files] ? k8s.io/kops/protokube/pkg/gossip/do [no test files] ? k8s.io/kops/protokube/pkg/gossip/hetzner [no test files] ? k8s.io/kops/protokube/pkg/gossip/memberlist [no test files] ? k8s.io/kops/protokube/pkg/gossip/mesh [no test files] ? k8s.io/kops/protokube/pkg/gossip/openstack [no test files] ? k8s.io/kops/protokube/pkg/gossip/scaleway [no test files] ? k8s.io/kops/protokube/pkg/protokube [no test files] ? k8s.io/kops/tests/fuzz [no test files] ? k8s.io/kops/tests/integration/channel/simple [no test files] ? k8s.io/kops/upup/models [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/bootstrapchannelbuilder [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmverifier [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/do [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcediscovery [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/gcemetadata [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm/gcetpmsigner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/gce/tpm [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetzner [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/hetznertasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/scalewaytasks [no test files] ? k8s.io/kops/upup/pkg/fi/cloudup/spotinsttasks [no test files] ? k8s.io/kops/upup/pkg/fi/loader [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/install [no test files] ? k8s.io/kops/upup/pkg/fi/nodeup/local [no test files] ? k8s.io/kops/upup/pkg/fi/secrets [no test files] ? k8s.io/kops/upup/tools/generators/fitask [no test files] ? k8s.io/kops/util/pkg/architectures [no test files] ? k8s.io/kops/util/pkg/env [no test files] ? k8s.io/kops/util/pkg/mirrors [no test files] ? k8s.io/kops/util/pkg/tables [no test files] ? k8s.io/kops/util/pkg/ui [no test files] === RUN TestCreateClusterMinimal I0313 08:49:53.001778 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.001991 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.002033 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.002067 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.002100 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.002146 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.002183 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.002200 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.002232 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.002262 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.008081 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.008159 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.060679 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:53.060947 20507 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0313 08:49:53.061353 20507 zones.go:93] ListHostedZonesPages { } I0313 08:49:53.082124 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.082237 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.082278 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.082320 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.082358 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.082409 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.082452 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.082480 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.082521 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.082551 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.123646 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.123701 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.153789 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:53.154072 20507 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0313 08:49:53.154508 20507 zones.go:93] ListHostedZonesPages { } I0313 08:49:53.164337 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.164451 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.164490 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.164540 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.164581 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.164633 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.164679 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.164712 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.164754 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.164783 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.169279 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.169334 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.203223 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:53.203408 20507 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0313 08:49:53.203743 20507 zones.go:93] ListHostedZonesPages { } I0313 08:49:53.209267 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.209339 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.209365 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.209397 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.209421 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.209452 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.209482 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.209499 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.209525 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.209544 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.213242 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.213285 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.258436 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:53.258742 20507 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0313 08:49:53.259242 20507 zones.go:93] ListHostedZonesPages { } I0313 08:49:53.269546 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.269654 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.269696 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.269742 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.269784 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.269835 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.269894 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.269925 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.269978 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.270013 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.273892 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.273942 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.312167 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:53.312448 20507 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0313 08:49:53.312861 20507 zones.go:93] ListHostedZonesPages { } I0313 08:49:53.321229 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.321345 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.321384 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.321427 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.321462 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.321507 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.321545 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.321571 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.321607 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.321631 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.327071 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.327221 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.376491 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:53.376641 20507 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0313 08:49:53.377091 20507 zones.go:93] ListHostedZonesPages { } I0313 08:49:53.383732 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.383811 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.383838 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.383870 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.383895 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.383927 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.383953 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.383969 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.383993 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.384009 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.419358 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.419445 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.453687 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:53.453876 20507 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0313 08:49:53.454216 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterMinimal (0.46s) === RUN TestCreateClusterHetzner I0313 08:49:53.460420 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.460537 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.460576 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.460604 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.460629 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.460669 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.460704 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.460721 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.460744 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.460760 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.465081 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.465134 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0313 08:49:53.504072 20507 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0313 08:49:53.504124 20507 new_cluster.go:1373] Cloud Provider ID: "hetzner" I0313 08:49:53.515994 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.516113 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.516154 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.516205 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.516251 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.516305 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.516350 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.516384 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.516431 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.516462 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.521051 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.521128 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.600285 20507 new_cluster.go:1373] Cloud Provider ID: "hetzner" --- PASS: TestCreateClusterHetzner (0.15s) === RUN TestCreateClusterOpenStack I0313 08:49:53.606490 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.606586 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.606622 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.606654 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.606679 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.606711 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.606736 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.606754 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.606779 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.606795 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.610462 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.610519 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0313 08:49:53.652846 20507 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0313 08:49:53.652895 20507 new_cluster.go:1373] Cloud Provider ID: "openstack" I0313 08:49:53.655707 20507 subnets.go:224] Assigned CIDR 10.0.0.0/16 to subnet us-test1 --- PASS: TestCreateClusterOpenStack (0.06s) === RUN TestCreateClusterOpenStackOctavia I0313 08:49:53.664805 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.664952 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.665041 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.665090 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.665128 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.665176 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.665217 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.665244 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.665292 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.665321 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.669643 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.669690 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0313 08:49:53.743270 20507 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0313 08:49:53.743326 20507 new_cluster.go:1373] Cloud Provider ID: "openstack" I0313 08:49:53.746073 20507 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0313 08:49:53.746094 20507 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackOctavia (0.09s) === RUN TestCreateClusterOpenStackNoDNS I0313 08:49:53.756653 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.756782 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.756823 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.756876 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.756921 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.756977 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.757018 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.757050 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.757091 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.757119 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.761949 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.762020 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0313 08:49:53.818008 20507 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0313 08:49:53.818055 20507 new_cluster.go:1373] Cloud Provider ID: "openstack" I0313 08:49:53.818105 20507 subnets.go:205] Assigned CIDR 10.0.0.0/20 to subnet utility-us-test1 I0313 08:49:53.818123 20507 subnets.go:224] Assigned CIDR 10.0.128.0/17 to subnet us-test1 --- PASS: TestCreateClusterOpenStackNoDNS (0.07s) === RUN TestCreateClusterCilium I0313 08:49:53.826048 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.826142 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.826172 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.826203 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.826227 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.826263 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.826295 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.826312 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.826338 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.826356 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.829911 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.829951 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.955981 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:53.956215 20507 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0313 08:49:53.956660 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterCilium (0.14s) === RUN TestCreateClusterOverride I0313 08:49:53.965213 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:53.965375 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:53.965414 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:53.965453 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:53.965496 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:53.965556 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:53.965591 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:53.965613 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:53.965642 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:53.965664 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:53.970477 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:53.970559 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.095442 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:54.095936 20507 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0313 08:49:54.096243 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterOverride (0.14s) === RUN TestCreateClusterKubernetesFeatureGates I0313 08:49:54.101940 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.102029 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.102056 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.102087 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.102115 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.102146 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.102175 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.102193 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.102217 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.102236 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.106187 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.106231 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.145467 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:54.145653 20507 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0313 08:49:54.146042 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKubernetesFeatureGates (0.05s) === RUN TestCreateClusterComplex I0313 08:49:54.152552 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.152639 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.152667 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.152698 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.152724 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.152759 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.152786 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.152803 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.152828 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.152846 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.178816 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.178896 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.279848 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:54.280177 20507 subnets.go:224] Assigned CIDR 10.0.0.0/18 to subnet us-test-1a I0313 08:49:54.280193 20507 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1b I0313 08:49:54.280204 20507 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1c I0313 08:49:54.280582 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplex (0.14s) === RUN TestCreateClusterComplexPrivate I0313 08:49:54.292976 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.293068 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.293098 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.293129 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.293155 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.293189 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.293216 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.293234 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.293258 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.293276 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.297202 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.297245 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.340555 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:54.340935 20507 subnets.go:205] Assigned CIDR 10.0.0.0/21 to subnet utility-us-test-1a I0313 08:49:54.340949 20507 subnets.go:205] Assigned CIDR 10.0.8.0/21 to subnet utility-us-test-1a-1 I0313 08:49:54.340960 20507 subnets.go:205] Assigned CIDR 10.0.16.0/21 to subnet utility-us-test-1a-4 I0313 08:49:54.340969 20507 subnets.go:205] Assigned CIDR 10.0.24.0/21 to subnet utility-us-test-1b I0313 08:49:54.340978 20507 subnets.go:205] Assigned CIDR 10.0.32.0/21 to subnet utility-us-test-1b-2 I0313 08:49:54.340984 20507 subnets.go:205] Assigned CIDR 10.0.40.0/21 to subnet utility-us-test-1c I0313 08:49:54.340994 20507 subnets.go:205] Assigned CIDR 10.0.48.0/21 to subnet utility-us-test-1c-3 I0313 08:49:54.341007 20507 subnets.go:224] Assigned CIDR 10.0.64.0/18 to subnet us-test-1a I0313 08:49:54.341016 20507 subnets.go:224] Assigned CIDR 10.0.128.0/18 to subnet us-test-1b I0313 08:49:54.341026 20507 subnets.go:224] Assigned CIDR 10.0.192.0/18 to subnet us-test-1c I0313 08:49:54.341521 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterComplexPrivate (0.06s) === RUN TestCreateClusterHA I0313 08:49:54.357349 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.357482 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.357526 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.357576 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.357629 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.357685 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.357734 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.357766 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.357813 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.357844 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.361945 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.361990 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.387543 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:54.387878 20507 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0313 08:49:54.387897 20507 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0313 08:49:54.387905 20507 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0313 08:49:54.388247 20507 zones.go:93] ListHostedZonesPages { } I0313 08:49:54.397025 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.397102 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.397129 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.397158 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.397184 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.397217 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.397248 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.397265 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.397289 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.397307 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.401002 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.401063 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.451589 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:54.451914 20507 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0313 08:49:54.451944 20507 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0313 08:49:54.451957 20507 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0313 08:49:54.452275 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHA (0.10s) === RUN TestCreateClusterMinimalGCE I0313 08:49:54.461073 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.461163 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.461191 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.461224 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.461249 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.461282 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.461309 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.461326 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.461348 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.461364 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.465203 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.465244 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.570873 20507 new_cluster.go:1373] Cloud Provider ID: "gce" I0313 08:49:54.570997 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 I0313 08:49:54.576460 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.576542 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.576569 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.576600 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.576626 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.576659 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.576692 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.576709 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.576735 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.576762 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.582480 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.582526 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.607980 20507 new_cluster.go:1373] Cloud Provider ID: "gce" I0313 08:49:54.608088 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterMinimalGCE (0.15s) === RUN TestCreateClusterHAGCE I0313 08:49:54.613973 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.614061 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.614091 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.614122 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.614146 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.614178 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.614206 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.614235 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.614264 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.614281 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.618705 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.618794 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.724502 20507 new_cluster.go:1373] Cloud Provider ID: "gce" I0313 08:49:54.724633 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterHAGCE (0.12s) === RUN TestCreateClusterGCE I0313 08:49:54.733164 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.733246 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.733275 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.733308 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.733333 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.733364 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.733391 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.733409 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.733432 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.733449 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.737539 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.737582 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.808213 20507 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0313 08:49:54.808298 20507 new_cluster.go:1373] Cloud Provider ID: "gce" I0313 08:49:54.808376 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterGCE (0.08s) === RUN TestCreateClusterHASharedZone I0313 08:49:54.814201 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.814291 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.814319 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.814350 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.814373 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.814408 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.814433 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.814448 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.814472 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.814489 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.818705 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.818758 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0313 08:49:54.887103 20507 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0313 08:49:54.887148 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:54.887400 20507 subnets.go:224] Assigned CIDR 172.20.0.0/16 to subnet us-test-1a I0313 08:49:54.887743 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZone (0.08s) === RUN TestCreateClusterHASharedZones I0313 08:49:54.897624 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.897744 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.897778 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.897812 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.897839 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.897873 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.897900 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.897919 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.897945 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.897963 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.901860 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.901915 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } W0313 08:49:54.925606 20507 new_cluster.go:947] Running with control-plane nodes in the same AZs; redundancy will be reduced I0313 08:49:54.925658 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:54.926043 20507 subnets.go:224] Assigned CIDR 172.20.0.0/17 to subnet us-test-1a I0313 08:49:54.926059 20507 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1b I0313 08:49:54.926415 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterHASharedZones (0.04s) === RUN TestCreateClusterPrivate I0313 08:49:54.936348 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.936446 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.936478 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.936509 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.936533 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.936566 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.936596 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.936615 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.936641 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.936658 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.940766 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.940812 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.963903 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:54.964135 20507 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0313 08:49:54.964155 20507 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0313 08:49:54.964504 20507 zones.go:93] ListHostedZonesPages { } I0313 08:49:54.964548 20507 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterPrivate (0.04s) === RUN TestCreateClusterPrivateGCE I0313 08:49:54.971843 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:54.971963 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:54.971992 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:54.972022 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:54.972046 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:54.972078 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:54.972104 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:54.972123 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:54.972146 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:54.972164 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:54.975754 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:54.975798 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.077028 20507 new_cluster.go:581] VMs will be configured to use specified Service Account: test-account@testproject.iam.gserviceaccount.com I0313 08:49:55.077150 20507 new_cluster.go:1373] Cloud Provider ID: "gce" I0313 08:49:55.077295 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 --- PASS: TestCreateClusterPrivateGCE (0.12s) === RUN TestCreateClusterWithNGWSpecified I0313 08:49:55.088042 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:55.088168 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:55.088206 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:55.088248 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:55.088284 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:55.088334 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:55.088375 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:55.088402 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:55.088440 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:55.088467 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:55.092755 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.092807 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.144839 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:55.145059 20507 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0313 08:49:55.145078 20507 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0313 08:49:55.145400 20507 zones.go:93] ListHostedZonesPages { } I0313 08:49:55.145433 20507 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithNGWSpecified (0.06s) === RUN TestCreateClusterWithINGWSpecified I0313 08:49:55.152010 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:55.152103 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:55.152132 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:55.152167 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:55.152193 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:55.152228 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:55.152256 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:55.152273 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:55.152299 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:55.152317 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:55.156683 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.156760 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.196225 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:55.196445 20507 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0313 08:49:55.196463 20507 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0313 08:49:55.196768 20507 zones.go:93] ListHostedZonesPages { } I0313 08:49:55.196800 20507 utils.go:230] Found matching hosted zone ".private.example.com", but it was "Private" and we require "Public" --- PASS: TestCreateClusterWithINGWSpecified (0.05s) === RUN TestCreateClusterSharedVPC I0313 08:49:55.203485 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:55.203574 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:55.203601 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:55.203633 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:55.203658 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:55.203693 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:55.203720 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:55.203738 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:55.203762 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:55.203778 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:55.207767 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.207816 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.231949 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:55.232118 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:49:55.232172 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:49:55.232210 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:49:55.232229 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:49:55.232282 20507 subnets.go:224] Assigned CIDR 10.0.0.0/12 to subnet us-test-1a I0313 08:49:55.232611 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedVPC (0.04s) === RUN TestCreateClusterSharedSubnets I0313 08:49:55.238765 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:55.238894 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:55.238933 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:55.238978 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:55.239014 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:55.239063 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:55.239105 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:55.239133 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:55.239171 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:55.239198 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:55.246589 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.246668 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.289999 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:49:55.290052 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:49:55.290152 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:55.290293 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:49:55.290314 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:49:55.290336 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:49:55.290350 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:49:55.290682 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnets (0.06s) === RUN TestCreateClusterSharedSubnetsVpcLookup I0313 08:49:55.296327 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:55.296432 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:55.296461 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:55.296489 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:55.296513 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:55.296544 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:55.296571 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:55.296587 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:55.296610 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:55.296627 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:55.300740 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.300785 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.359574 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:49:55.359640 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:49:55.359665 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:49:55.359752 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:55.359894 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:49:55.359915 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:49:55.359938 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:49:55.359953 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:49:55.360272 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterSharedSubnetsVpcLookup (0.07s) === RUN TestCreateClusterPrivateSharedSubnets I0313 08:49:55.365880 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:55.365974 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:55.366003 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:55.366032 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:55.366056 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:55.366087 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:55.366114 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:55.366129 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:55.366153 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:55.366171 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:55.370433 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.370485 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.416872 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:49:55.416923 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:49:55.416979 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:49:55.416999 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:49:55.417057 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:55.417205 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:49:55.417226 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:49:55.417248 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:49:55.417262 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:49:55.417616 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterPrivateSharedSubnets (0.06s) === RUN TestCreateClusterIPv6 I0313 08:49:55.423591 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:55.423689 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:55.423718 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:55.423749 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:55.423774 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:55.423806 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:55.423833 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:55.423852 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:55.423876 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:55.423896 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:55.427969 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.428014 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.520372 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:55.520551 20507 subnets.go:205] Assigned CIDR 172.20.0.0/21 to subnet utility-us-test-1a I0313 08:49:55.520569 20507 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet dualstack-us-test-1a I0313 08:49:55.521126 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterIPv6 (0.10s) === RUN TestCreateClusterDifferentAMIs I0313 08:49:55.527464 20507 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0313 08:49:55.527483 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:55.527574 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:55.527603 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:55.527635 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:55.527662 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:55.527696 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:55.527723 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:55.527740 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:55.527764 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:55.527782 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:55.531760 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.531810 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.571711 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:55.571811 20507 subnets.go:205] Assigned CIDR 172.20.0.0/20 to subnet utility-us-test-1a I0313 08:49:55.571828 20507 subnets.go:224] Assigned CIDR 172.20.128.0/17 to subnet us-test-1a I0313 08:49:55.572225 20507 zones.go:93] ListHostedZonesPages { } I0313 08:49:55.582346 20507 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestCreateClusterDifferentAMIs (0.05s) === RUN TestCreateClusterKarpenter I0313 08:49:55.582443 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:55.582532 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:55.582564 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:55.582598 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:55.582622 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:55.582655 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:55.582683 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:55.582699 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:55.582724 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:55.582742 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:55.586437 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.10.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.586484 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.11.0.0/24", VpcId: "vpc-12345678" } I0313 08:49:55.626608 20507 new_cluster.go:1373] Cloud Provider ID: "aws" I0313 08:49:55.626826 20507 subnets.go:224] Assigned CIDR 172.20.0.0/18 to subnet us-test-1a I0313 08:49:55.626845 20507 subnets.go:224] Assigned CIDR 172.20.64.0/18 to subnet us-test-1b I0313 08:49:55.626859 20507 subnets.go:224] Assigned CIDR 172.20.128.0/18 to subnet us-test-1c I0313 08:49:55.627230 20507 zones.go:93] ListHostedZonesPages { } --- PASS: TestCreateClusterKarpenter (0.05s) === RUN TestParseCloudLabels --- PASS: TestParseCloudLabels (0.00s) === RUN TestConfirmation --- PASS: TestConfirmation (0.00s) === RUN TestEditInstanceGroup I0313 08:49:55.634136 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:55.634231 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:55.634269 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:55.634356 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:55.634398 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:55.634449 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:55.634487 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:55.634518 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:55.634563 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:55.634590 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:55.640155 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } --- PASS: TestEditInstanceGroup (0.01s) === RUN TestMinimal I0313 08:49:55.641388 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:49:55.641477 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:49:55.641508 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:49:55.641553 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:49:55.641589 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:49:55.641642 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:49:55.641675 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:49:55.641711 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:49:55.641749 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:49:55.641775 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:49:55.655882 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0313 08:49:55.658277 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:49:55.658357 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0313 08:50:00.245830 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:03.570819 20507 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0313 08:50:03.572531 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:03.572573 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:03.572675 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:03.575122 20507 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0313 08:50:03.584343 20507 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0313 08:50:03.585425 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:03.585703 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:03.586189 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:03.586361 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:03.586470 20507 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0313 08:50:03.587164 20507 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0313 08:50:03.587959 20507 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0313 08:50:03.592992 20507 target.go:111] Terraform output is in /tmp/test2885633512/out --- PASS: TestMinimal (7.96s) === RUN TestMinimal_v1_23 I0313 08:50:03.597691 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:03.597858 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:03.597936 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:03.598005 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:03.598073 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:03.598159 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:03.598237 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:03.598300 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:03.598377 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:03.598437 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:03.624414 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0313 08:50:03.628661 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:03.628794 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:05.690884 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:05.815561 20507 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0313 08:50:05.815944 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:05.815977 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:05.816040 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:05.818274 20507 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0313 08:50:05.823656 20507 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0313 08:50:05.823912 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:05.824042 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:05.824392 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:05.824459 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:05.824527 20507 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0313 08:50:05.824755 20507 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0313 08:50:05.824952 20507 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0313 08:50:05.828104 20507 target.go:111] Terraform output is in /tmp/test6448817/out --- PASS: TestMinimal_v1_23 (2.23s) === RUN TestMinimal_v1_24 I0313 08:50:05.830834 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:05.830935 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:05.830972 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:05.831015 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:05.831042 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:05.831082 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:05.831113 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:05.831131 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:05.831165 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:05.831185 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:05.846680 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:50:05.849354 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:05.849441 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:07.711346 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:07.857117 20507 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0313 08:50:07.857609 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:07.857638 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:07.857699 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:07.859729 20507 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0313 08:50:07.862973 20507 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0313 08:50:07.863122 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:07.863311 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:07.863658 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:07.863716 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:07.863786 20507 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0313 08:50:07.864019 20507 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0313 08:50:07.864270 20507 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0313 08:50:07.869422 20507 target.go:111] Terraform output is in /tmp/test385017784/out --- PASS: TestMinimal_v1_24 (2.04s) === RUN TestMinimal_v1_25 I0313 08:50:07.874194 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:07.874312 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:07.874361 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:07.874410 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:07.874454 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:07.874507 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:07.874548 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:07.874580 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:07.874623 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:07.874651 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:07.894337 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0313 08:50:07.896310 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:07.896372 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:09.715997 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:09.861340 20507 executor.go:111] Tasks: 0 done / 105 total; 46 can run I0313 08:50:09.861859 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:09.861891 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:09.861959 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:09.863880 20507 executor.go:111] Tasks: 46 done / 105 total; 23 can run I0313 08:50:09.867158 20507 executor.go:111] Tasks: 69 done / 105 total; 28 can run I0313 08:50:09.868122 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:09.868655 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:09.871540 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:09.871612 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:09.871715 20507 executor.go:111] Tasks: 97 done / 105 total; 2 can run I0313 08:50:09.871967 20507 executor.go:111] Tasks: 99 done / 105 total; 6 can run I0313 08:50:09.872194 20507 executor.go:111] Tasks: 105 done / 105 total; 0 can run I0313 08:50:09.875347 20507 target.go:111] Terraform output is in /tmp/test3834672197/out --- PASS: TestMinimal_v1_25 (2.00s) === RUN TestMinimal_v1_26 I0313 08:50:09.877996 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:09.878074 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:09.878102 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:09.878133 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:09.878159 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:09.878194 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:09.878220 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:09.878238 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:09.878263 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:09.878281 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:09.893595 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0313 08:50:09.895591 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:09.895655 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:11.816604 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:11.934762 20507 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0313 08:50:11.935279 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:11.935909 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:11.936014 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:11.944055 20507 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0313 08:50:11.947532 20507 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0313 08:50:11.947799 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:11.948153 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:11.948199 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:11.948864 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:11.948977 20507 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0313 08:50:11.949246 20507 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0313 08:50:11.949425 20507 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0313 08:50:11.952664 20507 target.go:111] Terraform output is in /tmp/test4273693879/out --- PASS: TestMinimal_v1_26 (2.08s) === RUN TestMinimal_v1_27 I0313 08:50:11.955352 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:11.955447 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:11.955479 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:11.955510 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:11.955535 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:11.955567 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:11.955597 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:11.955622 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:11.955654 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:11.955674 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:11.977090 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0313 08:50:11.979389 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:11.979492 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:14.944154 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:15.074480 20507 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0313 08:50:15.075062 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:15.075086 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:15.075159 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:15.078979 20507 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0313 08:50:15.082869 20507 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0313 08:50:15.083032 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:15.083143 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:15.083417 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:15.083484 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:15.083582 20507 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0313 08:50:15.083810 20507 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0313 08:50:15.084007 20507 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0313 08:50:15.086714 20507 target.go:111] Terraform output is in /tmp/test2308328217/out --- PASS: TestMinimal_v1_27 (3.13s) === RUN TestMinimal_NoneDNS I0313 08:50:15.088884 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:15.088948 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:15.088970 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:15.088994 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:15.089013 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:15.089040 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:15.089062 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:15.089075 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:15.089095 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:15.089110 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0313 08:50:15.103022 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:15.103079 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:16.484567 20507 executor.go:111] Tasks: 0 done / 110 total; 43 can run I0313 08:50:16.488343 20507 executor.go:111] Tasks: 43 done / 110 total; 24 can run I0313 08:50:16.490114 20507 executor.go:111] Tasks: 67 done / 110 total; 29 can run I0313 08:50:16.490649 20507 executor.go:111] Tasks: 96 done / 110 total; 2 can run I0313 08:50:16.490682 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:16.490735 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:16.490837 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:16.490924 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:16.497560 20507 executor.go:111] Tasks: 98 done / 110 total; 4 can run I0313 08:50:16.497728 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:16.497905 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:16.498181 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:16.498223 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:16.498292 20507 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0313 08:50:16.498526 20507 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0313 08:50:16.498787 20507 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0313 08:50:16.504455 20507 target.go:111] Terraform output is in /tmp/test1814953273/out --- PASS: TestMinimal_NoneDNS (1.42s) === RUN TestHetzner I0313 08:50:16.508669 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:50:18.455482 20507 executor.go:111] Tasks: 0 done / 46 total; 37 can run I0313 08:50:18.458448 20507 executor.go:111] Tasks: 37 done / 46 total; 3 can run I0313 08:50:18.458881 20507 executor.go:111] Tasks: 40 done / 46 total; 2 can run I0313 08:50:18.464073 20507 executor.go:111] Tasks: 42 done / 46 total; 4 can run I0313 08:50:18.465034 20507 executor.go:111] Tasks: 46 done / 46 total; 0 can run I0313 08:50:18.467266 20507 target.go:111] Terraform output is in /tmp/test3345140300/out --- PASS: TestHetzner (1.96s) === RUN TestNvidia I0313 08:50:18.470146 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:18.470275 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:18.470321 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:18.470368 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:18.470410 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:18.470460 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:18.470506 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:18.470535 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:18.470575 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:18.470603 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:18.494605 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:50:18.498238 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:18.498325 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:20.319217 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:20.462173 20507 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0313 08:50:20.463138 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:20.463169 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:20.463251 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:20.464845 20507 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0313 08:50:20.469606 20507 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0313 08:50:20.470086 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:20.470268 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:20.470452 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:20.470751 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:20.470819 20507 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0313 08:50:20.471031 20507 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0313 08:50:20.471346 20507 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0313 08:50:20.477989 20507 target.go:111] Terraform output is in /tmp/test129505641/out --- PASS: TestNvidia (2.01s) === RUN TestMinimalGossip I0313 08:50:20.480574 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:20.480655 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:20.480687 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:20.480718 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:20.480743 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:20.480776 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:20.480804 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:20.480823 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:20.480849 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:20.480868 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:50:20.497184 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:20.497249 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:21.881665 20507 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0313 08:50:21.885853 20507 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0313 08:50:21.891674 20507 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0313 08:50:21.892101 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:21.893053 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:21.893856 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:21.894073 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:21.894947 20507 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0313 08:50:21.895799 20507 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0313 08:50:21.897213 20507 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0313 08:50:21.902213 20507 target.go:111] Terraform output is in /tmp/test411942287/out --- PASS: TestMinimalGossip (1.43s) === RUN TestMinimalGossipIRSA I0313 08:50:21.906302 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:21.906415 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:21.906453 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:21.906496 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:21.906539 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:21.906593 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:21.906635 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:21.906667 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:21.906708 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:21.906736 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:50:21.934608 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:21.934703 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:23.427545 20507 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0313 08:50:23.429959 20507 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0313 08:50:23.436655 20507 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0313 08:50:23.437014 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:23.437234 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:23.437548 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:23.437684 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:23.437789 20507 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0313 08:50:23.438017 20507 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0313 08:50:23.438278 20507 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0313 08:50:23.443589 20507 target.go:111] Terraform output is in /tmp/test1051474495/out --- PASS: TestMinimalGossipIRSA (1.54s) === RUN TestMinimalGCE I0313 08:50:23.448553 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:23.450293 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:50:25.392451 20507 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0313 08:50:25.392554 20507 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0313 08:50:25.392679 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0313 08:50:25.392711 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0313 08:50:25.392736 20507 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0313 08:50:25.392813 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0313 08:50:25.394441 20507 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0313 08:50:25.398502 20507 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0313 08:50:25.403073 20507 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0313 08:50:25.403716 20507 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0313 08:50:25.403906 20507 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0313 08:50:25.405803 20507 target.go:111] Terraform output is in /tmp/test2103524588/out --- PASS: TestMinimalGCE (1.96s) === RUN TestMinimalGCEPrivate I0313 08:50:25.407773 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:25.408878 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:50:27.059209 20507 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0313 08:50:27.059281 20507 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0313 08:50:27.059371 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/main" W0313 08:50:27.059391 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com/backups/etcd/events" W0313 08:50:27.059405 20507 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-private.example.com" W0313 08:50:27.059446 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0313 08:50:27.060316 20507 executor.go:111] Tasks: 0 done / 65 total; 41 can run I0313 08:50:27.062816 20507 executor.go:111] Tasks: 41 done / 65 total; 17 can run I0313 08:50:27.067732 20507 executor.go:111] Tasks: 58 done / 65 total; 5 can run I0313 08:50:27.068357 20507 executor.go:111] Tasks: 63 done / 65 total; 2 can run I0313 08:50:27.068493 20507 executor.go:111] Tasks: 65 done / 65 total; 0 can run I0313 08:50:27.070447 20507 target.go:111] Terraform output is in /tmp/test3128200145/out --- PASS: TestMinimalGCEPrivate (1.66s) === RUN TestMinimalGCEInternalLoadBalancer I0313 08:50:27.072344 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:27.073434 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:50:28.839632 20507 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0313 08:50:28.839689 20507 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0313 08:50:28.839780 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/main" W0313 08:50:28.839801 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com/backups/etcd/events" W0313 08:50:28.839815 20507 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-ilb.example.com" W0313 08:50:28.839856 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0313 08:50:28.839885 20507 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0313 08:50:28.840846 20507 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0313 08:50:28.842991 20507 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0313 08:50:28.843345 20507 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0313 08:50:28.843515 20507 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0313 08:50:28.846623 20507 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0313 08:50:28.847299 20507 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0313 08:50:28.847453 20507 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0313 08:50:28.847625 20507 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0313 08:50:28.847794 20507 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0313 08:50:28.849843 20507 target.go:111] Terraform output is in /tmp/test3296389444/out --- PASS: TestMinimalGCEInternalLoadBalancer (1.78s) === RUN TestMinimalGCEPublicLoadBalancer I0313 08:50:28.851749 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:28.852912 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:50:30.580833 20507 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0313 08:50:30.580914 20507 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0313 08:50:30.581056 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/main" W0313 08:50:30.581089 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com/backups/etcd/events" W0313 08:50:30.581115 20507 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-plb.example.com" W0313 08:50:30.581180 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0313 08:50:30.582790 20507 executor.go:111] Tasks: 0 done / 71 total; 43 can run I0313 08:50:30.585829 20507 executor.go:111] Tasks: 43 done / 71 total; 19 can run I0313 08:50:30.589746 20507 executor.go:111] Tasks: 62 done / 71 total; 7 can run I0313 08:50:30.590363 20507 executor.go:111] Tasks: 69 done / 71 total; 2 can run I0313 08:50:30.590590 20507 executor.go:111] Tasks: 71 done / 71 total; 0 can run I0313 08:50:30.593809 20507 target.go:111] Terraform output is in /tmp/test2956672917/out --- PASS: TestMinimalGCEPublicLoadBalancer (1.75s) === RUN TestMinimalGCELongClusterName I0313 08:50:30.597142 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.598864 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:50:32.216546 20507 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0313 08:50:32.216633 20507 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0313 08:50:32.216721 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0313 08:50:32.216738 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0313 08:50:32.216753 20507 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0313 08:50:32.216803 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0313 08:50:32.217811 20507 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0313 08:50:32.220630 20507 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0313 08:50:32.223881 20507 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0313 08:50:32.224390 20507 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0313 08:50:32.224487 20507 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0313 08:50:32.226411 20507 target.go:111] Terraform output is in /tmp/test4106937751/out --- PASS: TestMinimalGCELongClusterName (1.63s) === RUN TestMinimalGCEInternalLoadBalancerLongClusterName I0313 08:50:32.228305 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:32.229436 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:50:33.981984 20507 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0313 08:50:33.982051 20507 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0313 08:50:33.982163 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/main" W0313 08:50:33.982184 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com/backups/etcd/events" W0313 08:50:33.982200 20507 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce-with-a-very-very-very-very-very-long-name.example.com" W0313 08:50:33.982242 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0313 08:50:33.982274 20507 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0313 08:50:33.983268 20507 executor.go:111] Tasks: 0 done / 70 total; 42 can run I0313 08:50:33.985218 20507 executor.go:111] Tasks: 42 done / 70 total; 16 can run I0313 08:50:33.986412 20507 executor.go:111] Tasks: 58 done / 70 total; 2 can run I0313 08:50:33.986637 20507 executor.go:111] Tasks: 60 done / 70 total; 2 can run I0313 08:50:33.992384 20507 executor.go:111] Tasks: 62 done / 70 total; 4 can run I0313 08:50:33.992982 20507 executor.go:111] Tasks: 66 done / 70 total; 2 can run I0313 08:50:33.993112 20507 executor.go:111] Tasks: 68 done / 70 total; 1 can run I0313 08:50:33.993219 20507 executor.go:111] Tasks: 69 done / 70 total; 1 can run I0313 08:50:33.993310 20507 executor.go:111] Tasks: 70 done / 70 total; 0 can run I0313 08:50:33.995329 20507 target.go:111] Terraform output is in /tmp/test506175105/out --- PASS: TestMinimalGCEInternalLoadBalancerLongClusterName (1.77s) === RUN TestMinimalGCEDNSNone I0313 08:50:33.997604 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:33.998754 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:50:35.609666 20507 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0313 08:50:35.609723 20507 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0313 08:50:35.609809 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0313 08:50:35.609826 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0313 08:50:35.609840 20507 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0313 08:50:35.609880 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0313 08:50:35.609909 20507 autoscalinggroup.go:321] Not hooking the instance group manager up to anything. I0313 08:50:35.610878 20507 executor.go:111] Tasks: 0 done / 72 total; 41 can run I0313 08:50:35.614180 20507 executor.go:111] Tasks: 41 done / 72 total; 18 can run I0313 08:50:35.614531 20507 executor.go:111] Tasks: 59 done / 72 total; 2 can run I0313 08:50:35.614662 20507 executor.go:111] Tasks: 61 done / 72 total; 2 can run I0313 08:50:35.617652 20507 executor.go:111] Tasks: 63 done / 72 total; 4 can run I0313 08:50:35.618170 20507 executor.go:111] Tasks: 67 done / 72 total; 2 can run I0313 08:50:35.618330 20507 executor.go:111] Tasks: 69 done / 72 total; 1 can run I0313 08:50:35.618426 20507 executor.go:111] Tasks: 70 done / 72 total; 2 can run I0313 08:50:35.618571 20507 executor.go:111] Tasks: 72 done / 72 total; 0 can run I0313 08:50:35.621044 20507 target.go:111] Terraform output is in /tmp/test3330103956/out --- PASS: TestMinimalGCEDNSNone (1.63s) === RUN TestMinimalScaleway I0313 08:50:35.623038 20507 featureflag.go:164] FeatureFlag "Scaleway"=true I0313 08:50:35.623052 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:50:37.690074 20507 executor.go:111] Tasks: 0 done / 49 total; 37 can run I0313 08:50:37.695843 20507 executor.go:111] Tasks: 37 done / 49 total; 6 can run I0313 08:50:37.699056 20507 executor.go:111] Tasks: 43 done / 49 total; 6 can run I0313 08:50:37.699876 20507 executor.go:111] Tasks: 49 done / 49 total; 0 can run I0313 08:50:37.701717 20507 target.go:111] Terraform output is in /tmp/test3957168118/out I0313 08:50:37.704494 20507 featureflag.go:164] FeatureFlag "Scaleway"=false --- PASS: TestMinimalScaleway (2.08s) === RUN TestHA I0313 08:50:37.704596 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:37.704696 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:37.704734 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:37.704777 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:37.704815 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:37.704861 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:37.704903 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:37.704932 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:37.704969 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:37.704995 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:37.734300 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:50:37.737588 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:37.737665 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:37.737724 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:37.737776 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:39.008987 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:39.211664 20507 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0313 08:50:39.219100 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:39.219148 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:39.219243 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:39.221451 20507 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0313 08:50:39.227154 20507 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0313 08:50:39.227365 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:39.227539 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:39.227786 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:39.227916 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:39.228003 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:39.228174 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:39.228279 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:39.228642 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:39.228738 20507 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0313 08:50:39.229038 20507 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0313 08:50:39.229374 20507 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0313 08:50:39.236373 20507 target.go:111] Terraform output is in /tmp/test3490972485/out --- PASS: TestHA (1.54s) === RUN TestHighAvailabilityGCE I0313 08:50:39.241648 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:39.243707 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:50:40.942060 20507 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0313 08:50:40.942174 20507 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0313 08:50:40.942309 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/main" W0313 08:50:40.942337 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com/backups/etcd/events" W0313 08:50:40.942360 20507 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/ha-gce.example.com" W0313 08:50:40.942427 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0313 08:50:40.942510 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups W0313 08:50:40.942576 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0313 08:50:40.944710 20507 executor.go:111] Tasks: 0 done / 82 total; 49 can run I0313 08:50:40.947267 20507 executor.go:111] Tasks: 49 done / 82 total; 19 can run I0313 08:50:40.952532 20507 executor.go:111] Tasks: 68 done / 82 total; 8 can run I0313 08:50:40.953507 20507 executor.go:111] Tasks: 76 done / 82 total; 6 can run I0313 08:50:40.953749 20507 executor.go:111] Tasks: 82 done / 82 total; 0 can run I0313 08:50:40.957940 20507 target.go:111] Terraform output is in /tmp/test3902870635/out --- PASS: TestHighAvailabilityGCE (1.72s) === RUN TestComplex I0313 08:50:40.962143 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:40.962280 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:40.962328 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:40.962421 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:40.962464 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:40.962517 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:40.962559 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:40.962590 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:40.962634 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:40.962664 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:41.005788 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:50:41.009924 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:41.010030 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:42.932803 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:43.086371 20507 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0313 08:50:43.086908 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:43.086943 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:43.087032 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:43.088403 20507 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0313 08:50:43.090225 20507 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0313 08:50:43.090672 20507 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0313 08:50:43.090898 20507 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0313 08:50:43.090936 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:43.090989 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:43.091007 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:43.091063 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:43.096915 20507 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0313 08:50:43.097868 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:43.098114 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:43.098545 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:43.098649 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:43.098748 20507 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0313 08:50:43.098994 20507 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0313 08:50:43.099239 20507 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0313 08:50:43.104810 20507 target.go:111] Terraform output is in /tmp/test1232504333/out I0313 08:50:43.108656 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:43.108747 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:43.108785 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:43.108829 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:43.108867 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:43.108915 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:43.108954 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:43.108982 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:43.109019 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:43.109044 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:43.139342 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:50:43.143128 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:43.143212 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:44.408360 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:44.547121 20507 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0313 08:50:44.547908 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:44.547949 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:44.548032 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:44.553382 20507 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0313 08:50:44.556756 20507 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0313 08:50:44.557278 20507 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0313 08:50:44.557459 20507 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0313 08:50:44.557504 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:44.557565 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:44.557657 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:44.557707 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:44.560758 20507 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0313 08:50:44.560873 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:44.560995 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:44.561353 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:44.561390 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:44.561457 20507 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0313 08:50:44.561647 20507 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0313 08:50:44.561826 20507 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0313 08:50:44.565894 20507 target.go:111] Terraform output is in /tmp/test3320791/out --- PASS: TestComplex (3.61s) === RUN TestCompress I0313 08:50:44.568560 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:44.568658 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:44.568692 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:44.568724 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:44.568747 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:44.568783 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:44.568811 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:44.568829 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:44.568856 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:44.568874 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:44.583259 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:50:44.585263 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:44.585326 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:45.849044 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:45.980328 20507 executor.go:111] Tasks: 0 done / 100 total; 44 can run I0313 08:50:45.980561 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:45.980593 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:45.980659 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:45.982129 20507 executor.go:111] Tasks: 44 done / 100 total; 23 can run I0313 08:50:45.985328 20507 executor.go:111] Tasks: 67 done / 100 total; 25 can run I0313 08:50:45.985499 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:45.985698 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:45.986388 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:45.986762 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:45.986830 20507 executor.go:111] Tasks: 92 done / 100 total; 2 can run I0313 08:50:45.986995 20507 executor.go:111] Tasks: 94 done / 100 total; 6 can run I0313 08:50:45.987248 20507 executor.go:111] Tasks: 100 done / 100 total; 0 can run I0313 08:50:45.991562 20507 target.go:111] Terraform output is in /tmp/test2733649069/out --- PASS: TestCompress (1.43s) === RUN TestExternalPolicies I0313 08:50:45.995240 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:45.995358 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:45.995399 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:45.995442 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:45.995480 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:45.995529 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:45.995895 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:45.995930 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:45.995968 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:45.995998 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:46.024375 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:50:46.026507 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:46.026568 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:47.304739 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:47.482893 20507 executor.go:111] Tasks: 0 done / 115 total; 47 can run I0313 08:50:47.483717 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:47.483752 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:47.483862 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:47.485793 20507 executor.go:111] Tasks: 47 done / 115 total; 22 can run I0313 08:50:47.488981 20507 executor.go:111] Tasks: 69 done / 115 total; 30 can run I0313 08:50:47.489707 20507 executor.go:111] Tasks: 99 done / 115 total; 4 can run W0313 08:50:47.489784 20507 api.go:53] PageSize not implemented W0313 08:50:47.489879 20507 api.go:53] PageSize not implemented I0313 08:50:47.495331 20507 executor.go:111] Tasks: 103 done / 115 total; 4 can run I0313 08:50:47.495501 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:47.496057 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:47.496429 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:47.496617 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:47.496728 20507 executor.go:111] Tasks: 107 done / 115 total; 2 can run I0313 08:50:47.496978 20507 executor.go:111] Tasks: 109 done / 115 total; 6 can run I0313 08:50:47.497205 20507 executor.go:111] Tasks: 115 done / 115 total; 0 can run I0313 08:50:47.502924 20507 target.go:111] Terraform output is in /tmp/test3015785783/out --- PASS: TestExternalPolicies (1.52s) === RUN TestMinimalIPv6 I0313 08:50:47.511159 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:47.511293 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:47.511339 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:47.511387 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:47.511432 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:47.511487 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:47.511529 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:47.511559 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:47.511597 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:47.511625 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:47.542277 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:50:47.546012 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:47.546105 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:48.819635 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:48.987115 20507 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0313 08:50:48.987483 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:48.987517 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:48.987600 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:48.989440 20507 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0313 08:50:48.992576 20507 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0313 08:50:48.993179 20507 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0313 08:50:48.993592 20507 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0313 08:50:48.993745 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:48.993815 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:48.993841 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:48.993932 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:49.001385 20507 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0313 08:50:49.001532 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:49.001687 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:49.001988 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:49.002219 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:49.002348 20507 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0313 08:50:49.002620 20507 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0313 08:50:49.002849 20507 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0313 08:50:49.009048 20507 target.go:111] Terraform output is in /tmp/test268696005/out --- PASS: TestMinimalIPv6 (1.50s) === RUN TestMinimalIPv6Calico I0313 08:50:49.013579 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:49.013703 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:49.013746 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:49.013794 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:49.013830 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:49.013884 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:49.013975 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:49.014004 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:49.014041 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:49.014070 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:49.041844 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:50:49.045240 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:49.045329 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:50.295246 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:50.646102 20507 executor.go:111] Tasks: 0 done / 138 total; 47 can run I0313 08:50:50.646694 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:50.646730 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:50.646849 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:50.648800 20507 executor.go:111] Tasks: 47 done / 138 total; 25 can run I0313 08:50:50.650948 20507 executor.go:111] Tasks: 72 done / 138 total; 37 can run I0313 08:50:50.651594 20507 executor.go:111] Tasks: 109 done / 138 total; 9 can run I0313 08:50:50.651972 20507 executor.go:111] Tasks: 118 done / 138 total; 8 can run I0313 08:50:50.652061 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:50.652124 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:50.652140 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:50.652186 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:50.655845 20507 executor.go:111] Tasks: 126 done / 138 total; 4 can run I0313 08:50:50.655978 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:50.656098 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:50.656432 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:50.656590 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:50.656707 20507 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0313 08:50:50.656963 20507 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0313 08:50:50.657273 20507 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0313 08:50:50.663876 20507 target.go:111] Terraform output is in /tmp/test457077201/out --- PASS: TestMinimalIPv6Calico (1.66s) === RUN TestMinimalIPv6Cilium I0313 08:50:50.669313 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:50.669448 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:50.669492 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:50.669538 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:50.669583 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:50.669636 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:50.669726 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:50.669757 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:50.669796 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:50.669825 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:50.703254 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:50:50.707309 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:50.707409 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:51.933997 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:52.148092 20507 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0313 08:50:52.148765 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:52.148814 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:52.148918 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:52.155178 20507 executor.go:111] Tasks: 47 done / 137 total; 25 can run I0313 08:50:52.158278 20507 executor.go:111] Tasks: 72 done / 137 total; 36 can run I0313 08:50:52.159102 20507 executor.go:111] Tasks: 108 done / 137 total; 9 can run I0313 08:50:52.159640 20507 executor.go:111] Tasks: 117 done / 137 total; 8 can run I0313 08:50:52.159731 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:52.159829 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:52.159881 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:52.159980 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:52.165696 20507 executor.go:111] Tasks: 125 done / 137 total; 4 can run I0313 08:50:52.165867 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:52.166010 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:52.166548 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:52.166653 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:52.166740 20507 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0313 08:50:52.167105 20507 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0313 08:50:52.167547 20507 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0313 08:50:52.174100 20507 target.go:111] Terraform output is in /tmp/test3094982356/out --- PASS: TestMinimalIPv6Cilium (1.51s) === RUN TestMinimalIPv6NoSubnetPrefix I0313 08:50:52.179052 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:52.179175 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:52.179220 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:52.179268 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:52.179311 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:52.179365 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:52.179408 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:52.179438 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:52.179477 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:52.179507 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:52.208330 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:50:52.211934 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:52.212025 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:53.502312 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:53.687341 20507 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0313 08:50:53.687853 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:53.687903 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:53.688036 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:53.694649 20507 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0313 08:50:53.699334 20507 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0313 08:50:53.700243 20507 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0313 08:50:53.700696 20507 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0313 08:50:53.700765 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:53.700838 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:53.700959 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:50:53.701040 20507 loadbalancers.go:35] PageSize not implemented I0313 08:50:53.706341 20507 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0313 08:50:53.706539 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:53.706818 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:53.707037 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:53.707587 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:53.707700 20507 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0313 08:50:53.708044 20507 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0313 08:50:53.708340 20507 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0313 08:50:53.714776 20507 target.go:111] Terraform output is in /tmp/test206005170/out --- PASS: TestMinimalIPv6NoSubnetPrefix (1.54s) === RUN TestMinimalWarmPool I0313 08:50:53.719574 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:53.719707 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:53.719752 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:53.719799 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:53.719846 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:53.719903 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:53.719945 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:53.719977 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:53.720018 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:53.720047 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:53.745057 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:50:53.749078 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:53.749153 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:54.999007 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:55.217884 20507 executor.go:111] Tasks: 0 done / 102 total; 46 can run I0313 08:50:55.219049 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:55.219090 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:55.219195 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:55.220418 20507 executor.go:111] Tasks: 46 done / 102 total; 23 can run I0313 08:50:55.225991 20507 executor.go:111] Tasks: 69 done / 102 total; 25 can run I0313 08:50:55.226367 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:55.226636 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:55.227138 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:55.227234 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:55.227334 20507 executor.go:111] Tasks: 94 done / 102 total; 2 can run I0313 08:50:55.227646 20507 executor.go:111] Tasks: 96 done / 102 total; 6 can run I0313 08:50:55.228018 20507 executor.go:111] Tasks: 102 done / 102 total; 0 can run I0313 08:50:55.233180 20507 target.go:111] Terraform output is in /tmp/test4050524244/out --- PASS: TestMinimalWarmPool (1.52s) === RUN TestMinimalEtcd I0313 08:50:55.237866 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:55.237995 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:55.238041 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:55.238090 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:55.238131 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:55.238185 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:55.238232 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:55.238262 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:55.238303 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:55.238331 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:55.269928 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:50:55.273273 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:55.273367 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:56.570405 20507 zones.go:93] ListHostedZonesPages { } W0313 08:50:56.737953 20507 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc W0313 08:50:56.738018 20507 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 10 W0313 08:50:56.740818 20507 model.go:332] overloading image in manifest (embedded etcd manifest) with images gcr.io/k8s-staging-etcdadm/etcd:v20210430-v0.1.3-739-g7da12acc I0313 08:50:56.754076 20507 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0313 08:50:56.754991 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:56.755023 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:56.755109 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:56.756858 20507 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0313 08:50:56.762654 20507 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0313 08:50:56.763045 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:56.763239 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:56.763543 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:56.763600 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:56.763657 20507 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0313 08:50:56.763867 20507 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0313 08:50:56.764143 20507 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0313 08:50:56.773186 20507 target.go:111] Terraform output is in /tmp/test2910325642/out --- PASS: TestMinimalEtcd (1.54s) === RUN TestMinimalGp3 I0313 08:50:56.778192 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:56.778325 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:56.778373 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:56.778423 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:56.778467 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:56.778521 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:56.778565 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:56.778614 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:56.778656 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:56.778686 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:56.803529 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:50:56.806883 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:56.806977 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:58.040398 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:58.219508 20507 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0313 08:50:58.219971 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:58.220019 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:58.220150 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:58.222944 20507 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0313 08:50:58.227692 20507 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0313 08:50:58.228041 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:58.228286 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:58.228442 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:58.228954 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:58.229070 20507 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0313 08:50:58.229349 20507 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0313 08:50:58.229718 20507 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0313 08:50:58.234967 20507 target.go:111] Terraform output is in /tmp/test2910503259/out --- PASS: TestMinimalGp3 (1.46s) === RUN TestMinimalLongClusterName I0313 08:50:58.243007 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:58.243176 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:58.243235 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:58.243317 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:58.243382 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:58.243473 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:58.243536 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:58.243596 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:58.243665 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:58.243718 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:58.268239 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:50:58.271570 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:58.271679 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0313 08:50:59.518633 20507 zones.go:93] ListHostedZonesPages { } I0313 08:50:59.695940 20507 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0313 08:50:59.696552 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:50:59.696589 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:50:59.696682 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:50:59.698974 20507 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0313 08:50:59.704928 20507 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0313 08:50:59.705202 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:59.705525 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:59.705778 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:59.706307 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:59.706417 20507 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0313 08:50:59.706724 20507 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0313 08:50:59.707156 20507 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0313 08:50:59.718051 20507 target.go:111] Terraform output is in /tmp/test395257334/out --- PASS: TestMinimalLongClusterName (1.48s) === RUN TestExistingSG I0313 08:50:59.722683 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:59.722816 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:59.722869 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:59.722918 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:59.722959 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:59.723013 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:59.723057 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:59.723086 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:59.723124 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:59.723154 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:59.756516 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:50:59.760034 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:59.760125 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:59.760180 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:50:59.760232 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:01.028521 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:01.215338 20507 executor.go:111] Tasks: 0 done / 163 total; 53 can run I0313 08:51:01.216556 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:01.216622 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:01.216779 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:01.221318 20507 executor.go:111] Tasks: 53 done / 163 total; 26 can run I0313 08:51:01.226429 20507 executor.go:111] Tasks: 79 done / 163 total; 54 can run I0313 08:51:01.227335 20507 executor.go:111] Tasks: 133 done / 163 total; 6 can run W0313 08:51:01.227420 20507 api.go:53] PageSize not implemented W0313 08:51:01.227542 20507 api.go:53] PageSize not implemented W0313 08:51:01.227653 20507 api.go:53] PageSize not implemented W0313 08:51:01.227783 20507 api.go:53] PageSize not implemented I0313 08:51:01.233378 20507 executor.go:111] Tasks: 139 done / 163 total; 8 can run I0313 08:51:01.233557 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:01.233730 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:01.233989 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:01.234323 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:01.234701 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:01.234843 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:01.234906 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:01.235098 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:01.235237 20507 executor.go:111] Tasks: 147 done / 163 total; 4 can run I0313 08:51:01.235701 20507 executor.go:111] Tasks: 151 done / 163 total; 12 can run I0313 08:51:01.236205 20507 executor.go:111] Tasks: 163 done / 163 total; 0 can run I0313 08:51:01.244215 20507 target.go:111] Terraform output is in /tmp/test2891922725/out --- PASS: TestExistingSG (1.53s) === RUN TestBastionAdditionalUserData I0313 08:51:01.250247 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:01.250382 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:01.250427 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:01.250472 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:01.250513 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:01.250568 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:01.250610 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:01.250639 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:01.250680 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:01.250708 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:01.283630 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:01.288009 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:01.288103 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:01.288166 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:02.569609 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:02.751657 20507 executor.go:111] Tasks: 0 done / 137 total; 47 can run I0313 08:51:02.752475 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:02.752513 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:02.752600 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:02.756110 20507 executor.go:111] Tasks: 47 done / 137 total; 30 can run I0313 08:51:02.762234 20507 executor.go:111] Tasks: 77 done / 137 total; 35 can run I0313 08:51:02.763203 20507 executor.go:111] Tasks: 112 done / 137 total; 6 can run W0313 08:51:02.763270 20507 api.go:53] PageSize not implemented W0313 08:51:02.763301 20507 api.go:53] PageSize not implemented W0313 08:51:02.763386 20507 api.go:53] PageSize not implemented I0313 08:51:02.769077 20507 executor.go:111] Tasks: 118 done / 137 total; 7 can run I0313 08:51:02.769344 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:02.769577 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:02.769869 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:02.770110 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:02.770208 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:02.770667 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:02.770799 20507 executor.go:111] Tasks: 125 done / 137 total; 3 can run I0313 08:51:02.771150 20507 executor.go:111] Tasks: 128 done / 137 total; 9 can run I0313 08:51:02.771537 20507 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0313 08:51:02.778181 20507 target.go:111] Terraform output is in /tmp/test2228428083/out --- PASS: TestBastionAdditionalUserData (1.53s) === RUN TestPrivateFlannel I0313 08:51:02.783247 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:02.783386 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:02.783431 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:02.783478 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:02.783519 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:02.783574 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:02.783659 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:02.783690 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:02.783733 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:02.783763 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:02.810732 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:51:02.813870 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:02.813942 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:02.813998 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:04.083447 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:04.282286 20507 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0313 08:51:04.283103 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:04.283157 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:04.283288 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:04.286309 20507 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0313 08:51:04.289560 20507 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0313 08:51:04.290190 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:04.290369 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:04.290501 20507 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0313 08:51:04.290579 20507 api.go:53] PageSize not implemented W0313 08:51:04.290684 20507 api.go:53] PageSize not implemented I0313 08:51:04.296102 20507 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0313 08:51:04.296307 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:04.296543 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:04.297014 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:04.297098 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:04.297206 20507 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0313 08:51:04.297496 20507 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0313 08:51:04.297786 20507 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0313 08:51:04.304497 20507 target.go:111] Terraform output is in /tmp/test2108704581/out --- PASS: TestPrivateFlannel (1.53s) === RUN TestPrivateCalico I0313 08:51:04.309555 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:04.309685 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:04.309727 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:04.309775 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:04.309827 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:04.309881 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:04.309974 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:04.310010 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:04.310052 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:04.310080 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:04.343422 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:51:04.347516 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:04.347609 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:04.347668 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:05.612266 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:06.037856 20507 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0313 08:51:06.038564 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:06.038606 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:06.038669 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:06.045074 20507 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0313 08:51:06.047497 20507 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0313 08:51:06.048030 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:06.048201 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:06.048323 20507 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0313 08:51:06.048487 20507 api.go:53] PageSize not implemented W0313 08:51:06.048519 20507 api.go:53] PageSize not implemented I0313 08:51:06.053786 20507 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0313 08:51:06.053969 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:06.054210 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:06.054706 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:06.054801 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:06.054888 20507 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0313 08:51:06.055182 20507 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0313 08:51:06.055592 20507 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0313 08:51:06.062629 20507 target.go:111] Terraform output is in /tmp/test1664077557/out --- PASS: TestPrivateCalico (1.76s) === RUN TestPrivateCilium I0313 08:51:06.068294 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:06.068428 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:06.068472 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:06.068518 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:06.068565 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:06.068636 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:06.068680 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:06.068712 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:06.068754 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:06.068782 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:06.097421 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:06.101071 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:06.101150 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:06.101204 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:07.471760 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:07.693970 20507 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0313 08:51:07.694482 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:07.694540 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:07.694691 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:07.697824 20507 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0313 08:51:07.701269 20507 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0313 08:51:07.701500 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:07.701653 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:07.702068 20507 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0313 08:51:07.702141 20507 api.go:53] PageSize not implemented W0313 08:51:07.702221 20507 api.go:53] PageSize not implemented I0313 08:51:07.712152 20507 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0313 08:51:07.712347 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:07.712572 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:07.713077 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:07.713184 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:07.713316 20507 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0313 08:51:07.713610 20507 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0313 08:51:07.713958 20507 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0313 08:51:07.721383 20507 target.go:111] Terraform output is in /tmp/test2613941029/out --- PASS: TestPrivateCilium (1.66s) === RUN TestPrivateCilium2 I0313 08:51:07.726371 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:07.726498 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:07.726541 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:07.726587 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:07.726630 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:07.726687 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:07.726769 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:07.726800 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:07.726840 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:07.726870 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:07.755178 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:51:07.758722 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:07.758796 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:07.758852 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:09.035608 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:09.726082 20507 executor.go:111] Tasks: 0 done / 138 total; 50 can run I0313 08:51:09.726444 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:09.726465 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:09.726541 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:09.730708 20507 executor.go:111] Tasks: 50 done / 138 total; 30 can run I0313 08:51:09.735023 20507 executor.go:111] Tasks: 80 done / 138 total; 36 can run I0313 08:51:09.735524 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:09.735711 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:09.735876 20507 executor.go:111] Tasks: 116 done / 138 total; 6 can run W0313 08:51:09.735967 20507 api.go:53] PageSize not implemented W0313 08:51:09.736087 20507 api.go:53] PageSize not implemented I0313 08:51:09.742078 20507 executor.go:111] Tasks: 122 done / 138 total; 8 can run I0313 08:51:09.742293 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:09.742519 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:09.742809 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:09.743215 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:09.743323 20507 executor.go:111] Tasks: 130 done / 138 total; 2 can run I0313 08:51:09.743602 20507 executor.go:111] Tasks: 132 done / 138 total; 6 can run I0313 08:51:09.743978 20507 executor.go:111] Tasks: 138 done / 138 total; 0 can run I0313 08:51:09.751658 20507 target.go:111] Terraform output is in /tmp/test3723053904/out --- PASS: TestPrivateCilium2 (2.03s) === RUN TestPrivateCiliumAdvanced I0313 08:51:09.760502 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:09.760636 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:09.760683 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:09.760733 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:09.760772 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:09.760826 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:09.760870 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:09.760900 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:09.760940 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:09.760969 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:09.792175 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:09.795364 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:09.795434 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:09.795481 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:11.088175 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:11.313035 20507 executor.go:111] Tasks: 0 done / 142 total; 54 can run I0313 08:51:11.313627 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:11.313674 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:11.313776 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:11.316502 20507 executor.go:111] Tasks: 54 done / 142 total; 30 can run I0313 08:51:11.319866 20507 executor.go:111] Tasks: 84 done / 142 total; 36 can run I0313 08:51:11.320671 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:11.320847 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:11.320966 20507 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0313 08:51:11.321180 20507 api.go:53] PageSize not implemented W0313 08:51:11.321309 20507 api.go:53] PageSize not implemented I0313 08:51:11.327727 20507 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0313 08:51:11.327924 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:11.328113 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:11.328452 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:11.328845 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:11.328963 20507 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0313 08:51:11.329259 20507 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0313 08:51:11.329597 20507 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0313 08:51:11.343193 20507 target.go:111] Terraform output is in /tmp/test3192250315/out --- PASS: TestPrivateCiliumAdvanced (1.59s) === RUN TestPrivateCiliumENI I0313 08:51:11.349646 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:11.349780 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:11.349827 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:11.349881 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:11.349927 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:11.349979 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:11.350041 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:11.350079 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:11.350119 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:11.350149 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:11.382742 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:11.386466 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:11.386566 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:11.386629 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:12.662070 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:12.865228 20507 executor.go:111] Tasks: 0 done / 136 total; 48 can run I0313 08:51:12.865904 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:12.865954 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:12.867396 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:12.873882 20507 executor.go:111] Tasks: 48 done / 136 total; 30 can run I0313 08:51:12.877670 20507 executor.go:111] Tasks: 78 done / 136 total; 36 can run I0313 08:51:12.878345 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:12.878523 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:12.878651 20507 executor.go:111] Tasks: 114 done / 136 total; 6 can run W0313 08:51:12.878703 20507 api.go:53] PageSize not implemented W0313 08:51:12.878913 20507 api.go:53] PageSize not implemented I0313 08:51:12.884645 20507 executor.go:111] Tasks: 120 done / 136 total; 8 can run I0313 08:51:12.884821 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:12.884975 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:12.885433 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:12.885588 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:12.885696 20507 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0313 08:51:12.885993 20507 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0313 08:51:12.886317 20507 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0313 08:51:12.893119 20507 target.go:111] Terraform output is in /tmp/test1063366215/out --- PASS: TestPrivateCiliumENI (1.55s) === RUN TestPrivateCanal I0313 08:51:12.898104 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:12.898231 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:12.898276 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:12.898324 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:12.898379 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:12.898435 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:12.898520 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:12.898551 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:12.898610 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:12.898647 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:12.926040 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:51:12.929523 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:12.929604 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:12.929664 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:14.258328 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:14.704611 20507 executor.go:111] Tasks: 0 done / 137 total; 49 can run I0313 08:51:14.705232 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:14.705317 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:14.705440 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:14.708345 20507 executor.go:111] Tasks: 49 done / 137 total; 30 can run I0313 08:51:14.711624 20507 executor.go:111] Tasks: 79 done / 137 total; 36 can run I0313 08:51:14.712224 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:14.712404 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:14.712526 20507 executor.go:111] Tasks: 115 done / 137 total; 6 can run W0313 08:51:14.712628 20507 api.go:53] PageSize not implemented W0313 08:51:14.712690 20507 api.go:53] PageSize not implemented I0313 08:51:14.720262 20507 executor.go:111] Tasks: 121 done / 137 total; 8 can run I0313 08:51:14.720624 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:14.721747 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:14.722978 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:14.723354 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:14.723516 20507 executor.go:111] Tasks: 129 done / 137 total; 2 can run I0313 08:51:14.723868 20507 executor.go:111] Tasks: 131 done / 137 total; 6 can run I0313 08:51:14.724259 20507 executor.go:111] Tasks: 137 done / 137 total; 0 can run I0313 08:51:14.731817 20507 target.go:111] Terraform output is in /tmp/test3568118080/out --- PASS: TestPrivateCanal (1.84s) === RUN TestPrivateKopeio I0313 08:51:14.738198 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:14.738329 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:14.738374 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:14.738424 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:14.738471 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:14.738527 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:14.738571 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:14.738628 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:14.738669 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:14.738701 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:14.767990 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:14.771187 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:14.771265 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:14.771349 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:16.071160 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:16.260660 20507 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0313 08:51:16.261256 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:16.261296 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:16.261398 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:16.263441 20507 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0313 08:51:16.266088 20507 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0313 08:51:16.266854 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:16.267029 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:16.267154 20507 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0313 08:51:16.267210 20507 api.go:53] PageSize not implemented W0313 08:51:16.267430 20507 api.go:53] PageSize not implemented I0313 08:51:16.272781 20507 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0313 08:51:16.272986 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:16.273227 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:16.273742 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:16.273834 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:16.273931 20507 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0313 08:51:16.274339 20507 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0313 08:51:16.274666 20507 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0313 08:51:16.281566 20507 target.go:111] Terraform output is in /tmp/test3200940192/out --- PASS: TestPrivateKopeio (1.55s) === RUN TestUnmanaged I0313 08:51:16.286454 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:16.286581 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:16.286624 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:16.286671 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:16.286712 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:16.286763 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:16.286810 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:16.286841 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:16.286882 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:16.286912 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:16.316145 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:16.319529 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:16.319606 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:16.319665 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:17.589054 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:17.771472 20507 executor.go:111] Tasks: 0 done / 126 total; 46 can run I0313 08:51:17.771868 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:17.771940 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:17.772086 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:17.775216 20507 executor.go:111] Tasks: 46 done / 126 total; 27 can run I0313 08:51:17.778566 20507 executor.go:111] Tasks: 73 done / 126 total; 33 can run I0313 08:51:17.779194 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:17.779368 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:17.779480 20507 executor.go:111] Tasks: 106 done / 126 total; 5 can run W0313 08:51:17.779550 20507 api.go:53] PageSize not implemented W0313 08:51:17.779755 20507 api.go:53] PageSize not implemented I0313 08:51:17.784955 20507 executor.go:111] Tasks: 111 done / 126 total; 7 can run I0313 08:51:17.785215 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:17.785537 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:17.785766 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:17.786314 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:17.786440 20507 executor.go:111] Tasks: 118 done / 126 total; 2 can run I0313 08:51:17.786758 20507 executor.go:111] Tasks: 120 done / 126 total; 6 can run I0313 08:51:17.787188 20507 executor.go:111] Tasks: 126 done / 126 total; 0 can run I0313 08:51:17.793511 20507 target.go:111] Terraform output is in /tmp/test3414302556/out --- PASS: TestUnmanaged (1.52s) === RUN TestPrivateSharedSubnet I0313 08:51:17.803152 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:17.803297 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:17.803344 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:17.803394 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:17.803442 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:17.803497 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:17.803541 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:17.803571 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:17.803612 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:17.803642 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:17.831683 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:17.835426 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:17.835517 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:17.835603 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:19.130416 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:19.311959 20507 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0313 08:51:19.312805 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:19.312868 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:19.312984 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:19.315244 20507 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0313 08:51:19.315782 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:51:19.318299 20507 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0313 08:51:19.318815 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:19.318976 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:19.319076 20507 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0313 08:51:19.319144 20507 api.go:53] PageSize not implemented W0313 08:51:19.319274 20507 api.go:53] PageSize not implemented I0313 08:51:19.324803 20507 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0313 08:51:19.324984 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:19.325237 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:19.326568 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:19.326930 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:19.327075 20507 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0313 08:51:19.327693 20507 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0313 08:51:19.328259 20507 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0313 08:51:19.336311 20507 target.go:111] Terraform output is in /tmp/test4226969202/out --- PASS: TestPrivateSharedSubnet (1.54s) === RUN TestPrivateSharedIP I0313 08:51:19.341042 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:19.341177 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:19.341225 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:19.341275 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:19.341321 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:19.341379 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:19.341425 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:19.341454 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:19.341497 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:19.341704 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:19.369464 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:19.373384 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:19.373475 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:19.373540 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:20.631251 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:20.805008 20507 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0313 08:51:20.805646 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:20.805683 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:20.805757 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:20.808557 20507 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0313 08:51:20.809174 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:51:20.814760 20507 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0313 08:51:20.816131 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:20.816412 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:20.817491 20507 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0313 08:51:20.817610 20507 api.go:53] PageSize not implemented W0313 08:51:20.817730 20507 api.go:53] PageSize not implemented I0313 08:51:20.823132 20507 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0313 08:51:20.823430 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:20.823601 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:20.824077 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:20.824179 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:20.824262 20507 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0313 08:51:20.824567 20507 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0313 08:51:20.824936 20507 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0313 08:51:20.831413 20507 target.go:111] Terraform output is in /tmp/test3832845288/out --- PASS: TestPrivateSharedIP (1.50s) === RUN TestPrivateDns1 I0313 08:51:20.836241 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:20.836371 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:20.836415 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:20.836467 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:20.836516 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:20.836595 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:20.836645 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:20.836677 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:20.836722 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:20.836753 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0313 08:51:20.867893 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:20.867973 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:20.868029 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:22.346426 20507 executor.go:111] Tasks: 0 done / 135 total; 46 can run I0313 08:51:22.350190 20507 executor.go:111] Tasks: 46 done / 135 total; 28 can run I0313 08:51:22.350833 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "internal.example.com" I0313 08:51:22.350876 20507 zones.go:40] GetHostedZone { Id: "/hostedzone/Z2AFAKE1ZON3NO" } I0313 08:51:22.350978 20507 dnszone.go:248] Existing zone "internal.example.com." found; will configure TF to reuse I0313 08:51:22.350996 20507 dnszone.go:271] No association between VPC "privatedns1.example.com" and zone "internal.example.com."; adding I0313 08:51:22.351103 20507 executor.go:111] Tasks: 74 done / 135 total; 39 can run I0313 08:51:22.351620 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:22.351859 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:22.354740 20507 executor.go:111] Tasks: 113 done / 135 total; 6 can run W0313 08:51:22.354888 20507 api.go:53] PageSize not implemented W0313 08:51:22.354958 20507 api.go:53] PageSize not implemented I0313 08:51:22.364356 20507 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0313 08:51:22.364672 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:22.364921 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:22.365204 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:22.365734 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:22.365855 20507 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0313 08:51:22.366185 20507 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0313 08:51:22.366520 20507 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0313 08:51:22.374692 20507 target.go:111] Terraform output is in /tmp/test3991247808/out --- PASS: TestPrivateDns1 (1.54s) === RUN TestPrivateDns2 I0313 08:51:22.379635 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:22.379792 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:22.379848 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:22.379933 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:22.379998 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:22.380088 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:22.380152 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:22.380210 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:22.380283 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:22.380332 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:22.410680 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:22.410782 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:22.410872 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:23.863183 20507 executor.go:111] Tasks: 0 done / 132 total; 45 can run I0313 08:51:23.866012 20507 executor.go:111] Tasks: 45 done / 132 total; 26 can run I0313 08:51:23.866214 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "private.example.com" I0313 08:51:23.866269 20507 zones.go:40] GetHostedZone { Id: "/hostedzone/Z3AFAKE1ZOMORE" } I0313 08:51:23.866366 20507 dnszone.go:248] Existing zone "private.example.com." found; will configure TF to reuse I0313 08:51:23.866394 20507 dnszone.go:262] VPC "vpc-12345678" already associated with zone "private.example.com." I0313 08:51:23.866460 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:51:23.866823 20507 executor.go:111] Tasks: 71 done / 132 total; 39 can run I0313 08:51:23.867456 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:23.867690 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:23.870514 20507 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0313 08:51:23.870581 20507 api.go:53] PageSize not implemented W0313 08:51:23.870730 20507 api.go:53] PageSize not implemented I0313 08:51:23.876352 20507 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0313 08:51:23.876551 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:23.876839 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:23.877247 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:23.877340 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:23.877432 20507 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0313 08:51:23.877782 20507 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0313 08:51:23.878200 20507 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0313 08:51:23.884543 20507 target.go:111] Terraform output is in /tmp/test713735071/out --- PASS: TestPrivateDns2 (1.51s) === RUN TestDiscoveryFeatureGate I0313 08:51:23.889309 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:23.889438 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:23.889482 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:23.889531 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:23.889575 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:23.889629 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:23.889718 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:23.889750 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:23.889789 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:23.889820 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:23.911886 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:51:23.914377 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:23.914447 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:25.169964 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:25.383788 20507 executor.go:111] Tasks: 0 done / 113 total; 52 can run I0313 08:51:25.384262 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:25.384294 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:25.384385 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:25.387868 20507 executor.go:111] Tasks: 52 done / 113 total; 28 can run I0313 08:51:25.393938 20507 executor.go:111] Tasks: 80 done / 113 total; 25 can run I0313 08:51:25.394244 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:25.394511 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:25.394997 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:25.395100 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:25.395212 20507 executor.go:111] Tasks: 105 done / 113 total; 2 can run I0313 08:51:25.395634 20507 executor.go:111] Tasks: 107 done / 113 total; 6 can run I0313 08:51:25.396042 20507 executor.go:111] Tasks: 113 done / 113 total; 0 can run I0313 08:51:25.402115 20507 target.go:111] Terraform output is in /tmp/test2527806906/out --- PASS: TestDiscoveryFeatureGate (1.52s) === RUN TestVFSServiceAccountIssuerDiscovery I0313 08:51:25.407870 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:25.408002 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:25.408046 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:25.408093 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:25.408135 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:25.408191 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:25.408238 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:25.408272 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:25.408313 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:25.408344 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:25.433086 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:25.436389 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:25.436475 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:26.741840 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:26.920756 20507 executor.go:111] Tasks: 0 done / 104 total; 47 can run I0313 08:51:26.921846 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:26.921885 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:26.922024 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:26.924214 20507 executor.go:111] Tasks: 47 done / 104 total; 24 can run I0313 08:51:26.930179 20507 executor.go:111] Tasks: 71 done / 104 total; 25 can run I0313 08:51:26.930461 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:26.930860 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:26.931234 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:26.931314 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:26.931431 20507 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0313 08:51:26.931758 20507 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0313 08:51:26.932119 20507 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0313 08:51:26.942173 20507 target.go:111] Terraform output is in /tmp/test1821132858/out --- PASS: TestVFSServiceAccountIssuerDiscovery (1.54s) === RUN TestAWSLBController I0313 08:51:26.947063 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:26.947219 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:26.947281 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:26.947346 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:26.947402 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:26.947521 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:26.947619 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:26.947705 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:26.947807 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:26.947869 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:26.974002 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:26.977603 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:26.977693 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:28.247743 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:28.969068 20507 executor.go:111] Tasks: 0 done / 116 total; 54 can run I0313 08:51:28.969489 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:28.969524 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:28.969584 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:28.977004 20507 executor.go:111] Tasks: 54 done / 116 total; 29 can run I0313 08:51:28.983292 20507 executor.go:111] Tasks: 83 done / 116 total; 25 can run I0313 08:51:28.983704 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:28.983979 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:28.984205 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:28.984798 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:28.984931 20507 executor.go:111] Tasks: 108 done / 116 total; 2 can run I0313 08:51:28.985288 20507 executor.go:111] Tasks: 110 done / 116 total; 6 can run I0313 08:51:28.985637 20507 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0313 08:51:28.992649 20507 target.go:111] Terraform output is in /tmp/test563551706/out --- PASS: TestAWSLBController (2.06s) === RUN TestManyAddons I0313 08:51:29.006365 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:29.006514 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:29.006563 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:29.006618 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:29.006665 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:29.006721 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:29.006769 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:29.006802 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:29.006843 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:29.006873 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:29.035240 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:29.038870 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:29.038962 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:30.282610 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:31.106662 20507 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0313 08:51:31.107307 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:31.107345 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:31.107447 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:31.109545 20507 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0313 08:51:31.116694 20507 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0313 08:51:31.117497 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:31.118103 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:31.119039 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:31.120709 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:31.120893 20507 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0313 08:51:31.121676 20507 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0313 08:51:31.122271 20507 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0313 08:51:31.128905 20507 target.go:111] Terraform output is in /tmp/test3987767422/out --- PASS: TestManyAddons (2.13s) === RUN TestManyAddonsCCMIRSA I0313 08:51:31.137178 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:31.137311 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:31.137359 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:31.137410 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:31.137454 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:31.137514 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:31.137560 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:31.137590 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:31.137631 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:31.137662 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:31.165777 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:31.169666 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:31.169756 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:32.427586 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:33.326432 20507 executor.go:111] Tasks: 0 done / 123 total; 59 can run I0313 08:51:33.329204 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:33.329230 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:33.329301 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:33.335642 20507 executor.go:111] Tasks: 59 done / 123 total; 30 can run I0313 08:51:33.341987 20507 executor.go:111] Tasks: 89 done / 123 total; 26 can run I0313 08:51:33.342331 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:33.342792 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:33.343044 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:33.343532 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:33.343650 20507 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0313 08:51:33.344130 20507 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0313 08:51:33.344519 20507 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0313 08:51:33.352107 20507 target.go:111] Terraform output is in /tmp/test3496905741/out --- PASS: TestManyAddonsCCMIRSA (2.23s) === RUN TestManyAddonsCCMIRSA23 I0313 08:51:33.367107 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:33.367256 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:33.367308 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:33.367358 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:33.367404 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:33.367461 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:33.367508 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:33.367539 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:33.367582 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:33.367612 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:33.397574 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0313 08:51:33.401283 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:33.401374 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:34.630504 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:35.529174 20507 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0313 08:51:35.531555 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:35.531591 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:35.531764 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:35.534201 20507 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0313 08:51:35.544553 20507 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0313 08:51:35.544836 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:35.545053 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:35.545631 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:35.545721 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:35.545819 20507 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0313 08:51:35.546143 20507 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0313 08:51:35.546549 20507 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0313 08:51:35.554325 20507 target.go:111] Terraform output is in /tmp/test3669542775/out --- PASS: TestManyAddonsCCMIRSA23 (2.20s) === RUN TestManyAddonsCCMIRSA24 I0313 08:51:35.563923 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:35.564076 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:35.564132 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:35.564190 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:35.564236 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:35.564293 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:35.564338 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:35.564368 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:35.564417 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:35.564448 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:35.587474 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:51:35.590024 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:35.590090 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:36.843162 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:37.729056 20507 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0313 08:51:37.729931 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:37.729982 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:37.730089 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:37.735149 20507 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0313 08:51:37.745957 20507 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0313 08:51:37.746221 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:37.747348 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:37.747669 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:37.748410 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:37.748518 20507 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0313 08:51:37.748813 20507 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0313 08:51:37.749155 20507 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0313 08:51:37.756722 20507 target.go:111] Terraform output is in /tmp/test3887027482/out --- PASS: TestManyAddonsCCMIRSA24 (2.20s) === RUN TestManyAddonsCCMIRSA25 I0313 08:51:37.767036 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:37.767171 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:37.767218 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:37.767264 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:37.767305 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:37.767359 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:37.767405 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:37.767435 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:37.767475 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:37.767505 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:37.794373 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0313 08:51:37.797872 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:37.797953 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:39.066828 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:39.909653 20507 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0313 08:51:39.910311 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:39.910348 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:39.910455 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:39.914076 20507 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0313 08:51:39.924305 20507 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0313 08:51:39.925469 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:39.925756 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:39.926229 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:39.926627 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:39.926747 20507 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0313 08:51:39.927141 20507 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0313 08:51:39.927439 20507 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0313 08:51:39.935327 20507 target.go:111] Terraform output is in /tmp/test3561842398/out --- PASS: TestManyAddonsCCMIRSA25 (2.18s) === RUN TestManyAddonsCCMIRSA26 I0313 08:51:39.945358 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:39.945491 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:39.945537 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:39.945587 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:39.945632 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:39.945688 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:39.945735 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:39.945769 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:39.945812 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:39.945842 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:39.973716 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0313 08:51:39.977122 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:39.977201 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:41.261742 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:42.160724 20507 executor.go:111] Tasks: 0 done / 124 total; 60 can run I0313 08:51:42.165263 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:42.165332 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:42.165458 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:42.170353 20507 executor.go:111] Tasks: 60 done / 124 total; 30 can run I0313 08:51:42.176811 20507 executor.go:111] Tasks: 90 done / 124 total; 26 can run I0313 08:51:42.177053 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:42.177382 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:42.177513 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:42.178158 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:42.178276 20507 executor.go:111] Tasks: 116 done / 124 total; 2 can run I0313 08:51:42.178600 20507 executor.go:111] Tasks: 118 done / 124 total; 6 can run I0313 08:51:42.178998 20507 executor.go:111] Tasks: 124 done / 124 total; 0 can run I0313 08:51:42.186658 20507 target.go:111] Terraform output is in /tmp/test208054409/out --- PASS: TestManyAddonsCCMIRSA26 (2.26s) === RUN TestManyAddonsGCE I0313 08:51:42.201695 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:51:44.414713 20507 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0313 08:51:44.414786 20507 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0313 08:51:44.414866 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/main" W0313 08:51:44.414881 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com/backups/etcd/events" W0313 08:51:44.414895 20507 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal.example.com" W0313 08:51:44.414938 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0313 08:51:44.415894 20507 executor.go:111] Tasks: 0 done / 67 total; 44 can run I0313 08:51:44.425379 20507 executor.go:111] Tasks: 44 done / 67 total; 17 can run I0313 08:51:44.430972 20507 executor.go:111] Tasks: 61 done / 67 total; 4 can run I0313 08:51:44.431879 20507 executor.go:111] Tasks: 65 done / 67 total; 2 can run I0313 08:51:44.432107 20507 executor.go:111] Tasks: 67 done / 67 total; 0 can run I0313 08:51:44.436121 20507 target.go:111] Terraform output is in /tmp/test1333323863/out --- PASS: TestManyAddonsGCE (2.24s) === RUN TestCCM I0313 08:51:44.441063 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:44.441146 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:44.441176 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:44.441207 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:44.441234 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:44.441267 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:44.441294 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:44.441311 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:44.441337 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:44.441355 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:44.467605 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:44.471079 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:44.471164 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:45.717842 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:46.543023 20507 executor.go:111] Tasks: 0 done / 110 total; 51 can run I0313 08:51:46.543694 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:46.543731 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:46.543857 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:46.547648 20507 executor.go:111] Tasks: 51 done / 110 total; 24 can run I0313 08:51:46.553612 20507 executor.go:111] Tasks: 75 done / 110 total; 27 can run I0313 08:51:46.554151 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:46.554364 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:46.554828 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:46.555534 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:46.556055 20507 executor.go:111] Tasks: 102 done / 110 total; 2 can run I0313 08:51:46.556848 20507 executor.go:111] Tasks: 104 done / 110 total; 6 can run I0313 08:51:46.557737 20507 executor.go:111] Tasks: 110 done / 110 total; 0 can run I0313 08:51:46.566578 20507 target.go:111] Terraform output is in /tmp/test4038018798/out --- PASS: TestCCM (2.14s) === RUN TestExternalDNS I0313 08:51:46.576668 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:46.576812 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:46.576863 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:46.576915 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:46.576963 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:46.577018 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:46.577065 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:46.577096 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:46.577136 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:46.577169 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:46.601370 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:46.604459 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:46.604544 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:47.870967 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:48.046449 20507 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0313 08:51:48.048398 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:48.048440 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:48.048535 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:48.050191 20507 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0313 08:51:48.056216 20507 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0313 08:51:48.056498 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:48.056710 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:48.056979 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:48.057409 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:48.057568 20507 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0313 08:51:48.057956 20507 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0313 08:51:48.058307 20507 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0313 08:51:48.063266 20507 target.go:111] Terraform output is in /tmp/test111161652/out --- PASS: TestExternalDNS (1.49s) === RUN TestExternalDNSIRSA I0313 08:51:48.067784 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:48.067908 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:48.067955 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:48.068002 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:48.068043 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:48.068099 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:48.068144 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:48.068174 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:48.068216 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:48.068246 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:48.093113 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:48.096364 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:48.096478 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:49.386967 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:49.605729 20507 executor.go:111] Tasks: 0 done / 112 total; 51 can run I0313 08:51:49.606385 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:49.606431 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:49.606550 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:49.609469 20507 executor.go:111] Tasks: 51 done / 112 total; 28 can run I0313 08:51:49.615273 20507 executor.go:111] Tasks: 79 done / 112 total; 25 can run I0313 08:51:49.615853 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:49.616117 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:49.616392 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:49.616953 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:49.617075 20507 executor.go:111] Tasks: 104 done / 112 total; 2 can run I0313 08:51:49.617355 20507 executor.go:111] Tasks: 106 done / 112 total; 6 can run I0313 08:51:49.617703 20507 executor.go:111] Tasks: 112 done / 112 total; 0 can run I0313 08:51:49.623928 20507 target.go:111] Terraform output is in /tmp/test1221585313/out --- PASS: TestExternalDNSIRSA (1.56s) === RUN TestKarpenter I0313 08:51:49.629523 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:49.629651 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:49.629697 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:49.629745 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:49.629788 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:49.629844 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:49.629891 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:49.629922 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:49.629963 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:49.629994 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:49.665450 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:51:49.669258 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:49.669346 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:49.669407 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:50.957329 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:51.156401 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:51.156656 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:51.156823 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0313 08:51:51.300055 20507 pruning.go:115] manifest includes an object of GroupKind Secret, which will not be pruned W0313 08:51:51.300145 20507 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0313 08:51:51.300168 20507 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned W0313 08:51:51.300184 20507 pruning.go:115] manifest includes an object of GroupKind AWSNodeTemplate.karpenter.k8s.aws, which will not be pruned W0313 08:51:51.300199 20507 pruning.go:115] manifest includes an object of GroupKind Provisioner.karpenter.sh, which will not be pruned I0313 08:51:51.319521 20507 executor.go:111] Tasks: 0 done / 122 total; 54 can run I0313 08:51:51.321642 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:51.321713 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:51.321893 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:51.327317 20507 executor.go:111] Tasks: 54 done / 122 total; 31 can run I0313 08:51:51.334189 20507 executor.go:111] Tasks: 85 done / 122 total; 29 can run I0313 08:51:51.334540 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:51.334859 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:51.335016 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:51.335303 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:51.335499 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:51.335592 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:51.335808 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:51.336057 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:51.336166 20507 executor.go:111] Tasks: 114 done / 122 total; 2 can run I0313 08:51:51.336483 20507 executor.go:111] Tasks: 116 done / 122 total; 6 can run I0313 08:51:51.336864 20507 executor.go:111] Tasks: 122 done / 122 total; 0 can run I0313 08:51:51.344294 20507 target.go:111] Terraform output is in /tmp/test876406681/out --- PASS: TestKarpenter (1.72s) === RUN TestSharedSubnet I0313 08:51:51.351164 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:51.351296 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:51.351344 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:51.351395 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:51.351441 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:51.351498 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:51.351545 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:51.351577 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:51.351622 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:51.351654 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:51.382608 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:51.385888 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:51.385981 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:52.646451 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:52.829613 20507 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0313 08:51:52.832673 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:52.832713 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:52.832807 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:52.834523 20507 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0313 08:51:52.834923 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:51:52.840382 20507 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0313 08:51:52.840806 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:52.841216 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:52.841498 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:52.842932 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:52.843101 20507 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0313 08:51:52.843997 20507 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0313 08:51:52.845156 20507 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0313 08:51:52.852100 20507 target.go:111] Terraform output is in /tmp/test2810354266/out --- PASS: TestSharedSubnet (1.51s) === RUN TestSharedVPC I0313 08:51:52.856584 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:52.856714 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:52.856762 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:52.856813 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:52.856858 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:52.856915 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:52.856960 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:52.856990 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:52.857031 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:52.857061 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:52.882649 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:52.885950 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:52.886046 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:54.120529 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:54.299081 20507 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0313 08:51:54.303065 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:54.303226 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:54.303525 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:54.307723 20507 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0313 08:51:54.308185 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:51:54.313732 20507 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0313 08:51:54.314108 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:54.314271 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:54.314833 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:54.314933 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:54.315025 20507 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0313 08:51:54.315384 20507 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0313 08:51:54.315771 20507 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0313 08:51:54.320982 20507 target.go:111] Terraform output is in /tmp/test687346039/out --- PASS: TestSharedVPC (1.47s) === RUN TestSharedVPCIPv6 I0313 08:51:54.325545 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:54.325669 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:54.325712 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:54.325766 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:54.325834 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:54.325888 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:54.325936 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:54.325966 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:54.326030 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:54.326063 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:54.328138 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:51:54.328201 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:51:54.355540 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:51:54.355598 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "vpc-id", Values: ["vpc-12345678"] }] } I0313 08:51:54.355703 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:51:54.359705 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:54.359790 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:55.628615 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:55.821777 20507 executor.go:111] Tasks: 0 done / 133 total; 45 can run I0313 08:51:55.823459 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:55.823496 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:55.823592 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:55.826325 20507 executor.go:111] Tasks: 45 done / 133 total; 29 can run I0313 08:51:55.826528 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:51:55.826658 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:51:55.829412 20507 executor.go:111] Tasks: 74 done / 133 total; 37 can run I0313 08:51:55.830436 20507 executor.go:111] Tasks: 111 done / 133 total; 6 can run I0313 08:51:55.830510 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:51:55.830578 20507 loadbalancers.go:35] PageSize not implemented I0313 08:51:55.830728 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:51:55.830834 20507 loadbalancers.go:35] PageSize not implemented I0313 08:51:55.836417 20507 executor.go:111] Tasks: 117 done / 133 total; 8 can run I0313 08:51:55.836750 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:55.836991 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:55.837211 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:55.837715 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:55.837827 20507 executor.go:111] Tasks: 125 done / 133 total; 2 can run I0313 08:51:55.838138 20507 executor.go:111] Tasks: 127 done / 133 total; 6 can run I0313 08:51:55.838495 20507 executor.go:111] Tasks: 133 done / 133 total; 0 can run I0313 08:51:55.849786 20507 target.go:111] Terraform output is in /tmp/test3828427699/out --- PASS: TestSharedVPCIPv6 (1.53s) === RUN TestExistingIAM I0313 08:51:55.854700 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:55.854826 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:55.854872 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:55.854925 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:55.854974 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:55.855033 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:55.855080 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:55.855112 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:55.855154 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:55.855185 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:55.887667 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:55.891163 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:55.891247 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:55.891304 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:55.891360 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:57.170926 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:57.359535 20507 executor.go:111] Tasks: 0 done / 117 total; 51 can run I0313 08:51:57.359866 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:51:57.359897 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:51:57.359989 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:51:57.363750 20507 executor.go:111] Tasks: 51 done / 117 total; 19 can run I0313 08:51:57.369757 20507 executor.go:111] Tasks: 70 done / 117 total; 31 can run I0313 08:51:57.370150 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:57.370468 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:57.370695 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:57.370974 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:57.371161 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:57.371251 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:57.371343 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:57.371441 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:57.371565 20507 executor.go:111] Tasks: 101 done / 117 total; 4 can run I0313 08:51:57.372401 20507 executor.go:111] Tasks: 105 done / 117 total; 12 can run I0313 08:51:57.372837 20507 executor.go:111] Tasks: 117 done / 117 total; 0 can run I0313 08:51:57.379525 20507 target.go:111] Terraform output is in /tmp/test2689941866/out --- PASS: TestExistingIAM (1.53s) === RUN TestPhaseNetwork I0313 08:51:57.384795 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:57.384924 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:57.384972 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:57.385021 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:57.385090 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:57.385149 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:57.385193 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:57.385225 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:57.385283 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:57.385315 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:57.417266 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:57.420782 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:57.420879 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:57.420938 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:58.709346 20507 zones.go:93] ListHostedZonesPages { } I0313 08:51:58.878193 20507 executor.go:111] Tasks: 0 done / 135 total; 47 can run I0313 08:51:58.878799 20507 executor.go:111] Tasks: 47 done / 135 total; 30 can run I0313 08:51:58.879343 20507 executor.go:111] Tasks: 77 done / 135 total; 36 can run I0313 08:51:58.879787 20507 executor.go:111] Tasks: 113 done / 135 total; 6 can run I0313 08:51:58.879993 20507 executor.go:111] Tasks: 119 done / 135 total; 8 can run I0313 08:51:58.880226 20507 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0313 08:51:58.880333 20507 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0313 08:51:58.880414 20507 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0313 08:51:58.881420 20507 target.go:111] Terraform output is in /tmp/test3940184880/out --- PASS: TestPhaseNetwork (1.50s) === RUN TestExternalLoadBalancer I0313 08:51:58.882072 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:51:58.882221 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:51:58.882269 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:51:58.882329 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:51:58.882384 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:51:58.882465 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:51:58.882532 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:51:58.882576 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:51:58.882633 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:51:58.882669 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:51:58.912080 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:51:58.915346 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:51:58.915448 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:00.177055 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:00.352972 20507 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0313 08:52:00.353496 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:00.353541 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:00.354803 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:00.362175 20507 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0313 08:52:00.368137 20507 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0313 08:52:00.368471 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:00.368884 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:00.369302 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:00.369382 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:00.369517 20507 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0313 08:52:00.369845 20507 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0313 08:52:00.370190 20507 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0313 08:52:00.375607 20507 target.go:111] Terraform output is in /tmp/test90151165/out --- PASS: TestExternalLoadBalancer (1.50s) === RUN TestPhaseIAM integration_test.go:1062: unable to test w/o allowing failed validation --- SKIP: TestPhaseIAM (0.00s) === RUN TestPhaseCluster integration_test.go:1070: unable to test w/o allowing failed validation --- SKIP: TestPhaseCluster (0.00s) === RUN TestMixedInstancesASG I0313 08:52:00.380258 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:00.380383 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:00.380427 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:00.380476 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:00.380517 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:00.380573 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:00.380616 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:00.380649 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:00.380691 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:00.380721 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:00.412381 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:52:00.415591 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:00.415660 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:00.415709 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:00.415756 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:00.415798 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:00.415834 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:00.415886 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.697563 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:01.899256 20507 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0313 08:52:01.901676 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:01.901710 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:01.901803 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:01.903450 20507 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0313 08:52:01.914172 20507 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0313 08:52:01.914525 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.914747 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.914981 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.915267 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.915430 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.915671 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.915829 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.916041 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.916167 20507 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0313 08:52:01.916532 20507 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0313 08:52:01.916894 20507 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0313 08:52:01.924199 20507 target.go:111] Terraform output is in /tmp/test450373728/out --- PASS: TestMixedInstancesASG (1.55s) === RUN TestMixedInstancesSpotASG I0313 08:52:01.929848 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:01.929985 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:01.930030 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:01.930079 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:01.930128 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:01.930186 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:01.930228 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:01.930258 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:01.930300 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:01.930327 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:01.962589 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:52:01.965874 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.965952 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.966005 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.966058 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.966108 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.966155 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:01.966195 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:03.232393 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:03.427785 20507 executor.go:111] Tasks: 0 done / 127 total; 53 can run I0313 08:52:03.430080 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:03.430127 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:03.430269 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:03.433138 20507 executor.go:111] Tasks: 53 done / 127 total; 27 can run I0313 08:52:03.439017 20507 executor.go:111] Tasks: 80 done / 127 total; 31 can run I0313 08:52:03.439404 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:03.439628 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:03.439901 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:03.440182 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:03.440350 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:03.440492 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:03.440594 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:03.440794 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:03.440956 20507 executor.go:111] Tasks: 111 done / 127 total; 4 can run I0313 08:52:03.441343 20507 executor.go:111] Tasks: 115 done / 127 total; 12 can run I0313 08:52:03.441797 20507 executor.go:111] Tasks: 127 done / 127 total; 0 can run I0313 08:52:03.449124 20507 target.go:111] Terraform output is in /tmp/test436960037/out --- PASS: TestMixedInstancesSpotASG (1.53s) === RUN TestAdditionalObjects I0313 08:52:03.456014 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:03.456255 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:03.456299 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:03.456364 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:03.456439 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:03.456526 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:03.456589 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:03.456647 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:03.456706 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:03.456751 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:03.485975 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0313 08:52:03.489327 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:03.489416 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:04.784714 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:04.935533 20507 executor.go:111] Tasks: 0 done / 104 total; 45 can run I0313 08:52:04.936382 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:04.936431 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:04.936566 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:04.941812 20507 executor.go:111] Tasks: 45 done / 104 total; 23 can run I0313 08:52:04.948666 20507 executor.go:111] Tasks: 68 done / 104 total; 28 can run I0313 08:52:04.949025 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:04.949290 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:04.949508 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:04.950258 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:04.950445 20507 executor.go:111] Tasks: 96 done / 104 total; 2 can run I0313 08:52:04.950740 20507 executor.go:111] Tasks: 98 done / 104 total; 6 can run I0313 08:52:04.951093 20507 executor.go:111] Tasks: 104 done / 104 total; 0 can run I0313 08:52:04.956804 20507 target.go:111] Terraform output is in /tmp/test3130573636/out --- PASS: TestAdditionalObjects (1.51s) === RUN TestContainerd I0313 08:52:04.961390 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:04.961521 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:04.961567 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:04.961615 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:04.961661 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:04.961715 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:04.961761 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:04.961794 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:04.961838 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:04.961869 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:04.983789 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:52:04.986996 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:04.987085 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:06.224329 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:06.409655 20507 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0313 08:52:06.410983 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:06.411019 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:06.411111 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:06.413392 20507 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0313 08:52:06.419345 20507 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0313 08:52:06.419793 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:06.420133 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:06.420373 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:06.420895 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:06.421017 20507 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0313 08:52:06.421356 20507 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0313 08:52:06.421749 20507 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0313 08:52:06.426883 20507 target.go:111] Terraform output is in /tmp/test1900716548/out --- PASS: TestContainerd (1.47s) === RUN TestContainerdCustom I0313 08:52:06.431444 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:06.431569 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:06.431616 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:06.431663 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:06.431704 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:06.431757 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:06.431802 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:06.431833 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:06.431875 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:06.431904 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:06.462142 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:52:06.465560 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:06.465654 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:06.936894 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:07.114097 20507 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0313 08:52:07.114806 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:07.114858 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:07.114954 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:07.118654 20507 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0313 08:52:07.129014 20507 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0313 08:52:07.129268 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:07.129473 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:07.129914 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:07.130037 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:07.130427 20507 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0313 08:52:07.130724 20507 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0313 08:52:07.131036 20507 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0313 08:52:07.136118 20507 target.go:111] Terraform output is in /tmp/test1291414619/out --- PASS: TestContainerdCustom (0.71s) === RUN TestDockerCustom I0313 08:52:07.140987 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:07.141186 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:07.141260 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:07.141338 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:07.141423 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:07.141530 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:07.141616 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:07.141679 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:07.141759 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:07.141806 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:07.167265 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.23.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.23.17 ********************************************************************************* I0313 08:52:07.170854 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:07.170944 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:07.642956 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:07.805004 20507 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0313 08:52:07.805543 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:07.805593 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:07.805724 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:07.814464 20507 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0313 08:52:07.820981 20507 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0313 08:52:07.821510 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:07.821745 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:07.822297 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:07.822366 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:07.822486 20507 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0313 08:52:07.822810 20507 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0313 08:52:07.823211 20507 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0313 08:52:07.828455 20507 target.go:111] Terraform output is in /tmp/test968091777/out --- PASS: TestDockerCustom (0.69s) === RUN TestAPIServerNodes I0313 08:52:07.832978 20507 featureflag.go:164] FeatureFlag "APIServerNodes"=true I0313 08:52:07.833005 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:07.833125 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:07.833171 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:07.833217 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:07.833262 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:07.833317 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:07.833360 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:07.833391 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:07.833432 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:07.833461 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:07.859803 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0313 08:52:07.862799 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:07.862874 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:07.862928 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:09.209300 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:09.398011 20507 executor.go:111] Tasks: 0 done / 114 total; 47 can run I0313 08:52:09.398307 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:09.398334 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:09.398424 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:09.401996 20507 executor.go:111] Tasks: 47 done / 114 total; 28 can run I0313 08:52:09.407892 20507 executor.go:111] Tasks: 75 done / 114 total; 27 can run I0313 08:52:09.408236 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:09.408431 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:09.408672 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:09.408884 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:09.409109 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:09.409198 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:09.409294 20507 executor.go:111] Tasks: 102 done / 114 total; 3 can run I0313 08:52:09.409623 20507 executor.go:111] Tasks: 105 done / 114 total; 9 can run I0313 08:52:09.409992 20507 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0313 08:52:09.415804 20507 target.go:111] Terraform output is in /tmp/test1279981040/out I0313 08:52:09.425103 20507 featureflag.go:164] FeatureFlag "APIServerNodes"=false --- PASS: TestAPIServerNodes (1.59s) === RUN TestNTHIMDSProcessor I0313 08:52:09.425389 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:09.425612 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:09.425688 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:09.425788 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:09.425873 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:09.425977 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:09.426069 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:09.426111 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:09.426157 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:09.426189 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:09.451228 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:52:09.454532 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:09.454623 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:10.755989 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:10.929198 20507 executor.go:111] Tasks: 0 done / 90 total; 44 can run I0313 08:52:10.930837 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:10.930893 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:10.930997 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:10.938433 20507 executor.go:111] Tasks: 44 done / 90 total; 19 can run I0313 08:52:10.944590 20507 executor.go:111] Tasks: 63 done / 90 total; 21 can run I0313 08:52:10.945175 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:10.945483 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:10.946011 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:10.946434 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:10.946562 20507 executor.go:111] Tasks: 84 done / 90 total; 2 can run I0313 08:52:10.947009 20507 executor.go:111] Tasks: 86 done / 90 total; 4 can run I0313 08:52:10.947345 20507 executor.go:111] Tasks: 90 done / 90 total; 0 can run I0313 08:52:10.952081 20507 target.go:111] Terraform output is in /tmp/test2591685853/out --- PASS: TestNTHIMDSProcessor (1.53s) === RUN TestNTHIMDSProcessorIRSA I0313 08:52:10.956087 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:10.956212 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:10.956260 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:10.956307 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:10.956349 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:10.956405 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:10.956450 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:10.956481 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:10.956523 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:10.956552 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:10.982147 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:52:10.985532 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:10.985609 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:12.251103 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:12.474951 20507 executor.go:111] Tasks: 0 done / 101 total; 50 can run I0313 08:52:12.475457 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:12.475491 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:12.475582 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:12.481550 20507 executor.go:111] Tasks: 50 done / 101 total; 24 can run I0313 08:52:12.489449 20507 executor.go:111] Tasks: 74 done / 101 total; 21 can run I0313 08:52:12.489861 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:12.490070 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:12.490367 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:12.490846 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:12.490960 20507 executor.go:111] Tasks: 95 done / 101 total; 2 can run I0313 08:52:12.491247 20507 executor.go:111] Tasks: 97 done / 101 total; 4 can run I0313 08:52:12.491540 20507 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0313 08:52:12.497502 20507 target.go:111] Terraform output is in /tmp/test3063287777/out --- PASS: TestNTHIMDSProcessorIRSA (1.55s) === RUN TestCustomIRSA I0313 08:52:12.502643 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:12.502774 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:12.502820 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:12.502865 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:12.502907 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:12.502962 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:12.503009 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:12.503038 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:12.503077 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:12.503104 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:12.531115 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:52:12.534639 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:12.534722 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:13.824288 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:14.479760 20507 executor.go:111] Tasks: 0 done / 114 total; 52 can run I0313 08:52:14.480650 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:14.480690 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:14.480790 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:14.484794 20507 executor.go:111] Tasks: 52 done / 114 total; 29 can run I0313 08:52:14.490651 20507 executor.go:111] Tasks: 81 done / 114 total; 25 can run I0313 08:52:14.490937 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:14.491197 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:14.491436 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:14.491943 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:14.492067 20507 executor.go:111] Tasks: 106 done / 114 total; 2 can run I0313 08:52:14.492399 20507 executor.go:111] Tasks: 108 done / 114 total; 6 can run I0313 08:52:14.492730 20507 executor.go:111] Tasks: 114 done / 114 total; 0 can run I0313 08:52:14.499659 20507 target.go:111] Terraform output is in /tmp/test981045888/out --- PASS: TestCustomIRSA (2.02s) === RUN TestClusterNameDigit I0313 08:52:14.518917 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:14.519046 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:14.519086 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:14.519135 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:14.519167 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:14.519200 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:14.519228 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:14.519246 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:14.519272 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:14.519289 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:14.534363 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:52:14.536386 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:14.536437 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:15.795588 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:15.972193 20507 executor.go:111] Tasks: 0 done / 109 total; 49 can run I0313 08:52:15.974228 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:15.974257 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:15.974321 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:15.975930 20507 executor.go:111] Tasks: 49 done / 109 total; 27 can run I0313 08:52:15.982143 20507 executor.go:111] Tasks: 76 done / 109 total; 25 can run I0313 08:52:15.982413 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:15.982734 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:15.983049 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:15.983786 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:15.983961 20507 executor.go:111] Tasks: 101 done / 109 total; 2 can run I0313 08:52:15.984370 20507 executor.go:111] Tasks: 103 done / 109 total; 6 can run I0313 08:52:15.984708 20507 executor.go:111] Tasks: 109 done / 109 total; 0 can run I0313 08:52:15.990480 20507 target.go:111] Terraform output is in /tmp/test3412118656/out --- PASS: TestClusterNameDigit (1.48s) === RUN TestCASPriorityExpander I0313 08:52:15.995482 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:15.995615 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:15.995660 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:15.995708 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:15.995753 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:15.995813 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:15.995856 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:15.995884 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:15.995926 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:15.995954 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:16.029388 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0313 08:52:16.034051 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:16.034154 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:16.034212 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:16.034265 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0313 08:52:17.936925 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:18.137903 20507 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0313 08:52:18.138493 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:18.138515 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:18.138589 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:18.146732 20507 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0313 08:52:18.153834 20507 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0313 08:52:18.154125 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:18.154438 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:18.154588 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:18.154833 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:18.155072 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:18.155160 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:18.155220 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:18.155637 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:18.155766 20507 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0313 08:52:18.156280 20507 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0313 08:52:18.156801 20507 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0313 08:52:18.163118 20507 target.go:111] Terraform output is in /tmp/test3910800296/out --- PASS: TestCASPriorityExpander (2.17s) === RUN TestCASPriorityExpanderCustom I0313 08:52:18.168460 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:18.168606 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:18.168665 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:18.168715 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:18.168757 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:18.168810 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:18.168857 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:18.168887 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:18.168928 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:18.168957 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:52:18.204226 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* I0313 08:52:18.208984 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:18.209074 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:18.209130 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:18.209185 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0313 08:52:19.480421 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:19.688550 20507 executor.go:111] Tasks: 0 done / 116 total; 46 can run I0313 08:52:19.692139 20507 dnszone.go:241] Check for existing route53 zone to re-use with name "" I0313 08:52:19.692186 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:19.692288 20507 dnszone.go:248] Existing zone "example.com." found; will configure TF to reuse I0313 08:52:19.695983 20507 executor.go:111] Tasks: 46 done / 116 total; 25 can run I0313 08:52:19.702830 20507 executor.go:111] Tasks: 71 done / 116 total; 29 can run I0313 08:52:19.703112 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:19.703524 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:19.703692 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:19.703935 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:19.704220 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:19.704350 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:19.704452 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:19.704680 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:19.704799 20507 executor.go:111] Tasks: 100 done / 116 total; 4 can run I0313 08:52:19.705378 20507 executor.go:111] Tasks: 104 done / 116 total; 12 can run I0313 08:52:19.706148 20507 executor.go:111] Tasks: 116 done / 116 total; 0 can run I0313 08:52:19.726171 20507 target.go:111] Terraform output is in /tmp/test3095058978/out --- PASS: TestCASPriorityExpanderCustom (1.56s) === RUN TestLifecycleMinimalAWS I0313 08:52:19.731419 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:19.731551 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:19.731600 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:19.731651 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:19.731693 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:19.731748 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:19.731794 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:19.731827 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:19.731868 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:19.731897 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0313 08:52:19.755772 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0313 08:52:19.758973 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:19.759057 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0313 08:52:21.106556 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:21.289517 20507 iamrole.go:89] ListRoles: { } I0313 08:52:21.291068 20507 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0313 08:52:21.291385 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:21.291594 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:52:21.291758 20507 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.291953 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:21.292057 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0313 08:52:21.292181 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] } I0313 08:52:21.292216 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0313 08:52:21.292313 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0313 08:52:21.292364 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:52:21.292371 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0313 08:52:21.292434 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:21.292542 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0313 08:52:21.292666 20507 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.292807 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:52:21.292869 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:21.293040 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:52:21.293194 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:52:21.293248 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:21.293241 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:21.293293 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:52:21.293424 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:52:21.293481 20507 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I0313 08:52:21.295068 20507 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0313 08:52:21.295227 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:21.295294 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0313 08:52:21.295407 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0313 08:52:21.295449 20507 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0313 08:52:21.295454 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:21.295572 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0313 08:52:21.295583 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0313 08:52:21.295696 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:21.295725 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0313 08:52:21.295892 20507 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0313 08:52:21.295925 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0313 08:52:21.295947 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:21.296083 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0313 08:52:21.296142 20507 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.296238 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:52:21.296299 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0313 08:52:21.296517 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0313 08:52:21.296801 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }], VpcId: "vpc-1" } I0313 08:52:21.296951 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:21.297086 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:52:21.297210 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:52:21.297285 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:52:21.297394 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:21.297451 20507 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0313 08:52:21.297521 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:52:21.297579 20507 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0313 08:52:21.297415 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0313 08:52:21.297673 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:52:21.297776 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:21.297827 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:21.300891 20507 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0313 08:52:21.301161 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.301358 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:21.301554 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:21.301752 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0313 08:52:21.301808 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0313 08:52:21.301856 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0313 08:52:21.302049 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.302267 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0313 08:52:21.302426 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:21.302527 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0313 08:52:21.302585 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.302723 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:21.302884 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:21.303035 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.303232 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.303376 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:21.303490 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:21.303595 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.303798 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.303973 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.304121 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.304256 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" }] }] } I0313 08:52:21.304389 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0313 08:52:21.304440 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.304576 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:52:21.304791 20507 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0313 08:52:21.305102 20507 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0313 08:52:21.305440 20507 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0313 08:52:21.305505 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:21.305558 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:21.305665 20507 dns.go:235] Pre-creating DNS records I0313 08:52:21.305701 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:21.311423 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.27.5 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.27.5 ********************************************************************************* I0313 08:52:21.314622 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:21.314718 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } ********************************************************************************* Kubelet anonymousAuth is currently turned on. This allows RBAC escalation and remote code execution possibilities. It is highly recommended you turn it off by setting 'spec.kubelet.anonymousAuth' to 'false' via 'kops edit cluster' See https://kops.sigs.k8s.io/security/#kubelet-api ********************************************************************************* I0313 08:52:22.657302 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:22.837408 20507 iamrole.go:89] ListRoles: { } I0313 08:52:22.838917 20507 executor.go:111] Tasks: 0 done / 101 total; 45 can run I0313 08:52:22.839877 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:52:22.840074 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.840840 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.841695 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:22.841809 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.841974 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:52:22.842016 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:52:22.842076 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:22.842248 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.844121 20507 executor.go:111] Tasks: 45 done / 101 total; 23 can run I0313 08:52:22.844262 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:22.844384 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0313 08:52:22.844370 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.844454 20507 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0313 08:52:22.844485 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.844665 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:22.844777 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.844918 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:22.844967 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0313 08:52:22.845122 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:22.845214 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0313 08:52:22.845555 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:22.850350 20507 executor.go:111] Tasks: 68 done / 101 total; 25 can run I0313 08:52:22.850538 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:22.850749 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:22.850918 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:22.851131 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:22.851294 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:22.851362 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:22.851504 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:22.852036 20507 executor.go:111] Tasks: 93 done / 101 total; 2 can run I0313 08:52:22.852351 20507 executor.go:111] Tasks: 95 done / 101 total; 6 can run I0313 08:52:22.852645 20507 executor.go:111] Tasks: 101 done / 101 total; 0 can run I0313 08:52:22.855237 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0313 08:52:22.855329 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:52:22.855371 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0313 08:52:22.855404 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:52:22.855437 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0313 08:52:22.855469 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0313 08:52:22.855500 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:52:22.855539 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0313 08:52:22.855573 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0313 08:52:22.855617 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0313 08:52:22.855651 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0313 08:52:22.855682 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0313 08:52:22.855716 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:52:22.855752 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0313 08:52:22.855783 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:52:22.855816 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:52:22.855851 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:52:22.855887 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:52:22.855918 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0313 08:52:22.855949 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0313 08:52:22.855979 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:52:22.856016 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:52:22.856051 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:52:22.856085 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0313 08:52:22.858736 20507 delete_cluster.go:128] Looking for cloud resources to delete W0313 08:52:22.858892 20507 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0313 08:52:22.858922 20507 keypairs.go:95] DescribeKeyPairs: { } I0313 08:52:22.858982 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.859065 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0313 08:52:22.859164 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.859262 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.859322 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.859406 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.859463 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.859531 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0313 08:52:22.859594 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.859670 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:52:22.859826 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0313 08:52:22.859910 20507 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0313 08:52:22.859950 20507 api.go:53] PageSize not implemented I0313 08:52:22.859975 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:22.860010 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:22.860035 20507 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0313 08:52:22.860080 20507 targetgroups.go:35] PageSize not implemented I0313 08:52:22.860114 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0313 08:52:22.860165 20507 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0313 08:52:22.860306 20507 iamrole.go:89] ListRoles: { } I0313 08:52:22.860356 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:22.860394 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:22.860463 20507 internetgateways.go:101] DescribeInternetGateways: { } I0313 08:52:22.861097 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:52:22.861193 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:22.862775 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:22.862818 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } autoscaling-group:nodes.minimal.example.com ok I0313 08:52:22.862936 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok I0313 08:52:22.863008 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0313 08:52:22.863111 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0313 08:52:22.863025 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.minimal.example.com. ok I0313 08:52:22.862891 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 } ] } W0313 08:52:22.863288 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:52:22.863330 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0313 08:52:22.863408 20507 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0313 08:52:22.863546 20507 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0313 08:52:22.863621 20507 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0313 08:52:22.863668 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-1 ok I0313 08:52:22.863750 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:22.863807 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0313 08:52:22.863929 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:52:22.863952 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0313 08:52:22.863996 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-2 ok I0313 08:52:22.864101 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0313 08:52:22.864163 20507 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0313 08:52:22.864179 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0313 08:52:22.864161 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0313 08:52:22.864220 20507 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0313 08:52:22.864290 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0313 08:52:22.864383 20507 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0313 08:52:22.864405 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0313 08:52:22.864467 20507 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0313 08:52:22.864599 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0313 08:52:22.864742 20507 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0313 08:52:22.864873 20507 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleMinimalAWS (3.13s) === RUN TestLifecycleMinimalOpenstack I0313 08:52:22.865563 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster minimal-openstack.k8s.local I0313 08:52:22.875081 20507 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:52:24.334151 20507 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0313 08:52:24.334200 20507 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0313 08:52:24.349993 20507 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2024/03/13 08:52:24 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/03/13 08:52:24 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0313 08:52:24.360686 20507 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0313 08:52:24.374331 20507 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0313 08:52:24.378288 20507 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2024/03/13 08:52:24 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/03/13 08:52:24 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/03/13 08:52:24 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0313 08:52:24.381308 20507 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0313 08:52:24.381448 20507 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0313 08:52:24.381677 20507 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0313 08:52:25.387482 20507 executor.go:111] Tasks: 92 done / 92 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:52:26.794234 20507 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0313 08:52:26.794287 20507 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0313 08:52:26.813678 20507 executor.go:111] Tasks: 0 done / 92 total; 41 can run 2024/03/13 08:52:26 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/03/13 08:52:26 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0313 08:52:26.824583 20507 executor.go:111] Tasks: 41 done / 92 total; 43 can run I0313 08:52:26.832148 20507 executor.go:111] Tasks: 84 done / 92 total; 5 can run I0313 08:52:26.834162 20507 executor.go:111] Tasks: 89 done / 92 total; 3 can run 2024/03/13 08:52:26 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/03/13 08:52:26 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/03/13 08:52:26 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0313 08:52:26.838011 20507 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0313 08:52:26.838116 20507 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0313 08:52:26.838224 20507 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0313 08:52:26.838717 20507 executor.go:111] Tasks: 92 done / 92 total; 0 can run I0313 08:52:26.840359 20507 delete_cluster.go:128] Looking for cloud resources to delete 2024/03/13 08:52:26 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) ServerGroup:b5197cee-d229-498f-9964-ca6a6cdf603a ok Port:dee237d8-6779-415f-8356-ee5760aa39b4 ok SecurityGroup:c3130799-fcbf-4897-96db-46f7aed63295 ok SecurityGroup:b6aa2c1b-d05a-49cb-aa4b-1ce6aff0675c ok Instance:90571ec7-0b49-40a6-8d11-e847aeff5eee ok Port:54ad3b77-bca8-438e-be15-4d817aa3fd1f ok Subnet:09b761f7-c480-4573-8482-788b6b4ba434 ok Instance:413757e4-5a97-4be4-8a80-1c877a134027 ok SSHKey:kubernetes-minimal-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Instance:cc961fc3-657d-4387-a1df-a4b2bfd42a4e ok SecurityGroup:80bde805-6627-4add-b212-7562543ba753 ok ServerGroup:14a2f69a-1e3d-4779-a07e-890aebfb7a1e ok Network:9ce9362d-3900-4370-bc90-2f1d3ee2b04a ok Port:07ccb42f-d174-4943-a6e2-835b001d90c4 ok --- PASS: TestLifecycleMinimalOpenstack (5.09s) === RUN TestLifecycleMinimalGCE I0313 08:52:27.956472 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:479: running lifecycle test for cluster minimal-gce.example.com I0313 08:52:27.958434 20507 network.go:238] assigned 10.0.16.0/20 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:52:29.643272 20507 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0313 08:52:29.643392 20507 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0313 08:52:29.643521 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0313 08:52:29.643552 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0313 08:52:29.643578 20507 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0313 08:52:29.643659 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0313 08:52:29.645358 20507 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0313 08:52:29.649388 20507 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0313 08:52:29.655275 20507 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0313 08:52:29.656174 20507 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0313 08:52:29.656418 20507 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0313 08:52:29.656516 20507 dns.go:235] Pre-creating DNS records ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:52:31.313426 20507 external_access.go:39] TODO: Harmonize gcemodel ExternalAccessModelBuilder with awsmodel W0313 08:52:31.313536 20507 firewall.go:41] TODO: Harmonize gcemodel with awsmodel for firewall - GCE model is way too open W0313 08:52:31.313649 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/main" W0313 08:52:31.313679 20507 storageacl.go:153] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com/backups/etcd/events" W0313 08:52:31.313705 20507 storageacl.go:189] unknown path, can't apply IAM policy: "memfs://tests/minimal-gce.example.com" W0313 08:52:31.313823 20507 autoscalinggroup.go:151] enabling storage-rw for etcd backups I0313 08:52:31.315334 20507 executor.go:111] Tasks: 0 done / 64 total; 41 can run I0313 08:52:31.319063 20507 executor.go:111] Tasks: 41 done / 64 total; 17 can run I0313 08:52:31.324566 20507 executor.go:111] Tasks: 58 done / 64 total; 4 can run I0313 08:52:31.325502 20507 executor.go:111] Tasks: 62 done / 64 total; 2 can run I0313 08:52:31.325669 20507 executor.go:111] Tasks: 64 done / 64 total; 0 can run I0313 08:52:31.327241 20507 delete_cluster.go:128] Looking for cloud resources to delete I0313 08:52:31.327308 20507 gce.go:99] Scanning zones: [us-test1-a] I0313 08:52:31.327678 20507 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" I0313 08:52:31.327702 20507 gce.go:1077] backend services not found, assuming none exist in project: "testproject" region: "us-test1" FirewallRule:ssh-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:ssh-external-to-node-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-master-us-test1-a-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/control-plane-minimal-g-fu1mg6@testproject.iam.gserviceaccount.com ok FirewallRule:node-to-master-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-ipv6-minimal-gce-example-com ok FirewallRule:nodeport-external-to-node-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-ipv6-minimal-gce-example-com ok ServiceAccount:projects/testproject/serviceAccounts/node-minimal-gce-example-com@testproject.iam.gserviceaccount.com ok Disk:a-etcd-main-minimal-gce-example-com ok FirewallRule:master-to-master-minimal-gce-example-com ok Disk:a-etcd-events-minimal-gce-example-com ok FirewallRule:node-to-node-minimal-gce-example-com ok FirewallRule:master-to-node-minimal-gce-example-com ok InstanceGroupManager:us-test1-a/a-nodes-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-ipv6-minimal-gce-example-com ok FirewallRule:kubernetes-master-https-minimal-gce-example-com ok FirewallRule:ssh-external-to-master-minimal-gce-example-com ok InstanceTemplate:nodes-minimal-gce-example-com-1710319949 ok InstanceTemplate:master-us-test1-a-minimal-do16cp-1710319949 ok Subnet:us-test1-minimal-gce-example-com ok Network:minimal-gce-example-com ok --- PASS: TestLifecycleMinimalGCE (3.37s) === RUN TestLifecycleFloatingIPOpenstack I0313 08:52:31.329228 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false lifecycle_integration_test.go:426: running lifecycle test for cluster floatingip-openstack.k8s.local I0313 08:52:31.337389 20507 subnets.go:224] Assigned CIDR 192.168.0.0/16 to subnet us-test1 ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:52:32.801817 20507 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0313 08:52:32.801867 20507 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0313 08:52:32.819125 20507 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2024/03/13 08:52:32 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/03/13 08:52:32 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0313 08:52:32.831457 20507 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0313 08:52:32.840651 20507 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0313 08:52:32.843981 20507 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2024/03/13 08:52:32 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/03/13 08:52:32 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/03/13 08:52:32 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0313 08:52:32.846588 20507 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0313 08:52:32.847006 20507 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0313 08:52:32.847007 20507 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0313 08:52:33.857292 20507 executor.go:111] Tasks: 94 done / 94 total; 0 can run ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* W0313 08:52:35.236617 20507 pruning.go:115] manifest includes an object of GroupKind CSIDriver.storage.k8s.io, which will not be pruned W0313 08:52:35.236674 20507 pruning.go:115] manifest includes an object of GroupKind StorageClass.storage.k8s.io, which will not be pruned I0313 08:52:35.257885 20507 executor.go:111] Tasks: 0 done / 94 total; 42 can run 2024/03/13 08:52:35 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/03/13 08:52:35 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) I0313 08:52:35.268111 20507 executor.go:111] Tasks: 42 done / 94 total; 43 can run I0313 08:52:35.275121 20507 executor.go:111] Tasks: 85 done / 94 total; 6 can run I0313 08:52:35.276895 20507 executor.go:111] Tasks: 91 done / 94 total; 3 can run 2024/03/13 08:52:35 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/03/13 08:52:35 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) 2024/03/13 08:52:35 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) W0313 08:52:35.279976 20507 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. W0313 08:52:35.280458 20507 bootstrapscript.go:159] exporting username and password. Consider using application credentials instead. I0313 08:52:35.280878 20507 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0313 08:52:35.282508 20507 delete_cluster.go:128] Looking for cloud resources to delete 2024/03/13 08:52:35 http: superfluous response.WriteHeader call from k8s.io/kops/cloudmock/openstack/mockcompute.(*MockClient).getServer (servers.go:167) Router:87674f90-8975-4834-ab91-5d2e9415e9e7 ok Network:9e1135e5-d861-40e6-9f5f-4608454dfc98 ok ServerGroup:bf292a11-8d85-4191-ac5d-e841c065a8b9 ok SecurityGroup:d5cafc2f-ffa4-4e81-bca5-560b85b567d0 ok Port:4e46ecc3-924d-4210-9b38-60974b86eb38 ok SSHKey:kubernetes-floatingip-openstack-k8s-local-c4_a6_ed_9a_a8_89_b9_e2_c3_9c_d6_63_eb_9c_71_57 ok Instance:84ef6fd5-6f7f-4a3b-9eb3-0c9386ad13f0 ok SecurityGroup:39f7cd93-a4da-4196-9eb8-1c83433aab87 ok Instance:8989da35-2cbd-47a0-8d7e-70b6c057ccce ok Port:0651f2a1-7914-4aea-9f2a-638504a97180 ok Port:4eb372b0-b197-4e2a-a151-2911a126f0ca ok Instance:617a57c9-62d2-4b5d-8376-5f0061cd040d ok SecurityGroup:cd1b39d4-05e6-475b-8128-766ac0262f02 ok Subnet:6e8acc76-223e-4fd4-8c50-28ef3b4d6e0e ok ServerGroup:eca47c62-64aa-441b-8220-2e202d88cb6a ok Port:f8b0b808-3028-4809-96c5-bae61adb1b3a ok Router-IF:6e8acc76-223e-4fd4-8c50-28ef3b4d6e0e ok --- PASS: TestLifecycleFloatingIPOpenstack (5.07s) === RUN TestLifecyclePrivateCalico I0313 08:52:36.398261 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:36.398410 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:36.398461 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:36.398509 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:36.398550 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:36.398639 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:36.398689 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:36.398720 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:36.398762 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:36.398792 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatecalico.example.com I0313 08:52:36.432779 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:52:36.436489 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:36.436585 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:36.436646 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:37.717534 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:38.158221 20507 iamrole.go:89] ListRoles: { } I0313 08:52:38.159627 20507 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0313 08:52:38.159969 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:38.160093 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatecalico.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:52:38.161373 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } I0313 08:52:38.161450 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:52:38.161589 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", Tags: [{ Key: "Name", Value: "bastions.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0313 08:52:38.161703 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I0313 08:52:38.162087 20507 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.162239 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } I0313 08:52:38.162282 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0313 08:52:38.162378 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0313 08:52:38.162413 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0313 08:52:38.162991 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } I0313 08:52:38.163035 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:52:38.163073 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", Tags: [{ Key: "Name", Value: "masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] } I0313 08:52:38.163122 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:38.163214 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:38.163370 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:38.163456 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:38.163659 20507 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.163981 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:52:38.164046 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:52:38.164318 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:52:38.164930 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:52:38.165024 20507 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.167134 20507 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0313 08:52:38.167297 20507 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0313 08:52:38.167304 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:38.167423 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0313 08:52:38.167422 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:38.167516 20507 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0313 08:52:38.167519 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatecalico.example.com" } ] }], VpcId: "vpc-1" } I0313 08:52:38.167630 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0313 08:52:38.167582 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0313 08:52:38.167581 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0313 08:52:38.167778 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0313 08:52:38.167837 20507 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatecalico-exa-hocohm", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-privatecalico-exa-hocohm" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0313 08:52:38.167972 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0313 08:52:38.167854 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:38.168082 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0313 08:52:38.167993 20507 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0313 08:52:38.168131 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0313 08:52:38.168169 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.privatecalico.example.com" } ] }], VpcId: "vpc-1" } I0313 08:52:38.168202 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0313 08:52:38.168429 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "masters.privatecalico.example.com" }] }], VpcId: "vpc-1" } I0313 08:52:38.168530 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:38.168638 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:38.168744 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0313 08:52:38.168867 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:38.168969 20507 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.169061 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:38.169137 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0313 08:52:38.169242 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:52:38.169336 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:52:38.169408 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:38.169480 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0313 08:52:38.169625 20507 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0313 08:52:38.169619 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0313 08:52:38.169704 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:52:38.169806 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0313 08:52:38.169865 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:38.169918 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0313 08:52:38.170091 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:52:38.170072 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0313 08:52:38.170176 20507 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0313 08:52:38.169911 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatecalico.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatecalico.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ecr:BatchCheckLayerAvailability\",\n \"ecr:BatchGetImage\",\n \"ecr:DescribeRepositories\",\n \"ecr:GetAuthorizationToken\",\n \"ecr:GetDownloadUrlForLayer\",\n \"ecr:GetRepositoryPolicy\",\n \"ecr:ListImages\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatecalico.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0313 08:52:38.170264 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:52:38.170351 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:38.170400 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatecalico.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:52:38.170501 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:52:38.170556 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:52:38.170601 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0313 08:52:38.170662 20507 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "Name", Value: "private-us-test-1a.privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] } I0313 08:52:38.170756 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0313 08:52:38.170829 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:38.170910 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0313 08:52:38.170974 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0313 08:52:38.171018 20507 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "privatecalico.example.com" }, { Key: "KubernetesCluster", Value: "privatecalico.example.com" }, { Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" } ] } I0313 08:52:38.171110 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:38.171210 20507 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0313 08:52:38.171386 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0313 08:52:38.171452 20507 api.go:53] PageSize not implemented I0313 08:52:38.171568 20507 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.171507 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0313 08:52:38.171604 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:38.171614 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0313 08:52:38.171742 20507 tags.go:74] AddTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"], Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "api.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] } W0313 08:52:38.171825 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:38.171835 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:38.171728 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0313 08:52:38.171870 20507 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0313 08:52:38.171956 20507 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatecalico-example-0uch4k" } I0313 08:52:38.172001 20507 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatecalico-exa-hocohm", SubnetMappings: [{ SubnetId: "subnet-2" }], Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "bastion.privatecalico.example.com" }], Type: "network" } I0313 08:52:38.172025 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0313 08:52:38.172177 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0313 08:52:38.172317 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0313 08:52:38.172624 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-1to2379-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.172799 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.172937 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0313 08:52:38.173036 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.173254 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-egress-all-0to0-::/0" }] }] } I0313 08:52:38.173396 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0313 08:52:38.173530 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:38.173612 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-4-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.173755 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.173901 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:38.174028 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:38.174102 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:38.174189 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:38.174304 20507 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1", Port: 22, Protocol: "TCP" } I0313 08:52:38.174260 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-4003to65535-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } W0313 08:52:38.174435 20507 api.go:53] PageSize not implemented I0313 08:52:38.174461 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:38.174463 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0313 08:52:38.174612 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0313 08:52:38.174671 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatecalico.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.174802 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-tcp-2382to4000-masters.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0313 08:52:38.174942 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0313 08:52:38.174996 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0313 08:52:38.175096 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatecalico.example.com-ingress-udp-1to65535-masters.privatecalico.example.com" }] }] } I0313 08:52:38.175270 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.175393 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0313 08:52:38.175493 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.175627 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-api-elb.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0313 08:52:38.175754 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-nodes.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" }] }] } I0313 08:52:38.175900 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatecalico.example.com-ingress-all-0to0-nodes.privatecalico.example.com" }] }] } I0313 08:52:38.176035 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0313 08:52:38.176130 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0313 08:52:38.176184 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-1" } I0313 08:52:38.176224 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0313 08:52:38.176266 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0313 08:52:38.176304 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0313 08:52:38.176419 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:38.176525 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:38.176611 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatecalico.example.com-ingress-tcp-22to22-masters.privatecalico.example.com" }] }] } I0313 08:52:38.176751 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-bastion.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.176931 20507 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0313 08:52:38.177001 20507 api.go:53] PageSize not implemented I0313 08:52:38.177020 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:38.177065 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:38.177125 20507 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-2"] }] } W0313 08:52:38.177235 20507 api.go:53] PageSize not implemented I0313 08:52:38.177145 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:38.177302 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:38.177326 20507 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-2", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.privatecalico.example.com" },{ Key: "KubernetesCluster", Value: "privatecalico.example.com" },{ Key: "kubernetes.io/cluster/privatecalico.example.com", Value: "owned" }] }] } I0313 08:52:38.177448 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:38.177512 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0313 08:52:38.177592 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0313 08:52:38.177660 20507 tags.go:42] CreateTags { Resources: ["subnet-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0313 08:52:38.177597 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:38.177754 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:38.183171 20507 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0313 08:52:38.183307 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:38.183463 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0313 08:52:38.183540 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:38.183678 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:38.183824 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:38.183969 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:38.184723 20507 executor.go:111] Tasks: 134 done / 142 total; 2 can run I0313 08:52:38.185018 20507 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0313 08:52:38.185333 20507 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0313 08:52:38.185389 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:38.185427 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:38.185497 20507 dns.go:235] Pre-creating DNS records I0313 08:52:38.185524 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:38.192208 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:52:38.195862 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:38.195962 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:38.196060 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:39.455178 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:39.911113 20507 iamrole.go:89] ListRoles: { } I0313 08:52:39.913383 20507 executor.go:111] Tasks: 0 done / 142 total; 49 can run I0313 08:52:39.913770 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.913982 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.914294 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.914391 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:39.915035 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatecalico.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:52:39.915938 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.916077 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:52:39.916112 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:52:39.916163 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:39.917713 20507 executor.go:111] Tasks: 49 done / 142 total; 30 can run I0313 08:52:39.917883 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatecalico-exa-hocohm"] } I0313 08:52:39.917973 20507 iamrole.go:161] ListAttachedRolePolicies: masters.privatecalico.example.com I0313 08:52:39.917982 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0313 08:52:39.918024 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.privatecalico.example.com I0313 08:52:39.918023 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } I0313 08:52:39.917944 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatecalico.example.com"] } ] } I0313 08:52:39.918202 20507 iamrole.go:161] ListAttachedRolePolicies: bastions.privatecalico.example.com I0313 08:52:39.918160 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.918356 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:39.918439 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatecalico.example.com"] } ] } I0313 08:52:39.918633 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:39.918720 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.privatecalico.example.com"] }] } I0313 08:52:39.918871 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:39.918921 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:39.919026 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.919156 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatecalico.example.com"] } ] } I0313 08:52:39.919346 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:39.919397 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.919495 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:39.919570 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatecalico.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.919672 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatecalico.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatecalico.example.com"] } ] } I0313 08:52:39.919809 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:39.919851 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0313 08:52:39.919967 20507 executor.go:111] Tasks: 79 done / 142 total; 41 can run I0313 08:52:39.920062 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:39.920256 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:39.920342 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:39.920365 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0313 08:52:39.920423 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } W0313 08:52:39.920469 20507 api.go:53] PageSize not implemented I0313 08:52:39.920463 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0313 08:52:39.920536 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:39.920622 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4"] } I0313 08:52:39.920687 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } I0313 08:52:39.920714 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:39.920633 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:39.920784 20507 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatecalico-example-0uch4k" } I0313 08:52:39.920825 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } W0313 08:52:39.920962 20507 api.go:53] PageSize not implemented I0313 08:52:39.920989 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:39.921062 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:39.921237 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:39.921365 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:39.921514 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:39.921612 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0313 08:52:39.921663 20507 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0313 08:52:39.921706 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0313 08:52:39.921821 20507 executor.go:111] Tasks: 120 done / 142 total; 6 can run W0313 08:52:39.921924 20507 api.go:53] PageSize not implemented I0313 08:52:39.921989 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:39.922024 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:39.922075 20507 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" W0313 08:52:39.922106 20507 api.go:53] PageSize not implemented I0313 08:52:39.922111 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:39.922177 20507 dnsname.go:118] AliasTarget for "api.privatecalico.example.com" is "api-privatecalico-example-0uch4k.elb.cloudmock.com" I0313 08:52:39.922139 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:39.922218 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:39.922279 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0313 08:52:39.922462 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:39.922625 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:39.928036 20507 executor.go:111] Tasks: 126 done / 142 total; 8 can run I0313 08:52:39.928234 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:39.928404 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:39.928621 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:39.928765 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:39.928998 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:39.929427 20507 executor.go:111] Tasks: 134 done / 142 total; 2 can run W0313 08:52:39.929561 20507 api.go:53] PageSize not implemented I0313 08:52:39.929594 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:39.929843 20507 executor.go:111] Tasks: 136 done / 142 total; 6 can run I0313 08:52:39.930140 20507 executor.go:111] Tasks: 142 done / 142 total; 0 can run I0313 08:52:39.933629 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0313 08:52:39.933700 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:52:39.933746 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0313 08:52:39.933783 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0313 08:52:39.933817 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:52:39.933851 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0313 08:52:39.933883 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0313 08:52:39.933916 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:52:39.933952 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0313 08:52:39.933988 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0313 08:52:39.934028 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0313 08:52:39.934071 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0313 08:52:39.934110 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0313 08:52:39.934149 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0313 08:52:39.934181 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0313 08:52:39.934214 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:52:39.934250 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0313 08:52:39.934282 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0313 08:52:39.934319 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:52:39.934358 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:52:39.934394 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0313 08:52:39.934429 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0313 08:52:39.934464 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:52:39.934503 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:52:39.934539 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0313 08:52:39.934578 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0313 08:52:39.934610 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0313 08:52:39.934642 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:52:39.934678 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:52:39.934717 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:52:39.934752 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0313 08:52:39.936331 20507 delete_cluster.go:128] Looking for cloud resources to delete W0313 08:52:39.936405 20507 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0313 08:52:39.936429 20507 keypairs.go:95] DescribeKeyPairs: { } I0313 08:52:39.936477 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.936536 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0313 08:52:39.936606 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.936671 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.936720 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.936773 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.936821 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.936868 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } I0313 08:52:39.936930 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.936986 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:52:39.937017 20507 natgateway.go:117] DescribeNatGateways: { } I0313 08:52:39.937053 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatecalico.example.com"] }] } I0313 08:52:39.937094 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatecalico.example.com"] }] } W0313 08:52:39.937150 20507 api.go:53] PageSize not implemented I0313 08:52:39.937169 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatecalico-example-0uch4k"] } I0313 08:52:39.937213 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:39.937241 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:39.937258 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1"] } I0313 08:52:39.937299 20507 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0313 08:52:39.937325 20507 targetgroups.go:35] PageSize not implemented I0313 08:52:39.937342 20507 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" ] } I0313 08:52:39.937406 20507 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0313 08:52:39.937448 20507 iamrole.go:89] ListRoles: { } I0313 08:52:39.937497 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:39.937527 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:39.937576 20507 internetgateways.go:101] DescribeInternetGateways: { } I0313 08:52:39.937630 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:52:39.937674 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0313 08:52:39.937716 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0313 08:52:39.937752 20507 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0313 08:52:39.938371 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:nodes.privatecalico.example.com ok I0313 08:52:39.938510 20507 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatecalico-exa-hocohm/4 ok I0313 08:52:39.938539 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } I0313 08:52:39.938439 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 } ] } I0313 08:52:39.938618 20507 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatecalico-example-0uch4k" } W0313 08:52:39.938697 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions load-balancer:api-privatecalico-example-0uch4k ok I0313 08:52:39.938648 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatecalico.example.com" } autoscaling-group:master-us-test-1a.masters.privatecalico.example.com ok I0313 08:52:39.938728 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } autoscaling-group:bastion.privatecalico.example.com ok security-group:sg-2 ok I0313 08:52:39.938666 20507 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1" } iam-instance-profile:nodes.privatecalico.example.com ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatecalico-exa-hocohm/1 ok I0313 08:52:39.938751 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0313 08:52:39.938791 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0313 08:52:39.938626 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatecalico-example-0uch4k.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatecalico.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatecalico.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.privatecalico.example.com ok I0313 08:52:39.938818 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatecalico.example.com" } iam-instance-profile:bastions.privatecalico.example.com ok I0313 08:52:39.938884 20507 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0313 08:52:39.938938 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0313 08:52:39.939002 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatecalico.example.com" } iam-instance-profile:masters.privatecalico.example.com ok I0313 08:52:39.938983 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0313 08:52:39.939051 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:39.939116 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "4", UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0313 08:52:39.939342 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:52:39.939368 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0313 08:52:39.939405 20507 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok autoscaling-config:lt-3 ok I0313 08:52:39.939499 20507 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0313 08:52:39.939562 20507 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0313 08:52:39.939599 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0313 08:52:39.939652 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0313 08:52:39.939760 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-config:lt-1 ok I0313 08:52:39.939804 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0313 08:52:39.939948 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0313 08:52:39.939967 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatecalico.example.com" } I0313 08:52:39.940057 20507 iamrole.go:180] ListAttachedRolePolicies: masters.privatecalico.example.com I0313 08:52:39.940046 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0313 08:52:39.940083 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatecalico.example.com", RoleName: "masters.privatecalico.example.com" } I0313 08:52:39.940119 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:39.940136 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatecalico.example.com" } I0313 08:52:39.940214 20507 iamrole.go:180] ListAttachedRolePolicies: bastions.privatecalico.example.com I0313 08:52:39.940243 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatecalico.example.com", RoleName: "bastions.privatecalico.example.com" } I0313 08:52:39.940295 20507 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatecalico.example.com" } iam-role:bastions.privatecalico.example.com ok I0313 08:52:39.940207 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 } ] } W0313 08:52:39.940438 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:52:39.940464 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0313 08:52:39.940352 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatecalico.example.com" } I0313 08:52:39.940541 20507 iamrole.go:180] ListAttachedRolePolicies: nodes.privatecalico.example.com I0313 08:52:39.940530 20507 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } I0313 08:52:39.940569 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatecalico.example.com", RoleName: "nodes.privatecalico.example.com" } elastic-ip:eipalloc-1 ok I0313 08:52:39.940619 20507 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatecalico.example.com" } iam-role:nodes.privatecalico.example.com ok I0313 08:52:39.940671 20507 iamrole.go:137] DeleteRole: { RoleName: "masters.privatecalico.example.com" } iam-role:masters.privatecalico.example.com ok I0313 08:52:39.940806 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0313 08:52:39.940883 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0313 08:52:39.940969 20507 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0313 08:52:39.941056 20507 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateCalico (3.54s) === RUN TestLifecyclePrivateKopeio I0313 08:52:39.941546 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:39.941691 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:39.941732 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:39.941777 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:39.941817 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:39.941868 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:39.941934 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:39.941972 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:39.942013 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:39.942044 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster privatekopeio.example.com I0313 08:52:39.970550 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:52:39.973972 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:39.974053 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:39.974110 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:41.244722 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:41.436966 20507 iamrole.go:89] ListRoles: { } I0313 08:52:41.438966 20507 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0313 08:52:41.439241 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:41.439496 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0313 08:52:41.439505 20507 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.439596 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] } I0313 08:52:41.439674 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:52:41.439760 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:52:41.440003 20507 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.440083 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:41.440524 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } I0313 08:52:41.440645 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0313 08:52:41.440878 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:41.441175 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } I0313 08:52:41.441142 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:52:41.441349 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:52:41.441322 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] } I0313 08:52:41.441409 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:41.441576 20507 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.441612 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:41.441869 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0313 08:52:41.441944 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0313 08:52:41.441987 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:52:41.442038 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:52:41.442298 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:52:41.442382 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:41.442848 20507 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0313 08:52:41.443090 20507 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0313 08:52:41.443079 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0313 08:52:41.443090 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:41.443206 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0313 08:52:41.443262 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0313 08:52:41.443247 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0313 08:52:41.443322 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0313 08:52:41.443270 20507 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-privatekopeio-exa-d8ef8e", Port: 22, Protocol: "TCP", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-privatekopeio-exa-d8ef8e" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0313 08:52:41.443362 20507 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0313 08:52:41.443388 20507 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0313 08:52:41.443345 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0313 08:52:41.443449 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0313 08:52:41.443651 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0313 08:52:41.443595 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:41.443752 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0313 08:52:41.443869 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] }] } I0313 08:52:41.443894 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0313 08:52:41.443936 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0313 08:52:41.443991 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0313 08:52:41.444038 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } I0313 08:52:41.444046 20507 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] } I0313 08:52:41.444077 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "utility-us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" } ] }], VpcId: "vpc-1" } I0313 08:52:41.444130 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:41.444279 20507 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0313 08:52:41.444329 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:41.444426 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:41.444511 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:41.444612 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0313 08:52:41.444606 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0313 08:52:41.444606 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0313 08:52:41.444755 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:41.444847 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:41.444955 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0313 08:52:41.445032 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.8.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0313 08:52:41.445062 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0313 08:52:41.445161 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:41.445266 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:52:41.445317 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.privatekopeio.example.com" }] }], VpcId: "vpc-1" } I0313 08:52:41.445420 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0313 08:52:41.445486 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:52:41.445577 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:41.445551 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" } ] }], VpcId: "vpc-1" } I0313 08:52:41.445644 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:52:41.445413 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/privatekopeio.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/privatekopeio.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"privatekopeio.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0313 08:52:41.445728 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:52:41.445792 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:41.445848 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:52:41.445895 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:41.445947 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0313 08:52:41.445991 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0313 08:52:41.446043 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:52:41.446163 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0313 08:52:41.446240 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.privatekopeio.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:52:41.446366 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0313 08:52:41.446429 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0313 08:52:41.446473 20507 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "privatekopeio.example.com" }, { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0313 08:52:41.446559 20507 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.446641 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:52:41.446699 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0313 08:52:41.446754 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:41.446792 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0313 08:52:41.446839 20507 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0313 08:52:41.446874 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:41.446924 20507 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "KubernetesCluster", Value: "privatekopeio.example.com" }, { Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.privatekopeio.example.com" } ] } I0313 08:52:41.447011 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0313 08:52:41.447060 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:52:41.447151 20507 executor.go:111] Tasks: 81 done / 144 total; 41 can run I0313 08:52:41.447303 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:41.447392 20507 loadbalancers.go:35] PageSize not implemented W0313 08:52:41.447419 20507 api.go:53] PageSize not implemented I0313 08:52:41.447518 20507 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-privatekopeio-exa-d8ef8e", SubnetMappings: [{ SubnetId: "subnet-1" },{ SubnetId: "subnet-4" }], Tags: [{ Key: "Name", Value: "bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }], Type: "network" } I0313 08:52:41.447317 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:41.447568 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:41.447661 20507 tags.go:74] AddTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"], Tags: [{ Key: "Name", Value: "api.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] } I0313 08:52:41.447726 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:41.447714 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0313 08:52:41.447762 20507 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0313 08:52:41.447825 20507 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0313 08:52:41.447864 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0313 08:52:41.448044 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.448183 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-udp-1to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.448324 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-::/0" }] }] } I0313 08:52:41.448532 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.448692 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.448844 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:41.448922 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:41.448986 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0313 08:52:41.449066 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:41.449159 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0313 08:52:41.449237 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0313 08:52:41.449319 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:41.449388 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:41.449429 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0313 08:52:41.449546 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0313 08:52:41.449676 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-4003to65535-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.449827 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.privatekopeio.example.com-ingress-all-0to0-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.449958 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0313 08:52:41.450053 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0313 08:52:41.450183 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0313 08:52:41.450226 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0313 08:52:41.450271 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.450400 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0313 08:52:41.450501 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0313 08:52:41.450547 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-4" } I0313 08:52:41.450584 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-1to2379-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.450718 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" }] }] } I0313 08:52:41.450853 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:41.450963 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:41.451055 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0313 08:52:41.451110 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0313 08:52:41.451150 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-all-0to0-nodes.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.451284 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0313 08:52:41.451379 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.privatekopeio.example.com-ingress-tcp-2382to4000-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.451513 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }] } I0313 08:52:41.451604 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.privatekopeio.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.451732 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0313 08:52:41.451781 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0313 08:52:41.451821 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.451971 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.452109 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0313 08:52:41.452149 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.privatekopeio.example.com-ingress-tcp-22to22-masters.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.452234 20507 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1", Port: 22, Protocol: "TCP" } W0313 08:52:41.452372 20507 api.go:53] PageSize not implemented I0313 08:52:41.452294 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.452397 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:41.452425 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0313 08:52:41.452469 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.8.0/22-ingress-tcp-22to22-bastion.privatekopeio.example.com" },{ Key: "KubernetesCluster", Value: "privatekopeio.example.com" },{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "owned" }] }] } I0313 08:52:41.452610 20507 tags.go:42] CreateTags { Resources: ["nat-b2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0313 08:52:41.452653 20507 tags.go:42] CreateTags { Resources: ["nat-a2345678"], Tags: [{ Key: "kubernetes.io/cluster/privatekopeio.example.com", Value: "shared" }] } I0313 08:52:41.452695 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:52:41.452743 20507 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0313 08:52:41.452783 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0313 08:52:41.452831 20507 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-a2345678" }] } I0313 08:52:41.452874 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0313 08:52:41.452918 20507 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0313 08:52:41.452955 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0313 08:52:41.453004 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0313 08:52:41.453100 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I0313 08:52:41.453153 20507 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-b2345678" }] } I0313 08:52:41.453248 20507 executor.go:111] Tasks: 122 done / 144 total; 7 can run W0313 08:52:41.453343 20507 api.go:53] PageSize not implemented I0313 08:52:41.453348 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:41.453388 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:41.453443 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:41.453505 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-a2345678", RouteTableId: "rtb-2" } I0313 08:52:41.453562 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } W0313 08:52:41.453676 20507 api.go:53] PageSize not implemented I0313 08:52:41.453582 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:41.453685 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-b2345678", RouteTableId: "rtb-3" } I0313 08:52:41.453731 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:41.453735 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:41.453824 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:41.462420 20507 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0313 08:52:41.463525 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:41.463670 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:41.464332 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:41.464519 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:41.465331 20507 executor.go:111] Tasks: 136 done / 144 total; 2 can run I0313 08:52:41.465625 20507 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0313 08:52:41.466003 20507 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0313 08:52:41.466065 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:41.466103 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:41.466178 20507 dns.go:235] Pre-creating DNS records I0313 08:52:41.466206 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:41.473697 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:52:41.477491 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:41.477584 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:41.477646 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:42.759797 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:42.948713 20507 iamrole.go:89] ListRoles: { } I0313 08:52:42.950447 20507 executor.go:111] Tasks: 0 done / 144 total; 48 can run I0313 08:52:42.950757 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.950875 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:52:42.950903 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:52:42.950943 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:42.950982 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.951131 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.951228 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.privatekopeio.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:52:42.951266 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:42.951629 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.953543 20507 executor.go:111] Tasks: 48 done / 144 total; 33 can run I0313 08:52:42.953674 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.953826 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["bastion.privatekopeio.example.com"] } ] } I0313 08:52:42.953948 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.privatekopeio.example.com I0313 08:52:42.953964 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-privatekopeio-exa-d8ef8e"] } I0313 08:52:42.954060 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0313 08:52:42.954089 20507 iamrole.go:161] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0313 08:52:42.954105 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } I0313 08:52:42.954150 20507 iamrole.go:161] ListAttachedRolePolicies: masters.privatekopeio.example.com I0313 08:52:42.954033 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1b.privatekopeio.example.com"] }] } I0313 08:52:42.954274 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.954417 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.954544 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:42.954642 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.954811 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0313 08:52:42.954856 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.954986 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:42.955041 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.955270 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:52:42.955324 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "tag:Name", Values: ["api-elb.privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.privatekopeio.example.com"] } ] } I0313 08:52:42.955493 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:42.955550 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0313 08:52:42.955596 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.privatekopeio.example.com"] } ] } I0313 08:52:42.955764 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:42.955812 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.privatekopeio.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.privatekopeio.example.com"] } ] } I0313 08:52:42.955928 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.privatekopeio.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.956044 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:42.956168 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:42.956232 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:42.956326 20507 executor.go:111] Tasks: 81 done / 144 total; 41 can run W0313 08:52:42.956637 20507 api.go:53] PageSize not implemented I0313 08:52:42.956571 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:42.956665 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:42.956742 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:42.956704 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0313 08:52:42.956752 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:42.956855 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:42.956777 20507 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } I0313 08:52:42.956841 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0313 08:52:42.956881 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0313 08:52:42.956939 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0313 08:52:42.956977 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } I0313 08:52:42.956986 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:42.957018 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4"] } I0313 08:52:42.957158 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } W0313 08:52:42.957259 20507 api.go:53] PageSize not implemented I0313 08:52:42.957283 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:42.957325 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:42.957514 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:42.957710 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:42.957859 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:42.958001 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:42.958089 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0313 08:52:42.958209 20507 executor.go:111] Tasks: 122 done / 144 total; 7 can run I0313 08:52:42.958286 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0313 08:52:42.958388 20507 api.go:53] PageSize not implemented I0313 08:52:42.958387 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:42.958452 20507 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0313 08:52:42.958479 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:42.958519 20507 dnsname.go:118] AliasTarget for "api.privatekopeio.example.com" is "api-privatekopeio-example-tl2bv8.elb.cloudmock.com" I0313 08:52:42.958469 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } W0313 08:52:42.958416 20507 api.go:53] PageSize not implemented I0313 08:52:42.958666 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:42.958750 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:42.958949 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:42.959105 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:42.967693 20507 executor.go:111] Tasks: 129 done / 144 total; 7 can run I0313 08:52:42.967888 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:42.968059 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:42.968172 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:42.968331 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:42.968807 20507 executor.go:111] Tasks: 136 done / 144 total; 2 can run W0313 08:52:42.968906 20507 api.go:53] PageSize not implemented I0313 08:52:42.968926 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:42.969111 20507 executor.go:111] Tasks: 138 done / 144 total; 6 can run I0313 08:52:42.969332 20507 executor.go:111] Tasks: 144 done / 144 total; 0 can run I0313 08:52:42.972714 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0313 08:52:42.972785 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:52:42.972830 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0313 08:52:42.972868 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:52:42.972905 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0313 08:52:42.972941 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0313 08:52:42.972977 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:52:42.973014 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0313 08:52:42.973050 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0313 08:52:42.973091 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0313 08:52:42.973132 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0313 08:52:42.973170 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0313 08:52:42.973202 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0313 08:52:42.973233 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:52:42.973268 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0313 08:52:42.973301 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0313 08:52:42.973337 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0313 08:52:42.973373 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:52:42.973408 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:52:42.973443 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0313 08:52:42.973478 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0313 08:52:42.973513 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:52:42.973551 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:52:42.973583 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0313 08:52:42.973619 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0313 08:52:42.973654 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0313 08:52:42.973691 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0313 08:52:42.973722 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0313 08:52:42.973753 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:52:42.973792 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:52:42.973828 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:52:42.973864 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0313 08:52:42.975811 20507 delete_cluster.go:128] Looking for cloud resources to delete W0313 08:52:42.975932 20507 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0313 08:52:42.975969 20507 keypairs.go:95] DescribeKeyPairs: { } I0313 08:52:42.976050 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.976143 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0313 08:52:42.976215 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.976282 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.976334 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.976387 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.976432 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.976481 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } I0313 08:52:42.976551 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.976617 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:52:42.976654 20507 natgateway.go:117] DescribeNatGateways: { } I0313 08:52:42.976695 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["privatekopeio.example.com"] }] } I0313 08:52:42.976736 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/privatekopeio.example.com"] }] } W0313 08:52:42.976790 20507 api.go:53] PageSize not implemented I0313 08:52:42.976808 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-privatekopeio-example-tl2bv8"] } I0313 08:52:42.976849 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:42.976876 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:42.976891 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1"] } I0313 08:52:42.976932 20507 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0313 08:52:42.976958 20507 targetgroups.go:35] PageSize not implemented I0313 08:52:42.976975 20507 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" ] } I0313 08:52:42.977036 20507 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0313 08:52:42.977083 20507 iamrole.go:89] ListRoles: { } I0313 08:52:42.977132 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:42.977162 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:42.977210 20507 internetgateways.go:101] DescribeInternetGateways: { } I0313 08:52:42.977259 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:52:42.977311 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-3","rtb-1"] } I0313 08:52:42.977356 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-a2345678"] } I0313 08:52:42.977416 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-b2345678"] } I0313 08:52:42.978261 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-group:nodes.privatekopeio.example.com ok I0313 08:52:42.978330 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0313 08:52:42.978368 20507 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-privatekopeio-example-tl2bv8" } autoscaling-config:lt-1 ok I0313 08:52:42.978386 20507 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1" } autoscaling-group:master-us-test-1a.masters.privatekopeio.example.com ok load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-privatekopeio-exa-d8ef8e/1 ok load-balancer:api-privatekopeio-example-tl2bv8 ok I0313 08:52:42.978438 20507 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } autoscaling-config:lt-2 ok I0313 08:52:42.978496 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0313 08:52:42.978547 20507 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4" } autoscaling-group:bastion.privatekopeio.example.com ok I0313 08:52:42.978596 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.privatekopeio.example.com" } I0313 08:52:42.978615 20507 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0313 08:52:42.978656 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0313 08:52:42.978717 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.privatekopeio.example.com" } iam-instance-profile:masters.privatekopeio.example.com ok I0313 08:52:42.978706 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-privatekopeio-exa-d8ef8e/4 ok I0313 08:52:42.978755 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } iam-instance-profile:nodes.privatekopeio.example.com ok I0313 08:52:42.978807 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.privatekopeio.example.com" } iam-instance-profile:bastions.privatekopeio.example.com ok I0313 08:52:42.978704 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.privatekopeio.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-privatekopeio-example-tl2bv8.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.privatekopeio.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.privatekopeio.example.com ok I0313 08:52:42.978778 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0313 08:52:42.978996 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:52:42.979025 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0313 08:52:42.979065 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:42.979122 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0313 08:52:42.979236 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:52:42.979251 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0313 08:52:42.979289 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0313 08:52:42.979343 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.8.0/22" }], ToPort: 22 } ] } W0313 08:52:42.979508 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:52:42.979527 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0313 08:52:42.979562 20507 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok autoscaling-config:lt-3 ok I0313 08:52:42.979685 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:42.979705 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.privatekopeio.example.com" } I0313 08:52:42.979783 20507 iamrole.go:180] ListAttachedRolePolicies: bastions.privatekopeio.example.com I0313 08:52:42.979738 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I0313 08:52:42.979801 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.privatekopeio.example.com", RoleName: "bastions.privatekopeio.example.com" } W0313 08:52:42.979835 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:52:42.979840 20507 iamrole.go:137] DeleteRole: { RoleName: "bastions.privatekopeio.example.com" } iam-role:bastions.privatekopeio.example.com ok I0313 08:52:42.979880 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.privatekopeio.example.com" } I0313 08:52:42.979867 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } I0313 08:52:42.979926 20507 iamrole.go:180] ListAttachedRolePolicies: nodes.privatekopeio.example.com subnet:subnet-3 ok I0313 08:52:42.979943 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.privatekopeio.example.com", RoleName: "nodes.privatekopeio.example.com" } I0313 08:52:42.979953 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0313 08:52:42.979975 20507 iamrole.go:137] DeleteRole: { RoleName: "nodes.privatekopeio.example.com" } iam-role:nodes.privatekopeio.example.com ok I0313 08:52:42.980003 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.privatekopeio.example.com" } I0313 08:52:42.980052 20507 iamrole.go:180] ListAttachedRolePolicies: masters.privatekopeio.example.com I0313 08:52:42.980021 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0313 08:52:42.980067 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.privatekopeio.example.com", RoleName: "masters.privatekopeio.example.com" } I0313 08:52:42.980138 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } I0313 08:52:42.980146 20507 iamrole.go:137] DeleteRole: { RoleName: "masters.privatekopeio.example.com" } subnet:subnet-1 ok iam-role:masters.privatekopeio.example.com ok I0313 08:52:42.980213 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0313 08:52:42.980332 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0313 08:52:42.980400 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0313 08:52:42.980457 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0313 08:52:42.980537 20507 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0313 08:52:42.980619 20507 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecyclePrivateKopeio (3.04s) === RUN TestLifecycleIPv6 I0313 08:52:42.981108 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:42.981248 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:42.981288 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:42.981331 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:42.981369 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:42.981423 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:42.981465 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:42.981496 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:42.981539 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:42.981566 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal-ipv6.example.com I0313 08:52:43.010599 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:52:43.014378 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:43.014463 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:44.274960 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:44.451701 20507 iamrole.go:89] ListRoles: { } I0313 08:52:44.453181 20507 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0313 08:52:44.453685 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.453910 20507 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.454038 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:52:44.454098 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:52:44.454131 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } I0313 08:52:44.454225 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0313 08:52:44.454264 20507 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.454371 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } I0313 08:52:44.454446 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] } I0313 08:52:44.454437 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.454475 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:44.454606 20507 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.454697 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0313 08:52:44.454735 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0313 08:52:44.455794 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:52:44.455902 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:44.455953 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.456197 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:52:44.456375 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:52:44.456634 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.456912 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:52:44.457108 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:52:44.461067 20507 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0313 08:52:44.461264 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0313 08:52:44.461371 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0313 08:52:44.461228 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0313 08:52:44.461555 20507 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0313 08:52:44.461499 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0313 08:52:44.461621 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0313 08:52:44.461621 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0313 08:52:44.461755 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.461812 20507 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-minimal-ipv6-example--bne5ih", Port: 443, Protocol: "TCP", Tags: [{ Key: "Name", Value: "tcp-minimal-ipv6-example--bne5ih" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0313 08:52:44.461967 20507 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0313 08:52:44.462021 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:52:44.462108 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0313 08:52:44.462143 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:44.462355 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.462466 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1b"] }] } I0313 08:52:44.462594 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" } ] }], VpcId: "vpc-1" } I0313 08:52:44.462613 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.462834 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.462939 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0313 08:52:44.463052 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0313 08:52:44.463026 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0313 08:52:44.463249 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:52:44.463351 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:52:44.463407 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:44.463472 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.463619 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0313 08:52:44.463699 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:44.463761 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0313 08:52:44.463550 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal-ipv6.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal-ipv6.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:AssignIpv6Addresses\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal-ipv6.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0313 08:52:44.463862 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0313 08:52:44.463921 20507 tags.go:42] CreateTags { Resources: ["rtb-3"], Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "minimal-ipv6.example.com" } ] } I0313 08:52:44.464000 20507 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0313 08:52:44.464074 20507 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0313 08:52:44.464122 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:52:44.464176 20507 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1b" }, { Key: "Name", Value: "private-us-test-1b.minimal-ipv6.example.com" } ] } I0313 08:52:44.464252 20507 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.464328 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:52:44.464408 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal-ipv6.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:52:44.464501 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:52:44.464552 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0313 08:52:44.464602 20507 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] } I0313 08:52:44.464689 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:52:44.464781 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:44.464826 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0313 08:52:44.464882 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:44.464983 20507 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0313 08:52:44.465234 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.465483 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0313 08:52:44.465637 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-udp-1to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.465792 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-4003to65535-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0313 08:52:44.465935 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] }] } I0313 08:52:44.466129 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", Ipv6CidrBlock: "2001:db8:0:112::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" } ] }], VpcId: "vpc-1" } I0313 08:52:44.466173 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0313 08:52:44.466372 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I0313 08:52:44.466443 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:44.466536 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:44.466608 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.466717 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.466787 20507 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0313 08:52:44.466814 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.466911 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.466873 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", Ipv6CidrBlock: "2001:db8:0:113::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "dualstack-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0313 08:52:44.467017 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:44.466999 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.0.0/22", Ipv6CidrBlock: "2001:db8:0:115::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I0313 08:52:44.466953 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.4.0/22", Ipv6CidrBlock: "2001:db8:0:116::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1b.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0313 08:52:44.467092 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:44.467163 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0313 08:52:44.467159 20507 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.467138 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", Ipv6CidrBlock: "2001:db8:0:111::/64", Ipv6Native: true, TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Private" }, { Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" }, { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" } ] }], VpcId: "vpc-1" } I0313 08:52:44.467234 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:44.467322 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.467413 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1b", CidrBlock: "172.20.64.0/19", Ipv6CidrBlock: "2001:db8:0:114::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }, { Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }, { Key: "SubnetType", Value: "DualStack" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "dualstack-us-test-1b.minimal-ipv6.example.com" } ] }], VpcId: "vpc-1" } I0313 08:52:44.467488 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }] } I0313 08:52:44.467604 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0313 08:52:44.467741 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-2" } I0313 08:52:44.467790 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.467921 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-ingress-all-0to0-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.468053 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-1to2379-masters.minimal-ipv6.example.com" }] }] } I0313 08:52:44.468191 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-all-0to0-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.468319 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" }] }] } I0313 08:52:44.468455 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.468634 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0313 08:52:44.468775 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal-ipv6.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.468895 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal-ipv6.example.com-ingress-tcp-2382to4000-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.469048 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0313 08:52:44.469108 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:44.469166 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0313 08:52:44.469345 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0313 08:52:44.469436 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0313 08:52:44.469522 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.469705 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.469941 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", EgressOnlyInternetGatewayId: "eigw-2", RouteTableId: "rtb-1" } I0313 08:52:44.470057 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-3" } I0313 08:52:44.470177 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" },{ Key: "Name", Value: "from-::/0-ingress-tcp-443to443-masters.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" }] }] } I0313 08:52:44.470433 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:52:44.470501 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0313 08:52:44.470586 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0313 08:52:44.470668 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0313 08:52:44.470709 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0313 08:52:44.470757 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0313 08:52:44.470798 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:52:44.470845 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:44.470915 20507 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0313 08:52:44.471000 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:44.471051 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:44.471128 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:44.471095 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:44.471200 20507 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-4"] }] } I0313 08:52:44.471247 20507 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "dualstack", Name: "api-minimal-ipv6-example--jhj9te", SubnetMappings: [{ SubnetId: "subnet-3" },{ SubnetId: "subnet-4" }], Tags: [{ Key: "Name", Value: "api.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }], Type: "network" } I0313 08:52:44.471273 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:44.471339 20507 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-1", SubnetId: "subnet-4", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1b.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.471404 20507 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-3"] }] } I0313 08:52:44.471477 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0313 08:52:44.471538 20507 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-2", SubnetId: "subnet-3", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.minimal-ipv6.example.com" },{ Key: "KubernetesCluster", Value: "minimal-ipv6.example.com" },{ Key: "kubernetes.io/cluster/minimal-ipv6.example.com", Value: "owned" }] }] } I0313 08:52:44.471600 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0313 08:52:44.471662 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:44.471836 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-5"] }] } I0313 08:52:44.471902 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-5" } I0313 08:52:44.472052 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0313 08:52:44.472142 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:44.472331 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0313 08:52:44.472381 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0313 08:52:44.472418 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0313 08:52:44.472488 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:52:44.472529 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0313 08:52:44.472567 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-3" } I0313 08:52:44.472617 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-4"] }] } I0313 08:52:44.472693 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-3", SubnetId: "subnet-4" } I0313 08:52:44.472739 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0313 08:52:44.472805 20507 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1", Port: 443, Protocol: "TCP" } I0313 08:52:44.472864 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0313 08:52:44.472902 20507 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "false" },{ Key: "access_logs.s3.enabled", Value: "false" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0313 08:52:44.472964 20507 tags.go:42] CreateTags { Resources: ["subnet-4"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } W0313 08:52:44.473017 20507 api.go:53] PageSize not implemented I0313 08:52:44.473027 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0313 08:52:44.473079 20507 tags.go:42] CreateTags { Resources: ["subnet-3"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-2" }] } I0313 08:52:44.473124 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0313 08:52:44.473177 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0313 08:52:44.473223 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:44.473379 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-6"] }] } I0313 08:52:44.473423 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-6" } I0313 08:52:44.473499 20507 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0313 08:52:44.473546 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:44.473603 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:44.473622 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:44.473624 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0313 08:52:44.473622 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:44.473737 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:44.473811 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-2", RouteTableId: "rtb-2" } I0313 08:52:44.473809 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:44.473895 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:44.473897 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:44.473926 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0313 08:52:44.474054 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0313 08:52:44.473886 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:44.474125 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:44.474216 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:44.474299 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "64:ff9b::/96", NatGatewayId: "nat-1", RouteTableId: "rtb-1" } I0313 08:52:44.474378 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:44.474509 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-2", RouteTableId: "rtb-2" } I0313 08:52:44.479278 20507 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0313 08:52:44.479544 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:44.479672 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:44.479754 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:44.479880 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:44.480576 20507 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0313 08:52:44.480816 20507 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0313 08:52:44.481106 20507 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0313 08:52:44.481166 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:44.481206 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:44.481272 20507 dns.go:235] Pre-creating DNS records I0313 08:52:44.481299 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:44.487930 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.25.13 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.13 ********************************************************************************* I0313 08:52:44.491726 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:44.491821 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:45.746065 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:45.929273 20507 iamrole.go:89] ListRoles: { } I0313 08:52:45.931403 20507 executor.go:111] Tasks: 0 done / 136 total; 46 can run I0313 08:52:45.931991 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.932475 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.932618 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.932760 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.932882 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:52:45.932917 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:52:45.932970 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:45.933012 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal-ipv6.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:52:45.933099 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:45.935596 20507 executor.go:111] Tasks: 46 done / 136 total; 25 can run I0313 08:52:45.935765 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0313 08:52:45.935961 20507 iamrole.go:161] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0313 08:52:45.935808 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.minimal-ipv6.example.com"] } ] } I0313 08:52:45.935962 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-minimal-ipv6-example--bne5ih"] } I0313 08:52:45.936086 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0313 08:52:45.936149 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } I0313 08:52:45.936065 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.936281 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:45.936370 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.936550 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.936713 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.936878 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal-ipv6.example.com"] } ] } I0313 08:52:45.937078 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:45.937149 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] },{ Name: "tag:Name", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.937289 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:45.937414 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:45.937536 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal-ipv6.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal-ipv6.example.com"] } ] } I0313 08:52:45.937752 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:45.937888 20507 executor.go:111] Tasks: 71 done / 136 total; 36 can run I0313 08:52:45.938083 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:45.938246 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.938449 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.938690 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:52:45.938767 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0313 08:52:45.938856 20507 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0313 08:52:45.938921 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0313 08:52:45.939041 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.939219 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-4"] } I0313 08:52:45.939292 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:45.939435 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0313 08:52:45.939543 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["dualstack-us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.939698 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:45.939793 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0313 08:52:45.939928 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.940092 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1b.minimal-ipv6.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.940237 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:45.940295 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:45.940390 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0313 08:52:45.940466 20507 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0313 08:52:45.940527 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0313 08:52:45.940637 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-6"] } I0313 08:52:45.940709 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-5"] } I0313 08:52:45.940780 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:45.940914 20507 executor.go:111] Tasks: 107 done / 136 total; 9 can run I0313 08:52:45.941034 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:45.941073 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:45.941171 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:45.941128 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:45.941194 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0313 08:52:45.941332 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0313 08:52:45.941259 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0313 08:52:45.941398 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0313 08:52:45.941459 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4"] } I0313 08:52:45.941456 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:45.941514 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } I0313 08:52:45.941557 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:45.941638 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0313 08:52:45.941700 20507 api.go:53] PageSize not implemented I0313 08:52:45.941713 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0313 08:52:45.941777 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:45.941866 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0313 08:52:45.941969 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-3"] } I0313 08:52:45.942087 20507 executor.go:111] Tasks: 116 done / 136 total; 8 can run I0313 08:52:45.942152 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:45.942200 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:45.942215 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:45.942221 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0313 08:52:45.942295 20507 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0313 08:52:45.942307 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:45.942346 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:45.942240 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:45.942386 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0313 08:52:45.942384 20507 dnsname.go:118] AliasTarget for "api.minimal-ipv6.example.com" is "api-minimal-ipv6-example--jhj9te.amazonaws.com" I0313 08:52:45.942461 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:45.942497 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:45.942591 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:45.942577 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:45.942660 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:45.942629 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0313 08:52:45.942819 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:45.942856 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0313 08:52:45.949832 20507 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0313 08:52:45.950052 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:45.950235 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:45.950318 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:45.950490 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:45.951199 20507 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0313 08:52:45.951515 20507 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0313 08:52:45.951839 20507 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0313 08:52:45.955313 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0313 08:52:45.955384 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:52:45.955432 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0313 08:52:45.955471 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-2"] }] } I0313 08:52:45.955511 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0313 08:52:45.955549 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:52:45.955588 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-2"] }] } I0313 08:52:45.955624 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0313 08:52:45.955656 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0313 08:52:45.955696 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:52:45.955734 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0313 08:52:45.955769 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0313 08:52:45.955813 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0313 08:52:45.955856 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0313 08:52:45.955893 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-2"] }] } I0313 08:52:45.955926 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0313 08:52:45.955956 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0313 08:52:45.955985 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:52:45.956019 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0313 08:52:45.956050 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0313 08:52:45.956083 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-3"] }] } I0313 08:52:45.956116 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:52:45.956150 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:52:45.956183 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0313 08:52:45.956215 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:52:45.956248 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:52:45.956278 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0313 08:52:45.956313 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0313 08:52:45.956348 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-4"] }] } I0313 08:52:45.956384 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-5"] }] } I0313 08:52:45.956418 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-6"] }] } I0313 08:52:45.956451 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0313 08:52:45.956483 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0313 08:52:45.956517 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:52:45.956557 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:52:45.956595 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:52:45.956628 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0313 08:52:45.958657 20507 delete_cluster.go:128] Looking for cloud resources to delete W0313 08:52:45.958735 20507 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0313 08:52:45.958757 20507 keypairs.go:95] DescribeKeyPairs: { } I0313 08:52:45.958802 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.958858 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0313 08:52:45.958929 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.958996 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.959051 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.959105 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.959157 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.959207 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } I0313 08:52:45.959279 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.959370 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:52:45.959407 20507 natgateway.go:117] DescribeNatGateways: { } I0313 08:52:45.959456 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal-ipv6.example.com"] }] } I0313 08:52:45.959500 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal-ipv6.example.com"] }] } W0313 08:52:45.959555 20507 api.go:53] PageSize not implemented I0313 08:52:45.959576 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:45.959603 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:45.959620 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1"] } I0313 08:52:45.959660 20507 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0313 08:52:45.959686 20507 targetgroups.go:35] PageSize not implemented I0313 08:52:45.959703 20507 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" ] } I0313 08:52:45.959762 20507 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0313 08:52:45.959808 20507 iamrole.go:89] ListRoles: { } I0313 08:52:45.959859 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:45.959889 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:45.959930 20507 internetgateways.go:101] DescribeInternetGateways: { } I0313 08:52:45.959978 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:52:45.960027 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2","rtb-3"] } I0313 08:52:45.960074 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-2"] } I0313 08:52:45.960114 20507 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-2"] } I0313 08:52:45.960151 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0313 08:52:45.960184 20507 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-1"] } I0313 08:52:45.960857 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:45.960870 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0313 08:52:45.960983 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal-ipv6.example.com" } iam-instance-profile:masters.minimal-ipv6.example.com ok autoscaling-group:master-us-test-1a.masters.minimal-ipv6.example.com ok I0313 08:52:45.961005 20507 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4" } autoscaling-group:nodes.minimal-ipv6.example.com ok I0313 08:52:45.961118 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0313 08:52:45.961149 20507 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-minimal-ipv6-example--jhj9te/1 ok I0313 08:52:45.961189 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal-ipv6.example.com" } iam-instance-profile:nodes.minimal-ipv6.example.com ok I0313 08:52:45.960922 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: -1, IpProtocol: "icmpv6", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: -1 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 443 } ] } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-minimal-ipv6-example--bne5ih/4 ok I0313 08:52:45.961048 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-minimal-ipv6-example--jhj9te.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.minimal-ipv6.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal-ipv6.example.com.", ResourceRecords: [{ Value: "fd00:dead:add::" }], TTL: 10, Type: "AAAA" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.minimal-ipv6.example.com ok W0313 08:52:45.961288 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:52:45.961353 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0313 08:52:45.961403 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-1 ok I0313 08:52:45.961495 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-6" } subnet:subnet-6 ok I0313 08:52:45.961565 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0313 08:52:45.961614 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:45.961679 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0313 08:52:45.961717 20507 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0313 08:52:45.961786 20507 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } nat-gateway:nat-1 ok I0313 08:52:45.961849 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-4" } subnet:subnet-4 ok I0313 08:52:45.961931 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0313 08:52:45.962003 20507 egressonlyinternetgateways.go:171] DeleteEgressOnlyInternetGateway: { EgressOnlyInternetGatewayId: "eigw-2" } egress-only-internet-gateway:eigw-2 ok I0313 08:52:45.962077 20507 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-2" } nat-gateway:nat-2 ok I0313 08:52:45.962136 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:45.962199 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", Ipv6Ranges: [{ CidrIpv6: "::/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0313 08:52:45.962361 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:52:45.962385 20507 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } autoscaling-config:lt-2 ok I0313 08:52:45.962462 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0313 08:52:45.962542 20507 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0313 08:52:45.962664 20507 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-2" } elastic-ip:eipalloc-2 ok I0313 08:52:45.962737 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0313 08:52:45.962727 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal-ipv6.example.com" } I0313 08:52:45.962806 20507 iamrole.go:180] ListAttachedRolePolicies: masters.minimal-ipv6.example.com I0313 08:52:45.962828 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal-ipv6.example.com", RoleName: "masters.minimal-ipv6.example.com" } I0313 08:52:45.962818 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-5" } subnet:subnet-5 ok I0313 08:52:45.962866 20507 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal-ipv6.example.com" } iam-role:masters.minimal-ipv6.example.com ok I0313 08:52:45.962941 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } subnet:subnet-2 ok I0313 08:52:45.963008 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-3" } route-table:rtb-3 ok I0313 08:52:45.962989 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal-ipv6.example.com" } I0313 08:52:45.963093 20507 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal-ipv6.example.com I0313 08:52:45.963127 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal-ipv6.example.com", RoleName: "nodes.minimal-ipv6.example.com" } I0313 08:52:45.963075 20507 address.go:185] ReleaseAddress: { AllocationId: "eipalloc-1" } elastic-ip:eipalloc-1 ok I0313 08:52:45.963184 20507 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal-ipv6.example.com" } iam-role:nodes.minimal-ipv6.example.com ok I0313 08:52:45.963306 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0313 08:52:45.963393 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0313 08:52:45.963509 20507 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0313 08:52:45.963621 20507 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleIPv6 (2.98s) === RUN TestLifecycleSharedVPC I0313 08:52:45.964200 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:45.964363 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:45.964417 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:45.964491 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:45.964556 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:45.964641 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:45.964700 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:45.964754 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:45.964822 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:45.964872 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedvpc.example.com I0313 08:52:45.992770 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:52:45.998314 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:45.998416 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:47.257358 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:47.433597 20507 iamrole.go:89] ListRoles: { } I0313 08:52:47.434650 20507 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0313 08:52:47.434982 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:52:47.435131 20507 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "sharedvpc.example.com" }] }] } I0313 08:52:47.435330 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:47.435513 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:47.435532 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:52:47.435779 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:52:47.435862 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:52:47.435989 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0313 08:52:47.436053 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0313 08:52:47.436093 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } I0313 08:52:47.436124 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:47.436167 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0313 08:52:47.436223 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } I0313 08:52:47.436265 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", Tags: [{ Key: "Name", Value: "masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] } I0313 08:52:47.436288 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedvpc.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:52:47.436416 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:52:47.441363 20507 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0313 08:52:47.441518 20507 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0313 08:52:47.441638 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0313 08:52:47.442415 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0313 08:52:47.442665 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0313 08:52:47.442691 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:52:47.442874 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0313 08:52:47.442910 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:47.442991 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0313 08:52:47.443080 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0313 08:52:47.443267 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0313 08:52:47.443298 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0313 08:52:47.443543 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }], VpcId: "vpc-12345678" } I0313 08:52:47.443659 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:52:47.443717 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:47.443778 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:52:47.443827 20507 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "sharedvpc.example.com" }, { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0313 08:52:47.443909 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:47.444009 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedvpc.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedvpc.example.com" }] }], VpcId: "vpc-12345678" } I0313 08:52:47.444090 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:52:47.444141 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:47.444167 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "sharedvpc.example.com" }, { Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.sharedvpc.example.com" } ] }], VpcId: "vpc-12345678" } I0313 08:52:47.444326 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:52:47.444383 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:47.445018 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedvpc.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedvpc.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedvpc.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0313 08:52:47.448494 20507 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0313 08:52:47.448736 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0313 08:52:47.449010 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-1to2379-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0313 08:52:47.449179 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:47.449330 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0313 08:52:47.449469 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0313 08:52:47.449689 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0313 08:52:47.449897 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0313 08:52:47.450032 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:47.450121 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:47.450235 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0313 08:52:47.450315 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0313 08:52:47.450548 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0313 08:52:47.450613 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0313 08:52:47.450755 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0313 08:52:47.450804 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:47.450911 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:47.451011 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-2382to4000-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0313 08:52:47.451240 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedvpc.example.com-ingress-all-0to0-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0313 08:52:47.451394 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" }] }] } I0313 08:52:47.451540 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-all-0to0-nodes.sharedvpc.example.com" }] }] } I0313 08:52:47.451679 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-udp-1to65535-masters.sharedvpc.example.com" }] }] } I0313 08:52:47.451812 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" },{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedvpc.example.com-ingress-tcp-4003to65535-masters.sharedvpc.example.com" }] }] } I0313 08:52:47.451969 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:47.452080 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:47.452168 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedvpc.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedvpc.example.com" },{ Key: "KubernetesCluster", Value: "sharedvpc.example.com" }] }] } I0313 08:52:47.452563 20507 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0313 08:52:47.453074 20507 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0313 08:52:47.453582 20507 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0313 08:52:47.453646 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:47.453690 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:47.453766 20507 dns.go:235] Pre-creating DNS records I0313 08:52:47.453799 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:47.459861 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:52:47.463079 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:47.463167 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:48.724592 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:48.899058 20507 iamrole.go:89] ListRoles: { } I0313 08:52:48.900031 20507 executor.go:111] Tasks: 0 done / 98 total; 44 can run I0313 08:52:48.900620 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedvpc.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:52:48.900856 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:48.901029 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:48.902699 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:48.902975 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:52:48.903083 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0313 08:52:48.903127 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0313 08:52:48.908219 20507 executor.go:111] Tasks: 44 done / 98 total; 21 can run I0313 08:52:48.908402 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedvpc.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedvpc.example.com"] } ] } I0313 08:52:48.908519 20507 iamrole.go:161] ListAttachedRolePolicies: masters.sharedvpc.example.com I0313 08:52:48.908651 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:48.908724 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0313 08:52:48.908730 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:48.908866 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }, { Name: "tag:Name", Values: ["nodes.sharedvpc.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedvpc.example.com"] } ] } I0313 08:52:48.909012 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:48.909070 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.sharedvpc.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:48.909212 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:48.909844 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:52:48.917437 20507 executor.go:111] Tasks: 65 done / 98 total; 25 can run I0313 08:52:48.917619 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:48.917739 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:48.917919 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:48.918086 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:48.918279 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:48.918525 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:48.918709 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:48.919348 20507 executor.go:111] Tasks: 90 done / 98 total; 2 can run I0313 08:52:48.919590 20507 executor.go:111] Tasks: 92 done / 98 total; 6 can run I0313 08:52:48.919900 20507 executor.go:111] Tasks: 98 done / 98 total; 0 can run I0313 08:52:48.923016 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0313 08:52:48.923084 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0313 08:52:48.923121 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:52:48.923153 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0313 08:52:48.923185 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0313 08:52:48.923222 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0313 08:52:48.923257 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0313 08:52:48.923296 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0313 08:52:48.923336 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0313 08:52:48.923368 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0313 08:52:48.923398 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:52:48.923436 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0313 08:52:48.923467 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:52:48.923500 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:52:48.923535 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:52:48.923576 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:52:48.923633 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0313 08:52:48.923672 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0313 08:52:48.923703 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:52:48.923739 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:52:48.923775 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0313 08:52:48.925167 20507 delete_cluster.go:128] Looking for cloud resources to delete W0313 08:52:48.925234 20507 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0313 08:52:48.925277 20507 keypairs.go:95] DescribeKeyPairs: { } I0313 08:52:48.925322 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:48.925372 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0313 08:52:48.925431 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:48.925491 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:48.925534 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:48.925576 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:48.925621 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:48.925664 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } I0313 08:52:48.925713 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:48.925772 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedvpc.example.com"] }] } I0313 08:52:48.925809 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedvpc.example.com"] }] } W0313 08:52:48.925857 20507 api.go:53] PageSize not implemented I0313 08:52:48.925879 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:48.925907 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:48.925926 20507 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0313 08:52:48.925952 20507 targetgroups.go:35] PageSize not implemented I0313 08:52:48.925974 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0313 08:52:48.926026 20507 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0313 08:52:48.926068 20507 iamrole.go:89] ListRoles: { } I0313 08:52:48.926116 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:48.926147 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:48.926197 20507 internetgateways.go:101] DescribeInternetGateways: { } I0313 08:52:48.926239 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:52:48.926268 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:48.926651 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } autoscaling-config:lt-1 ok I0313 08:52:48.926718 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedvpc.example.com" } iam-instance-profile:nodes.sharedvpc.example.com ok autoscaling-group:nodes.sharedvpc.example.com ok I0313 08:52:48.926761 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } autoscaling-group:master-us-test-1a.masters.sharedvpc.example.com ok I0313 08:52:48.926859 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedvpc.example.com" } iam-instance-profile:masters.sharedvpc.example.com ok I0313 08:52:48.926778 20507 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0313 08:52:48.926804 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedvpc.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/kops-controller.internal.sharedvpc.example.com. ok I0313 08:52:48.926934 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:48.927033 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }] } W0313 08:52:48.927173 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:52:48.927198 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I0313 08:52:48.927249 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0313 08:52:48.927312 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:48.927365 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } W0313 08:52:48.927572 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:52:48.927593 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0313 08:52:48.927628 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0313 08:52:48.927720 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedvpc.example.com" } I0313 08:52:48.927771 20507 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedvpc.example.com I0313 08:52:48.927787 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedvpc.example.com", RoleName: "nodes.sharedvpc.example.com" } I0313 08:52:48.927830 20507 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedvpc.example.com" } iam-role:nodes.sharedvpc.example.com ok I0313 08:52:48.927864 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedvpc.example.com" } I0313 08:52:48.927826 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0313 08:52:48.927908 20507 iamrole.go:180] ListAttachedRolePolicies: masters.sharedvpc.example.com I0313 08:52:48.927968 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedvpc.example.com", RoleName: "masters.sharedvpc.example.com" } I0313 08:52:48.928022 20507 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedvpc.example.com" } iam-role:masters.sharedvpc.example.com ok I0313 08:52:48.928113 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok --- PASS: TestLifecycleSharedVPC (2.96s) === RUN TestLifecycleComplex I0313 08:52:48.928673 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:52:48.928835 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:52:48.928887 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:52:48.928956 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:52:48.929024 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:52:48.929111 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:52:48.929168 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:52:48.929225 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:52:48.929292 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:52:48.929340 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster complex.example.com I0313 08:52:48.964227 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:52:48.968587 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:48.968705 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:50.241399 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:50.436863 20507 iamrole.go:89] ListRoles: { } I0313 08:52:50.439008 20507 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0313 08:52:50.439250 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0313 08:52:50.439686 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:50.439773 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:50.439820 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } I0313 08:52:50.439831 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-main.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "k8s.io/etcd/main", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:52:50.439899 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] } W0313 08:52:50.439871 20507 api.go:53] PageSize not implemented I0313 08:52:50.439954 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:52:50.439997 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:50.440133 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0313 08:52:50.440314 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Name", Value: "a.etcd-events.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "k8s.io/etcd/events", Value: "a/a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:52:50.440505 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:52:50.440582 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:50.440710 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } I0313 08:52:50.440767 20507 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0313 08:52:50.440796 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0313 08:52:50.440818 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.complex.example.com", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] } I0313 08:52:50.440961 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:50.441148 20507 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0313 08:52:50.441292 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:52:50.441358 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0313 08:52:50.441493 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0313 08:52:50.441544 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0313 08:52:50.441574 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:52:50.441627 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:50.442018 20507 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0313 08:52:50.442201 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:50.442267 20507 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0313 08:52:50.442356 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0313 08:52:50.442417 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0313 08:52:50.442322 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0313 08:52:50.442475 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0313 08:52:50.442520 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0313 08:52:50.442471 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] }] } I0313 08:52:50.442631 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0313 08:52:50.442628 20507 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tcp-complex-example-com-vpjolq", Port: 443, Protocol: "TCP", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tcp-complex-example-com-vpjolq" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0313 08:52:50.442699 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0313 08:52:50.442771 20507 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0313 08:52:50.442729 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] }], VpcId: "vpc-1" } I0313 08:52:50.442850 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0313 08:52:50.442898 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:52:50.442969 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:50.443024 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:50.442997 20507 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "tls-complex-example-com-5nursn", Port: 443, Protocol: "TLS", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "tls-complex-example-com-5nursn" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ], UnhealthyThresholdCount: 2, VpcId: "vpc-1" } I0313 08:52:50.443190 20507 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.2.0.0/16", VpcId: "vpc-1" } I0313 08:52:50.443195 20507 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0313 08:52:50.443246 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:50.443425 20507 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0313 08:52:50.443534 20507 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0313 08:52:50.443572 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:50.443672 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:50.443771 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:50.443872 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:50.443947 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:50.444024 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0313 08:52:50.444016 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.96.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "us-east-1a-utility.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Utility" } ] }], VpcId: "vpc-1" } I0313 08:52:50.444136 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0313 08:52:50.444246 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "api-elb.complex.example.com" } ] }], VpcId: "vpc-1" } I0313 08:52:50.444358 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:52:50.444412 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:52:50.444467 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:50.444509 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0313 08:52:50.444656 20507 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "10.1.0.0/16", VpcId: "vpc-1" } I0313 08:52:50.444647 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0313 08:52:50.444750 20507 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0313 08:52:50.444825 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0313 08:52:50.444591 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/complex.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/complex.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"complex.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0313 08:52:50.444882 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:50.444980 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.complex.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [ { Key: "Name", Value: "masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }], VpcId: "vpc-1" } I0313 08:52:50.445106 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0313 08:52:50.445167 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:50.445213 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:52:50.445282 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:50.445324 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0313 08:52:50.445489 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:52:50.445461 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" } ] }], VpcId: "vpc-1" } I0313 08:52:50.445582 20507 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0313 08:52:50.445694 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0313 08:52:50.445744 20507 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ] } I0313 08:52:50.445886 20507 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0313 08:52:50.446051 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:50.446173 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:50.446335 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0313 08:52:50.446394 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:50.446570 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "192.168.1.10/32", RouteTableId: "rtb-2", TransitGatewayId: "tgw-0123456" } I0313 08:52:50.446712 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0313 08:52:50.446889 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0313 08:52:50.447069 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0313 08:52:50.447228 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:50.447357 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", RouteTableId: "rtb-2", TransitGatewayId: "tgw-123456" } I0313 08:52:50.447428 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:50.447502 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0313 08:52:50.447551 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }] } I0313 08:52:50.447650 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-::/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0313 08:52:50.447807 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-all-0to0-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0313 08:52:50.447959 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-::/0" } ] }] } I0313 08:52:50.448093 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:50.448169 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-1to2379-masters.complex.example.com" } ] }] } I0313 08:52:50.448337 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:50.448439 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0313 08:52:50.448538 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-masters.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0313 08:52:50.449644 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0313 08:52:50.448614 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "10.1.64.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-east-1a-private.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0313 08:52:50.449755 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }] } I0313 08:52:50.450156 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }] } I0313 08:52:50.450311 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }] } I0313 08:52:50.450436 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-2382to4000-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" } ] }] } I0313 08:52:50.450642 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }] } I0313 08:52:50.450777 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0313 08:52:50.450879 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }] } I0313 08:52:50.451090 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0313 08:52:50.451411 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-1.1.1.1/32-ingress-tcp-22to22-nodes.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0313 08:52:50.451694 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-nodes.complex.example.com-ingress-tcp-4003to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0313 08:52:50.452042 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-ingress-udp-1to65535-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0313 08:52:50.452333 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Name", Value: "from-1.1.1.0/24-ingress-tcp-443to443-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" } ] }] } I0313 08:52:50.452688 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0313 08:52:50.452793 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-2" } I0313 08:52:50.452917 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-masters.complex.example.com-ingress-all-0to0-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0313 08:52:50.453561 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" } ] }] } I0313 08:52:50.453774 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-nodes.complex.example.com-egress-all-0to0-0.0.0.0/0" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" } ] }] } I0313 08:52:50.453926 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [ { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "Owner", Value: "John Doe" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.complex.example.com" } ] }] } I0313 08:52:50.454081 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }] } I0313 08:52:50.454177 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 }] } I0313 08:52:50.454310 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0313 08:52:50.454372 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:52:50.454447 20507 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0313 08:52:50.454534 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0313 08:52:50.455192 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0313 08:52:50.455301 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:50.455420 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-3"] }] } I0313 08:52:50.455479 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-3" } I0313 08:52:50.455551 20507 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "api-complex-example-com-vd3t5n", SubnetMappings: [{ AllocationId: "eipalloc-012345a678b9cdefa", SubnetId: "subnet-1" }], Tags: [ { Key: "Name", Value: "api.complex.example.com" }, { Key: "KubernetesCluster", Value: "complex.example.com" }, { Key: "kubernetes.io/cluster/complex.example.com", Value: "owned" }, { Key: "foo/bar", Value: "fib+baz" }, { Key: "Owner", Value: "John Doe" } ], Type: "network" } I0313 08:52:50.455684 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:50.455747 20507 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-test-1:000000000000:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0313 08:52:50.455838 20507 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0313 08:52:50.455908 20507 loadbalancers.go:170] ModifyLoadBalancerAttributes v2 { Attributes: [{ Key: "load_balancing.cross_zone.enabled", Value: "true" },{ Key: "access_logs.s3.enabled", Value: "true" },{ Key: "access_logs.s3.bucket", Value: "access-log-example" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0313 08:52:50.455980 20507 api.go:53] PageSize not implemented I0313 08:52:50.456031 20507 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0313 08:52:50.456087 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0313 08:52:50.456110 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0313 08:52:50.456182 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:50.456208 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:50.456268 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:50.456362 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:50.456372 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:50.456462 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:50.456448 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:50.456483 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:50.462026 20507 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0313 08:52:50.462237 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:50.462372 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:50.462512 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:50.462642 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:50.463378 20507 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0313 08:52:50.463622 20507 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0313 08:52:50.463902 20507 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0313 08:52:50.463947 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:50.463983 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:50.464046 20507 dns.go:235] Pre-creating DNS records I0313 08:52:50.464073 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:50.473199 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:52:50.477436 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:50.477529 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:51.740864 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:51.937176 20507 iamrole.go:89] ListRoles: { } I0313 08:52:51.939300 20507 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0313 08:52:51.939647 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:51.939993 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:51.940186 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:52:51.940241 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:52:51.940320 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0313 08:52:51.940457 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0313 08:52:51.940555 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:51.940711 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:51.940762 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0313 08:52:51.941170 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:51.941642 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0313 08:52:51.941791 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } W0313 08:52:51.942038 20507 api.go:53] PageSize not implemented I0313 08:52:51.943721 20507 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0313 08:52:51.943902 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0313 08:52:51.943855 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:51.943960 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0313 08:52:51.944016 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:51.944052 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:52:51.944072 20507 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0313 08:52:51.944143 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0313 08:52:51.944111 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:51.944206 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0313 08:52:51.944335 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:52:51.944368 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:51.944405 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0313 08:52:51.944446 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:51.944668 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:51.944802 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0313 08:52:51.945030 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:51.945097 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:51.945235 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0313 08:52:51.945439 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:51.945599 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:51.945718 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0313 08:52:51.945873 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:51.946089 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:51.946184 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:51.946288 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:51.946412 20507 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0313 08:52:51.946689 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:51.946807 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:51.946996 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:51.947571 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:51.947743 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:51.947883 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:51.947980 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:51.948144 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:52:51.948297 20507 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0313 08:52:51.948385 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:51.948454 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:51.948475 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:51.948519 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:51.948491 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:51.948556 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0313 08:52:51.948673 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:52:51.948726 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:52:51.948762 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0313 08:52:51.948864 20507 api.go:53] PageSize not implemented I0313 08:52:51.948913 20507 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0313 08:52:51.948960 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:51.949011 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:51.949030 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:51.949122 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:51.949219 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:51.949025 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:51.949243 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:51.949320 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:52:51.949358 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:51.949388 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:51.949443 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:51.949521 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:52:51.949547 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:51.949574 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:51.954765 20507 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0313 08:52:51.954884 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:51.955038 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:51.955216 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:51.955394 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:51.955925 20507 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0313 08:52:51.956224 20507 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0313 08:52:51.956537 20507 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.sslCertificate=arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678] I0313 08:52:51.962543 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:51.966127 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:51.978223 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:52:51.982372 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:51.982470 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:53.251606 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:53.450576 20507 iamrole.go:89] ListRoles: { } I0313 08:52:53.452793 20507 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0313 08:52:53.453054 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:53.453189 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:52:53.453227 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:52:53.453319 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:53.453468 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0313 08:52:53.453617 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0313 08:52:53.453674 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:53.453823 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:53.453975 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0313 08:52:53.454075 20507 api.go:53] PageSize not implemented I0313 08:52:53.454161 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0313 08:52:53.454305 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] }] } I0313 08:52:53.454479 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0313 08:52:53.456319 20507 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0313 08:52:53.456457 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0313 08:52:53.456583 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0313 08:52:53.456664 20507 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0313 08:52:53.456597 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:53.456684 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:52:53.456740 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0313 08:52:53.456753 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:53.456837 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0313 08:52:53.456925 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:52:53.456935 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:53.456975 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0313 08:52:53.457044 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0313 08:52:53.457211 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:53.457262 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0313 08:52:53.457473 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:53.457552 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:53.457732 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:53.457798 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:53.457913 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:53.458079 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:53.458201 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:53.458314 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:53.458478 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:53.458535 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0313 08:52:53.458795 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:53.459009 20507 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0313 08:52:53.459235 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:53.459427 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:53.459574 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:53.459739 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:53.459835 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:53.459981 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:52:53.460107 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:53.460271 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:53.460739 20507 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0313 08:52:53.460814 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:53.460871 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:53.460964 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:53.460987 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:53.461038 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:53.461078 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0313 08:52:53.461120 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:52:53.461161 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:52:53.461196 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0313 08:52:53.461421 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { Names: ["api-complex-example-com-vd3t5n"] } I0313 08:52:53.461463 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0313 08:52:53.461496 20507 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/1" } I0313 08:52:53.461527 20507 listeners.go:103] DeleteListener v2 { ListenerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:listener/net/api-complex-example-com-vd3t5n/1/2" } I0313 08:52:53.461566 20507 listeners.go:56] CreateListener v2 { Certificates: [{ CertificateArn: "arn:aws-test:acm:us-east-1:123456789012:certificate/123456789012-1234-1234-1234-12345678" }], DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 443, Protocol: "TLS", SslPolicy: "ELBSecurityPolicy-2016-08" } I0313 08:52:53.461659 20507 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1", Port: 8443, Protocol: "TCP" } I0313 08:52:53.461726 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:53.461762 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } W0313 08:52:53.461809 20507 api.go:53] PageSize not implemented I0313 08:52:53.461880 20507 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0313 08:52:53.461987 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:53.462041 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:52:53.462063 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:53.462133 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:52:53.462046 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:53.462169 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:53.462191 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:53.462373 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:53.462434 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:53.462460 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:53.462585 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:53.462647 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:53.462799 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:53.462848 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:53.467943 20507 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0313 08:52:53.468072 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:53.468222 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:53.468366 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:53.468551 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:53.469426 20507 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0313 08:52:53.469693 20507 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0313 08:52:53.469956 20507 executor.go:111] Tasks: 135 done / 135 total; 0 can run I0313 08:52:53.470012 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:53.470054 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:53.470125 20507 dns.go:235] Pre-creating DNS records I0313 08:52:53.478141 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:52:53.482407 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:53.482503 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:54.739592 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:54.934423 20507 iamrole.go:89] ListRoles: { } I0313 08:52:54.936221 20507 executor.go:111] Tasks: 0 done / 135 total; 51 can run I0313 08:52:54.936663 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } W0313 08:52:54.936821 20507 api.go:53] PageSize not implemented I0313 08:52:54.936849 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:54.937022 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0313 08:52:54.937129 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:54.937212 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:54.937238 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:52:54.937276 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:52:54.937338 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:54.937382 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:54.937733 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0313 08:52:54.938415 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0313 08:52:54.938838 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:54.940857 20507 executor.go:111] Tasks: 51 done / 135 total; 28 can run I0313 08:52:54.941045 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0313 08:52:54.940981 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0313 08:52:54.941121 20507 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0313 08:52:54.941136 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:54.941183 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0313 08:52:54.941147 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0313 08:52:54.941314 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:52:54.941347 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0313 08:52:54.941293 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:54.941397 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0313 08:52:54.941476 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0313 08:52:54.941550 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:52:54.941621 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0313 08:52:54.941659 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:54.941754 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:54.941976 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:54.942036 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:54.942140 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:54.942224 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:54.942313 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0313 08:52:54.942463 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:54.942537 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:54.942801 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:54.942876 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:54.943066 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:54.943379 20507 executor.go:111] Tasks: 79 done / 135 total; 38 can run I0313 08:52:54.943594 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:54.943781 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:54.944040 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:54.944180 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:54.944276 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:54.944437 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:52:54.945046 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:54.945147 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:54.945335 20507 executor.go:111] Tasks: 117 done / 135 total; 2 can run I0313 08:52:54.945431 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0313 08:52:54.945438 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0313 08:52:54.945504 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:54.945593 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:54.945646 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:54.945687 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0313 08:52:54.945730 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:52:54.945772 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:52:54.945830 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0313 08:52:54.945937 20507 api.go:53] PageSize not implemented I0313 08:52:54.945997 20507 executor.go:111] Tasks: 119 done / 135 total; 4 can run I0313 08:52:54.946074 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:54.946125 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:52:54.946094 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:54.946169 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:54.946202 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:54.946202 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:54.946383 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:52:54.946416 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:54.946462 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:54.946542 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:54.946616 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:54.946641 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:54.946735 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:54.946787 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:54.952324 20507 executor.go:111] Tasks: 123 done / 135 total; 4 can run I0313 08:52:54.952468 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:54.952641 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:54.952792 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:54.952959 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:54.953743 20507 executor.go:111] Tasks: 127 done / 135 total; 2 can run I0313 08:52:54.954001 20507 executor.go:111] Tasks: 129 done / 135 total; 6 can run I0313 08:52:54.954235 20507 executor.go:111] Tasks: 135 done / 135 total; 0 can run lifecycle_integration_test.go:216: overriding cluster values [spec.api.loadBalancer.additionalSecurityGroups=sg-123456] I0313 08:52:54.957770 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:54.961373 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:54.973646 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:52:54.977763 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:54.977856 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:56.245790 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:56.429073 20507 iamrole.go:89] ListRoles: { } I0313 08:52:56.430544 20507 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0313 08:52:56.430708 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:56.430840 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:56.430961 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0313 08:52:56.431040 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0313 08:52:56.431004 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:56.431129 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } W0313 08:52:56.431253 20507 api.go:53] PageSize not implemented I0313 08:52:56.431226 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:56.431303 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0313 08:52:56.434851 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0313 08:52:56.435176 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:52:56.435262 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:52:56.435337 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:56.435773 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:56.438924 20507 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0313 08:52:56.439158 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0313 08:52:56.439108 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:56.439195 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0313 08:52:56.439293 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:52:56.439252 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:56.439344 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0313 08:52:56.439378 20507 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0313 08:52:56.439401 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:56.439556 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0313 08:52:56.439565 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:56.439652 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:52:56.439698 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0313 08:52:56.439710 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:56.439788 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0313 08:52:56.440047 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:56.440162 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0313 08:52:56.440393 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:56.440479 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:56.440693 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:56.440746 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:56.440907 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:56.441126 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:56.441266 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0313 08:52:56.441522 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:56.441590 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:56.441987 20507 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0313 08:52:56.442162 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:56.442311 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:56.442852 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:56.443038 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:52:56.443184 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:56.443479 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:56.443613 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:56.443728 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:56.443841 20507 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0313 08:52:56.443917 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0313 08:52:56.443919 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0313 08:52:56.443983 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:56.444077 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:56.444129 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:56.444169 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0313 08:52:56.444211 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:52:56.444247 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:52:56.444282 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0313 08:52:56.444379 20507 api.go:53] PageSize not implemented I0313 08:52:56.444431 20507 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0313 08:52:56.444467 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:56.444523 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:56.444544 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:56.444617 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:56.444673 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:56.444695 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:56.444535 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:56.444882 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:52:56.444916 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:56.444952 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:56.444956 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:56.445022 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:52:56.445053 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:56.445082 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:56.450283 20507 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0313 08:52:56.450440 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:56.450629 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:56.450811 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:56.450979 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:56.451974 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:56.452093 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:56.452262 20507 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0313 08:52:56.452494 20507 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0313 08:52:56.452777 20507 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0313 08:52:56.452829 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:56.452866 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:56.452937 20507 dns.go:235] Pre-creating DNS records I0313 08:52:56.458461 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:52:56.460922 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:56.460980 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:57.790601 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:57.969147 20507 iamrole.go:89] ListRoles: { } I0313 08:52:57.971328 20507 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0313 08:52:57.971646 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:57.971855 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:57.971925 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:57.972068 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:52:57.972108 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:52:57.972177 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0313 08:52:57.972377 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:57.972551 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:57.972609 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W0313 08:52:57.972693 20507 api.go:53] PageSize not implemented I0313 08:52:57.972713 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0313 08:52:57.972931 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:57.973227 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0313 08:52:57.973540 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0313 08:52:57.975204 20507 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0313 08:52:57.975345 20507 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0313 08:52:57.975368 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0313 08:52:57.975397 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0313 08:52:57.975512 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:57.975594 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:52:57.975657 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0313 08:52:57.975672 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0313 08:52:57.975643 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:57.975731 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0313 08:52:57.975833 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:52:57.975877 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0313 08:52:57.975792 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0313 08:52:57.975985 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:57.976045 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:57.976198 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:57.976243 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0313 08:52:57.976410 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:57.976468 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:57.976516 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:57.976653 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:57.976748 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:57.976834 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:57.976959 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0313 08:52:57.977108 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:57.977165 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:57.977333 20507 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0313 08:52:57.977424 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:57.977512 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:57.977739 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:57.977863 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:57.978210 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:57.978504 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:57.978733 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:52:57.979055 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:57.979237 20507 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0313 08:52:57.979323 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:57.979348 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:57.979434 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:57.979455 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:57.979493 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:57.979527 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0313 08:52:57.979569 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:52:57.979606 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:52:57.979637 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0313 08:52:57.979729 20507 api.go:53] PageSize not implemented I0313 08:52:57.979793 20507 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0313 08:52:57.979876 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:57.979925 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:52:57.979912 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0313 08:52:57.979954 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0313 08:52:57.979975 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:57.979987 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:52:57.979999 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:57.980096 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:57.980172 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:57.980195 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:57.980304 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:57.980362 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:57.980487 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:57.980517 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:57.985697 20507 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0313 08:52:57.985898 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:57.986068 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:57.986266 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:57.986462 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:57.987977 20507 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0313 08:52:57.988358 20507 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0313 08:52:57.989216 20507 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t3.large] I0313 08:52:57.996613 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:58.001237 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:58.001332 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:58.011204 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:52:58.015358 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:58.015448 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:58.015504 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:59.256937 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:59.430487 20507 iamrole.go:89] ListRoles: { } I0313 08:52:59.432086 20507 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0313 08:52:59.432263 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0313 08:52:59.432504 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0313 08:52:59.432594 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:52:59.432628 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:52:59.432689 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:59.432624 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:52:59.432730 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0313 08:52:59.432890 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:59.433114 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:59.433222 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:59.433328 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } W0313 08:52:59.436432 20507 api.go:53] PageSize not implemented I0313 08:52:59.436742 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0313 08:52:59.436966 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0313 08:52:59.440776 20507 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0313 08:52:59.441078 20507 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0313 08:52:59.441015 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:59.441190 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:59.441299 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:59.441449 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0313 08:52:59.441576 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:59.441681 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0313 08:52:59.441862 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0313 08:52:59.442076 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:52:59.442115 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0313 08:52:59.442182 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:59.442347 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:59.442452 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0313 08:52:59.442606 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:52:59.442606 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:52:59.442692 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0313 08:52:59.442704 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:52:59.442817 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0313 08:52:59.442920 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:52:59.442938 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:52:59.442981 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0313 08:52:59.443184 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0313 08:52:59.443414 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:52:59.443478 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:59.443633 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:52:59.443728 20507 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0313 08:52:59.443933 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:59.444149 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:59.444470 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:59.444703 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:59.444987 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:52:59.445199 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:52:59.445291 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:52:59.445394 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:59.445583 20507 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0313 08:52:59.445710 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:52:59.445717 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:59.445809 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:59.445831 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:59.445882 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:59.445919 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0313 08:52:59.445963 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:52:59.446001 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:52:59.446034 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0313 08:52:59.446129 20507 api.go:53] PageSize not implemented I0313 08:52:59.446179 20507 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0313 08:52:59.446260 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:59.446250 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:59.446306 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:59.446309 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:52:59.446326 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:59.446361 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:52:59.446422 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:52:59.446448 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:59.446475 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:59.446602 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:52:59.446657 20507 loadbalancers.go:35] PageSize not implemented I0313 08:52:59.446681 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:59.446779 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:52:59.446831 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:52:59.452509 20507 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0313 08:52:59.452656 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:59.452843 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:59.452960 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:59.453138 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:59.453713 20507 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0313 08:52:59.454043 20507 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0313 08:52:59.454270 20507 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0313 08:52:59.454328 20507 zones.go:93] ListHostedZonesPages { } I0313 08:52:59.454366 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:52:59.454438 20507 dns.go:235] Pre-creating DNS records I0313 08:52:59.462590 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:52:59.466848 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:59.466943 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:52:59.467002 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:00.704566 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:00.902697 20507 iamrole.go:89] ListRoles: { } I0313 08:53:00.904932 20507 executor.go:111] Tasks: 0 done / 136 total; 52 can run W0313 08:53:00.905199 20507 api.go:53] PageSize not implemented I0313 08:53:00.905289 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:00.905313 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0313 08:53:00.905525 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0313 08:53:00.905687 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0313 08:53:00.905998 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:00.906121 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:53:00.906151 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:53:00.906210 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:00.906334 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0313 08:53:00.906692 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:00.907038 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0313 08:53:00.907594 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:00.907763 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0313 08:53:00.909089 20507 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0313 08:53:00.909200 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0313 08:53:00.909221 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:00.909288 20507 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0313 08:53:00.909282 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:53:00.909333 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:00.909373 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0313 08:53:00.909420 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0313 08:53:00.909459 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:00.909532 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0313 08:53:00.909611 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:53:00.909633 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:53:00.909646 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0313 08:53:00.909682 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:00.909823 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0313 08:53:00.910006 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:53:00.910090 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:00.910307 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0313 08:53:00.910491 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:00.910597 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:00.910783 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0313 08:53:00.910951 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:00.911010 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:00.911104 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:00.911240 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:53:00.911283 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:00.911427 20507 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0313 08:53:00.911717 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:00.912156 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:00.912328 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:00.912562 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:00.912718 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:00.912869 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:53:00.912912 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:00.912996 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:00.913107 20507 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0313 08:53:00.913176 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:00.913209 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:00.913305 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:00.913327 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:00.913377 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:00.913417 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0313 08:53:00.913459 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:53:00.913497 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:53:00.913531 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0313 08:53:00.913630 20507 api.go:53] PageSize not implemented I0313 08:53:00.913683 20507 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0313 08:53:00.913758 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:00.913811 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:53:00.913822 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } I0313 08:53:00.913857 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:00.913926 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" W0313 08:53:00.913890 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:00.913971 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:00.914058 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:00.914118 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:00.914143 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:00.914289 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:53:00.914346 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:00.914489 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:53:00.914540 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:00.919749 20507 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0313 08:53:00.919924 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:00.920100 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:00.920292 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:00.920487 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:00.921367 20507 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0313 08:53:00.921661 20507 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0313 08:53:00.921964 20507 executor.go:111] Tasks: 136 done / 136 total; 0 can run lifecycle_integration_test.go:244: overriding instance group values (nodes) [spec.mixedInstancesPolicy.instances=t2.medium] I0313 08:53:00.924897 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:00.928380 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:00.928468 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:00.928522 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:00.938354 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:53:00.946546 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:00.947252 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:00.947321 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:00.947371 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:02.238496 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:02.427844 20507 iamrole.go:89] ListRoles: { } I0313 08:53:02.429428 20507 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0313 08:53:02.430097 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0313 08:53:02.430198 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:02.430318 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0313 08:53:02.430618 20507 api.go:53] PageSize not implemented I0313 08:53:02.430916 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0313 08:53:02.431067 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:02.431282 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:02.431386 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:53:02.431417 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:53:02.431479 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:02.431963 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0313 08:53:02.432122 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0313 08:53:02.432707 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0313 08:53:02.433092 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:02.434175 20507 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0313 08:53:02.434336 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0313 08:53:02.434315 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0313 08:53:02.434329 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0313 08:53:02.434406 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:53:02.434472 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0313 08:53:02.434540 20507 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0313 08:53:02.435567 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0313 08:53:02.434472 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:02.435672 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:53:02.435731 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0313 08:53:02.435733 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:02.435832 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:02.435925 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:02.436006 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:02.436062 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0313 08:53:02.436190 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:02.436312 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["complex.example.com"] }] } I0313 08:53:02.436424 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:02.436502 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0313 08:53:02.436677 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:02.436774 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] },{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] }] } I0313 08:53:02.436928 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:02.437046 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:53:02.437310 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:53:02.437483 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:53:02.437685 20507 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0313 08:53:02.438345 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:02.438709 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:02.439147 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:02.439687 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:02.439920 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:02.440003 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:02.440107 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:53:02.440210 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:02.440417 20507 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0313 08:53:02.441044 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:02.441058 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:02.441124 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:02.441139 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:02.441172 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:02.441198 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0313 08:53:02.441227 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:53:02.441250 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:53:02.441271 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0313 08:53:02.441338 20507 api.go:53] PageSize not implemented I0313 08:53:02.441370 20507 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0313 08:53:02.441425 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:02.441416 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:02.441480 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:02.441478 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:02.441499 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:53:02.441468 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:53:02.441493 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:02.441593 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:02.441636 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:02.441650 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:02.441723 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:53:02.441745 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:02.441829 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:53:02.441875 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:02.446803 20507 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0313 08:53:02.446925 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:02.447088 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:02.447266 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:02.447431 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:02.448186 20507 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0313 08:53:02.448550 20507 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0313 08:53:02.448876 20507 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0313 08:53:02.448935 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:02.448977 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:02.449049 20507 dns.go:235] Pre-creating DNS records I0313 08:53:02.457654 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* Kops support for this Kubernetes version is deprecated and will be removed in a future release. Upgrading Kubernetes is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.25.0 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.24.17 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.24.17 ********************************************************************************* I0313 08:53:02.461960 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:02.462060 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:02.462116 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:02.462164 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:03.713706 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:03.908210 20507 iamrole.go:89] ListRoles: { } I0313 08:53:03.910690 20507 executor.go:111] Tasks: 0 done / 136 total; 52 can run I0313 08:53:03.911004 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid3"] } I0313 08:53:03.911135 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-events.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.911168 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:03.911273 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["a.etcd-main.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } W0313 08:53:03.911349 20507 api.go:53] PageSize not implemented I0313 08:53:03.911375 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.911469 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.911548 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid4"] } I0313 08:53:03.911707 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:53:03.911752 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:53:03.911829 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid6"] } I0313 08:53:03.911985 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-123456"] } I0313 08:53:03.912078 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-exampleid5"] } I0313 08:53:03.912212 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:03.914707 20507 executor.go:111] Tasks: 52 done / 136 total; 28 can run I0313 08:53:03.914862 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["api-elb.complex.example.com"] } ] } I0313 08:53:03.914986 20507 iamrole.go:161] ListAttachedRolePolicies: masters.complex.example.com I0313 08:53:03.915070 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:03.914902 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tls-complex-example-com-5nursn"] } I0313 08:53:03.915150 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.complex.example.com I0313 08:53:03.915150 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:53:03.915138 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.915260 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } I0313 08:53:03.915398 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:53:03.915478 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["tcp-complex-example-com-vpjolq"] } I0313 08:53:03.915556 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:53:03.915590 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0313 08:53:03.915447 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.complex.example.com"] } ] } I0313 08:53:03.915721 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:53:03.915804 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:03.915906 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:03.915997 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-utility.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.916133 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:53:03.916209 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.complex.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.complex.example.com"] } ] } I0313 08:53:03.916450 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:03.916527 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:03.916662 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.916796 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.916926 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.917053 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:03.917275 20507 executor.go:111] Tasks: 80 done / 136 total; 38 can run I0313 08:53:03.917609 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-east-1a-private.complex.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.917979 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:03.918387 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:03.918504 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:03.918626 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:03.918901 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:03.919074 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:03.919183 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-3"] } I0313 08:53:03.919266 20507 executor.go:111] Tasks: 118 done / 136 total; 2 can run I0313 08:53:03.919351 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:03.919375 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:03.919457 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:03.919478 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:03.919528 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:03.919567 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } I0313 08:53:03.919605 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5"] } I0313 08:53:03.919642 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4"] } I0313 08:53:03.919673 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } W0313 08:53:03.919769 20507 api.go:53] PageSize not implemented I0313 08:53:03.919843 20507 executor.go:111] Tasks: 120 done / 136 total; 4 can run I0313 08:53:03.919932 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:03.919982 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:53:03.920007 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:03.920041 20507 dnsname.go:118] AliasTarget for "api.complex.example.com" is "api-complex-example-com-vd3t5n.amazonaws.com" I0313 08:53:03.919975 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:03.920082 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:03.920133 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:03.920360 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:03.920444 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:03.920474 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:03.920554 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:53:03.920592 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:03.920684 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { } I0313 08:53:03.920730 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:03.926077 20507 executor.go:111] Tasks: 124 done / 136 total; 4 can run I0313 08:53:03.926199 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:03.926379 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:03.926562 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:03.926750 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:03.927387 20507 executor.go:111] Tasks: 128 done / 136 total; 2 can run I0313 08:53:03.927661 20507 executor.go:111] Tasks: 130 done / 136 total; 6 can run I0313 08:53:03.927959 20507 executor.go:111] Tasks: 136 done / 136 total; 0 can run I0313 08:53:03.928172 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0313 08:53:03.928245 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:53:03.928297 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0313 08:53:03.928345 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:53:03.928381 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0313 08:53:03.928430 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0313 08:53:03.928464 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:53:03.928520 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0313 08:53:03.928593 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0313 08:53:03.928651 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0313 08:53:03.928697 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0313 08:53:03.928732 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:53:03.928790 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0313 08:53:03.928833 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0313 08:53:03.928877 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:53:03.928921 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:53:03.928967 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0313 08:53:03.929018 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:53:03.929064 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:53:03.929114 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0313 08:53:03.929155 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-3"] }] } I0313 08:53:03.929209 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0313 08:53:03.929244 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0313 08:53:03.929289 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:53:03.929329 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:53:03.929378 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:53:03.929417 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0313 08:53:03.932244 20507 delete_cluster.go:128] Looking for cloud resources to delete W0313 08:53:03.932319 20507 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0313 08:53:03.932346 20507 keypairs.go:95] DescribeKeyPairs: { } I0313 08:53:03.932396 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.932474 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0313 08:53:03.932569 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.932657 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.932730 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.932801 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.932856 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.932932 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } I0313 08:53:03.933012 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.933110 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["complex.example.com"] }] } I0313 08:53:03.933173 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/complex.example.com"] }] } W0313 08:53:03.933251 20507 api.go:53] PageSize not implemented I0313 08:53:03.933275 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:03.933306 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:03.933332 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1"] } I0313 08:53:03.933383 20507 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0313 08:53:03.933420 20507 targetgroups.go:35] PageSize not implemented I0313 08:53:03.933446 20507 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" ] } I0313 08:53:03.933546 20507 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0313 08:53:03.933594 20507 iamrole.go:89] ListRoles: { } I0313 08:53:03.933657 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:03.933692 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:03.933756 20507 internetgateways.go:101] DescribeInternetGateways: { } I0313 08:53:03.933817 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:53:03.933888 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1","rtb-2"] } I0313 08:53:03.934469 20507 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/api-complex-example-com-vd3t5n/1 ok I0313 08:53:03.934504 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:03.934579 20507 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4" } I0313 08:53:03.934600 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tcp-complex-example-com-vpjolq/4 ok I0313 08:53:03.934623 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } I0313 08:53:03.934680 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.complex.example.com" } autoscaling-group:nodes.complex.example.com ok I0313 08:53:03.934736 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } I0313 08:53:03.934742 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } security-group:sg-2 ok I0313 08:53:03.934798 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.complex.example.com" } iam-instance-profile:masters.complex.example.com ok volume:vol-1 ok I0313 08:53:03.934788 20507 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5" } autoscaling-group:master-us-test-1a.masters.complex.example.com ok I0313 08:53:03.934831 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } autoscaling-config:lt-1 ok I0313 08:53:03.934636 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.complex.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-complex-example-com-vd3t5n.amazonaws.com", EvaluateTargetHealth: false, HostedZoneId: "HZ123456" }, Name: "api.complex.example.com", Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } subnet:subnet-2 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/tls-complex-example-com-5nursn/5 ok autoscaling-config:lt-2 ok iam-instance-profile:nodes.complex.example.com ok route53-record:Z1AFAKE1ZON3YO/AAAA/api.complex.example.com ok I0313 08:53:03.935000 20507 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0313 08:53:03.935096 20507 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0313 08:53:03.935141 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0313 08:53:03.935228 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:53:03.935339 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 4 }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.1.0.0/16" }], ToPort: 443 }, { FromPort: 8443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 8443 }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.2.0.0/16" }], ToPort: 443 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.0.0/16" }], ToPort: 443 }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.0/24" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 443 }, { FromPort: 8443, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-44444444" }], ToPort: 8443 } ] } W0313 08:53:03.935714 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:03.935751 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0313 08:53:03.935807 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-3" } subnet:subnet-3 ok I0313 08:53:03.935890 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:03.935954 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 }, { FromPort: 28000, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.2.3.4/32" }], ToPort: 32767 }, { FromPort: 22, IpProtocol: "tcp", PrefixListIds: [{ PrefixListId: "pl-66666666" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "1.1.1.1/32" }], ToPort: 22 }, { FromPort: 28000, IpProtocol: "udp", IpRanges: [{ CidrIp: "10.20.30.0/24" }], ToPort: 32767 } ] } W0313 08:53:03.936213 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:03.936239 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0313 08:53:03.936341 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0313 08:53:03.936421 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok I0313 08:53:03.936416 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.complex.example.com" } I0313 08:53:03.936506 20507 iamrole.go:180] ListAttachedRolePolicies: masters.complex.example.com I0313 08:53:03.936524 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.complex.example.com", RoleName: "masters.complex.example.com" } I0313 08:53:03.936563 20507 iamrole.go:137] DeleteRole: { RoleName: "masters.complex.example.com" } iam-role:masters.complex.example.com ok I0313 08:53:03.936605 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.complex.example.com" } I0313 08:53:03.936674 20507 iamrole.go:180] ListAttachedRolePolicies: nodes.complex.example.com I0313 08:53:03.936699 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.complex.example.com", RoleName: "nodes.complex.example.com" } I0313 08:53:03.936736 20507 iamrole.go:137] DeleteRole: { RoleName: "nodes.complex.example.com" } iam-role:nodes.complex.example.com ok I0313 08:53:03.936825 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0313 08:53:03.936933 20507 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0313 08:53:03.937040 20507 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleComplex (15.01s) === RUN TestLifecycleExternalLB I0313 08:53:03.937603 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:53:03.937775 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:53:03.937824 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:53:03.937882 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:53:03.937936 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:53:03.938003 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:53:03.938060 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:53:03.938093 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:53:03.938141 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:53:03.938174 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster externallb.example.com I0313 08:53:03.962777 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:53:03.965690 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:03.965771 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:05.204263 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:05.386168 20507 iamrole.go:89] ListRoles: { } I0313 08:53:05.387951 20507 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0313 08:53:05.388183 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } W0313 08:53:05.388320 20507 api.go:53] PageSize not implemented I0313 08:53:05.388390 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0313 08:53:05.388556 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } W0313 08:53:05.388626 20507 api.go:53] PageSize not implemented W0313 08:53:05.388652 20507 api.go:53] PageSize not implemented I0313 08:53:05.388649 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0313 08:53:05.388394 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:53:05.388698 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:05.388658 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } I0313 08:53:05.388806 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:53:05.388807 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0313 08:53:05.388916 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0313 08:53:05.388887 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.externallb.example.com" }] } I0313 08:53:05.388973 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0313 08:53:05.388922 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:05.389059 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0313 08:53:05.389092 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0313 08:53:05.389178 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0313 08:53:05.389194 20507 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0313 08:53:05.389338 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:53:05.389401 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } I0313 08:53:05.389490 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] } I0313 08:53:05.389579 20507 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0313 08:53:05.389796 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:05.389989 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:05.390181 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:53:05.390352 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:53:05.390428 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0313 08:53:05.390466 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0313 08:53:05.390500 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:53:05.390556 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:05.390587 20507 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0313 08:53:05.390691 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:53:05.390968 20507 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0313 08:53:05.391168 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:05.391379 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0313 08:53:05.391431 20507 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0313 08:53:05.391379 20507 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "externallb.example.com" }] }] } I0313 08:53:05.391455 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0313 08:53:05.391479 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0313 08:53:05.391542 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0313 08:53:05.391646 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0313 08:53:05.391631 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:53:05.391728 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:53:05.391793 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:05.391840 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:05.391978 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0313 08:53:05.392085 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:53:05.392108 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0313 08:53:05.392180 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:05.392418 20507 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0313 08:53:05.392485 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0313 08:53:05.392653 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:05.392762 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:05.392910 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:53:05.392980 20507 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" }, { Key: "Name", Value: "externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" } ] } I0313 08:53:05.393002 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "Name", Value: "us-test-1a.externallb.example.com" }, { Key: "KubernetesCluster", Value: "externallb.example.com" }, { Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" } ] }], VpcId: "vpc-1" } I0313 08:53:05.393086 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.externallb.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:53:05.393239 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:53:05.393307 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:05.393087 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/externallb.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/externallb.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"externallb.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0313 08:53:05.393384 20507 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0313 08:53:05.393491 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:53:05.393562 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:53:05.397088 20507 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0313 08:53:05.397309 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:05.397469 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0313 08:53:05.397646 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0313 08:53:05.397711 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0313 08:53:05.397943 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0313 08:53:05.398174 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0313 08:53:05.398400 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:05.398502 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:05.398595 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0313 08:53:05.398747 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-udp-1to65535-masters.externallb.example.com" }] }] } I0313 08:53:05.398899 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.externallb.example.com" }] }] } I0313 08:53:05.399071 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0313 08:53:05.399201 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:05.399277 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" }] }] } I0313 08:53:05.399417 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:05.399501 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:05.399564 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0313 08:53:05.399637 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0313 08:53:05.399687 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-all-0to0-nodes.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0313 08:53:05.399886 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-1to2379-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" }] }] } I0313 08:53:05.400031 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-4003to65535-masters.externallb.example.com" }] }] } I0313 08:53:05.400170 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.externallb.example.com-ingress-tcp-2382to4000-masters.externallb.example.com" },{ Key: "KubernetesCluster", Value: "externallb.example.com" }] }] } I0313 08:53:05.400310 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0313 08:53:05.400368 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "externallb.example.com" },{ Key: "kubernetes.io/cluster/externallb.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.externallb.example.com-egress-all-0to0-::/0" }] }] } I0313 08:53:05.400515 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:05.401277 20507 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0313 08:53:05.401619 20507 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0313 08:53:05.401872 20507 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0313 08:53:05.401946 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:05.401990 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:05.402060 20507 dns.go:235] Pre-creating DNS records I0313 08:53:05.402093 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:05.408194 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:53:05.411472 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:05.411567 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:06.659076 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:06.835450 20507 iamrole.go:89] ListRoles: { } I0313 08:53:06.837202 20507 executor.go:111] Tasks: 0 done / 107 total; 51 can run I0313 08:53:06.837582 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:06.837594 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.837820 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.837910 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0313 08:53:06.838047 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0313 08:53:06.838001 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.externallb.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:53:06.838088 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3" } I0313 08:53:06.838190 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } I0313 08:53:06.838194 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] },{ Name: "tag:Name", Values: ["externallb.example.com"] }] } W0313 08:53:06.838289 20507 api.go:53] PageSize not implemented I0313 08:53:06.838331 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:53:06.838263 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1"] } W0313 08:53:06.838394 20507 api.go:53] PageSize not implemented I0313 08:53:06.838386 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:53:06.838397 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1" } I0313 08:53:06.838477 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } W0313 08:53:06.838961 20507 api.go:53] PageSize not implemented I0313 08:53:06.839628 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.839813 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0313 08:53:06.839931 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2"] } I0313 08:53:06.839974 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2" } I0313 08:53:06.841464 20507 executor.go:111] Tasks: 51 done / 107 total; 23 can run I0313 08:53:06.841705 20507 iamrole.go:161] ListAttachedRolePolicies: masters.externallb.example.com I0313 08:53:06.841625 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "tag:Name", Values: ["masters.externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.externallb.example.com"] } ] } I0313 08:53:06.841866 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.externallb.example.com I0313 08:53:06.841853 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.842110 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:53:06.842180 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:06.842287 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.842453 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:06.842584 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:06.842704 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["externallb.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.842868 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.externallb.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.externallb.example.com"] } ] } I0313 08:53:06.843049 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:06.847150 20507 executor.go:111] Tasks: 74 done / 107 total; 25 can run I0313 08:53:06.847306 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:06.847477 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:06.847595 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:06.847825 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:06.848052 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:06.848203 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:06.848349 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:06.849088 20507 executor.go:111] Tasks: 99 done / 107 total; 2 can run I0313 08:53:06.849407 20507 executor.go:111] Tasks: 101 done / 107 total; 6 can run I0313 08:53:06.849657 20507 executor.go:111] Tasks: 107 done / 107 total; 0 can run I0313 08:53:06.852621 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0313 08:53:06.852690 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:53:06.852731 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0313 08:53:06.852765 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:53:06.852800 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0313 08:53:06.852832 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0313 08:53:06.852870 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:53:06.852907 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0313 08:53:06.852942 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0313 08:53:06.852986 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0313 08:53:06.853025 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0313 08:53:06.853055 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0313 08:53:06.853084 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:53:06.853117 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0313 08:53:06.853149 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:53:06.853181 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:53:06.853217 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:53:06.853251 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:53:06.853286 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0313 08:53:06.853318 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0313 08:53:06.853350 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:53:06.853388 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:53:06.853426 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:53:06.853461 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0313 08:53:06.854756 20507 delete_cluster.go:128] Looking for cloud resources to delete W0313 08:53:06.854828 20507 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0313 08:53:06.854852 20507 keypairs.go:95] DescribeKeyPairs: { } I0313 08:53:06.854898 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.854951 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0313 08:53:06.855014 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.855075 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.855125 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.855184 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.855233 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.855302 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } I0313 08:53:06.855354 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.855443 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["externallb.example.com"] }] } I0313 08:53:06.855504 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/externallb.example.com"] }] } W0313 08:53:06.855562 20507 api.go:53] PageSize not implemented I0313 08:53:06.855585 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:06.855613 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:06.855632 20507 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0313 08:53:06.855658 20507 targetgroups.go:35] PageSize not implemented I0313 08:53:06.855676 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0313 08:53:06.855727 20507 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0313 08:53:06.855773 20507 iamrole.go:89] ListRoles: { } I0313 08:53:06.855820 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:06.855852 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:06.855896 20507 internetgateways.go:101] DescribeInternetGateways: { } I0313 08:53:06.855941 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:53:06.855976 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:06.856408 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0313 08:53:06.856472 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.externallb.example.com" } iam-instance-profile:nodes.externallb.example.com ok I0313 08:53:06.856461 20507 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } autoscaling-group:master-us-test-1a.masters.externallb.example.com ok I0313 08:53:06.856556 20507 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } autoscaling-group:nodes.externallb.example.com ok I0313 08:53:06.856600 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0313 08:53:06.856574 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } autoscaling-config:lt-1 ok I0313 08:53:06.856683 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.externallb.example.com" } iam-instance-profile:masters.externallb.example.com ok internet-gateway:igw-2 ok I0313 08:53:06.856675 20507 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok I0313 08:53:06.856650 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.externallb.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.externallb.example.com. ok I0313 08:53:06.856798 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:06.856902 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0313 08:53:06.857037 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:06.857056 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0313 08:53:06.857092 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:06.857147 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] } ] } W0313 08:53:06.857343 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:06.857365 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok autoscaling-config:lt-2 ok I0313 08:53:06.857426 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0313 08:53:06.857529 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.externallb.example.com" } I0313 08:53:06.857578 20507 iamrole.go:180] ListAttachedRolePolicies: nodes.externallb.example.com I0313 08:53:06.857594 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.externallb.example.com", RoleName: "nodes.externallb.example.com" } I0313 08:53:06.857585 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0313 08:53:06.857632 20507 iamrole.go:137] DeleteRole: { RoleName: "nodes.externallb.example.com" } iam-role:nodes.externallb.example.com ok I0313 08:53:06.857697 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.externallb.example.com" } I0313 08:53:06.857757 20507 iamrole.go:180] ListAttachedRolePolicies: masters.externallb.example.com I0313 08:53:06.857773 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.externallb.example.com", RoleName: "masters.externallb.example.com" } I0313 08:53:06.857805 20507 iamrole.go:137] DeleteRole: { RoleName: "masters.externallb.example.com" } iam-role:masters.externallb.example.com ok I0313 08:53:06.857880 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0313 08:53:06.857962 20507 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0313 08:53:06.858038 20507 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleExternalLB (2.92s) === RUN TestLifecycleSharedSubnet I0313 08:53:06.858526 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:53:06.858685 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:53:06.858726 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:53:06.858769 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:53:06.858808 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:53:06.858856 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:53:06.858898 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:53:06.858929 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:53:06.858967 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:53:06.858995 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster sharedsubnet.example.com I0313 08:53:06.883481 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:53:06.886693 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:06.886778 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:08.172630 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:08.346431 20507 iamrole.go:89] ListRoles: { } I0313 08:53:08.347751 20507 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0313 08:53:08.348011 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0313 08:53:08.348012 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:08.348191 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:53:08.348390 20507 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0313 08:53:08.348551 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.sharedsubnet.example.com" }, { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:53:08.348741 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:53:08.348803 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:53:08.348875 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0313 08:53:08.348903 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0313 08:53:08.349038 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } I0313 08:53:08.349179 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] } I0313 08:53:08.349983 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0313 08:53:08.350181 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0313 08:53:08.350268 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] } I0313 08:53:08.350201 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.sharedsubnet.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:53:08.350360 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:53:08.351844 20507 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0313 08:53:08.352120 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0313 08:53:08.352114 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0313 08:53:08.352181 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0313 08:53:08.352257 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0313 08:53:08.352336 20507 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0313 08:53:08.352258 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0313 08:53:08.352450 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:53:08.352555 20507 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [ { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "shared" } ] } I0313 08:53:08.352733 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0313 08:53:08.352712 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0313 08:53:08.352989 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:53:08.353114 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0313 08:53:08.353215 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:53:08.353272 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:08.353325 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.sharedsubnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0313 08:53:08.353481 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:53:08.353577 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:08.355561 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/sharedsubnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/sharedsubnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"sharedsubnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0313 08:53:08.359262 20507 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0313 08:53:08.359599 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-4003to65535-masters.sharedsubnet.example.com" }] }] } I0313 08:53:08.359864 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.sharedsubnet.example.com" }] }] } I0313 08:53:08.360015 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0313 08:53:08.360244 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-1to2379-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0313 08:53:08.360502 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:08.360675 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:08.360825 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-udp-1to65535-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0313 08:53:08.361055 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0313 08:53:08.361295 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0313 08:53:08.361488 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-::/0" }] }] } I0313 08:53:08.361623 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0313 08:53:08.361763 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.sharedsubnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" }] }] } I0313 08:53:08.361919 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-tcp-2382to4000-masters.sharedsubnet.example.com" }] }] } I0313 08:53:08.362073 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0313 08:53:08.362215 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0313 08:53:08.362347 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.sharedsubnet.example.com-ingress-all-0to0-nodes.sharedsubnet.example.com" },{ Key: "KubernetesCluster", Value: "sharedsubnet.example.com" },{ Key: "kubernetes.io/cluster/sharedsubnet.example.com", Value: "owned" }] }] } I0313 08:53:08.362480 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:08.362577 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:08.363271 20507 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0313 08:53:08.363589 20507 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0313 08:53:08.363900 20507 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0313 08:53:08.363955 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:08.363997 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:08.364073 20507 dns.go:235] Pre-creating DNS records I0313 08:53:08.364105 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:08.369870 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:53:08.373505 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:08.373593 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:09.669076 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:09.844129 20507 iamrole.go:89] ListRoles: { } I0313 08:53:09.845545 20507 executor.go:111] Tasks: 0 done / 94 total; 44 can run I0313 08:53:09.845801 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0313 08:53:09.846038 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.sharedsubnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0313 08:53:09.846239 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.sharedsubnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:53:09.846899 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:53:09.847013 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0313 08:53:09.847049 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0313 08:53:09.847729 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:09.849431 20507 executor.go:111] Tasks: 44 done / 94 total; 20 can run I0313 08:53:09.849578 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.sharedsubnet.example.com"] } ] } I0313 08:53:09.849768 20507 iamrole.go:161] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0313 08:53:09.849727 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:53:09.849812 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0313 08:53:09.849915 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:09.849996 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.sharedsubnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.sharedsubnet.example.com"] } ] } I0313 08:53:09.850174 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:09.850234 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0313 08:53:09.853095 20507 executor.go:111] Tasks: 64 done / 94 total; 22 can run I0313 08:53:09.853380 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:09.853555 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:09.853756 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:09.853942 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:09.854431 20507 executor.go:111] Tasks: 86 done / 94 total; 2 can run I0313 08:53:09.854692 20507 executor.go:111] Tasks: 88 done / 94 total; 6 can run I0313 08:53:09.854931 20507 executor.go:111] Tasks: 94 done / 94 total; 0 can run I0313 08:53:09.856578 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0313 08:53:09.856619 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0313 08:53:09.856642 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:53:09.856662 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0313 08:53:09.856681 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0313 08:53:09.856701 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0313 08:53:09.856724 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0313 08:53:09.856751 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0313 08:53:09.856774 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0313 08:53:09.856792 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0313 08:53:09.856812 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0313 08:53:09.856832 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:53:09.856853 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:53:09.856875 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:53:09.856896 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0313 08:53:09.856917 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0313 08:53:09.856936 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:53:09.856958 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:53:09.856980 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0313 08:53:09.857823 20507 delete_cluster.go:128] Looking for cloud resources to delete W0313 08:53:09.857867 20507 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0313 08:53:09.857881 20507 keypairs.go:95] DescribeKeyPairs: { } I0313 08:53:09.857909 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0313 08:53:09.857939 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0313 08:53:09.857975 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0313 08:53:09.858016 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0313 08:53:09.858042 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0313 08:53:09.858067 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0313 08:53:09.858096 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0313 08:53:09.858117 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } I0313 08:53:09.858143 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0313 08:53:09.858173 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["sharedsubnet.example.com"] }] } I0313 08:53:09.858195 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/sharedsubnet.example.com"] }] } W0313 08:53:09.858227 20507 api.go:53] PageSize not implemented I0313 08:53:09.858245 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:09.858262 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:09.858276 20507 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0313 08:53:09.858291 20507 targetgroups.go:35] PageSize not implemented I0313 08:53:09.858305 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0313 08:53:09.858337 20507 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0313 08:53:09.858364 20507 iamrole.go:89] ListRoles: { } I0313 08:53:09.858393 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:09.858414 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:09.858445 20507 internetgateways.go:101] DescribeInternetGateways: { } I0313 08:53:09.858473 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:53:09.858719 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0313 08:53:09.858760 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.sharedsubnet.example.com" } I0313 08:53:09.858792 20507 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-group:nodes.sharedsubnet.example.com ok iam-instance-profile:nodes.sharedsubnet.example.com ok I0313 08:53:09.858857 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0313 08:53:09.858853 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:09.858887 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.sharedsubnet.example.com" } iam-instance-profile:masters.sharedsubnet.example.com ok autoscaling-group:master-us-test-1a.masters.sharedsubnet.example.com ok I0313 08:53:09.858840 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.sharedsubnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.sharedsubnet.example.com. ok I0313 08:53:09.858904 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 } ] } W0313 08:53:09.859120 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:09.859149 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0313 08:53:09.859206 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0313 08:53:09.859269 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:09.859324 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0313 08:53:09.859437 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:09.859454 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0313 08:53:09.859496 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok autoscaling-config:lt-2 ok autoscaling-config:lt-1 ok I0313 08:53:09.859605 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.sharedsubnet.example.com" } I0313 08:53:09.859654 20507 iamrole.go:180] ListAttachedRolePolicies: masters.sharedsubnet.example.com I0313 08:53:09.859671 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.sharedsubnet.example.com", RoleName: "masters.sharedsubnet.example.com" } I0313 08:53:09.859706 20507 iamrole.go:137] DeleteRole: { RoleName: "masters.sharedsubnet.example.com" } iam-role:masters.sharedsubnet.example.com ok I0313 08:53:09.859740 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.sharedsubnet.example.com" } I0313 08:53:09.859781 20507 iamrole.go:180] ListAttachedRolePolicies: nodes.sharedsubnet.example.com I0313 08:53:09.859794 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.sharedsubnet.example.com", RoleName: "nodes.sharedsubnet.example.com" } I0313 08:53:09.859822 20507 iamrole.go:137] DeleteRole: { RoleName: "nodes.sharedsubnet.example.com" } iam-role:nodes.sharedsubnet.example.com ok --- PASS: TestLifecycleSharedSubnet (3.00s) === RUN TestLifecyclePrivateSharedSubnet I0313 08:53:09.860277 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:53:09.860411 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:53:09.860450 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:53:09.860491 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:53:09.860531 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:53:09.860581 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:53:09.860624 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:53:09.860658 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:53:09.860700 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:53:09.860730 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-subnet.example.com I0313 08:53:09.888751 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:53:09.892319 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:09.892408 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:09.892470 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:11.150524 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:11.328226 20507 iamrole.go:89] ListRoles: { } I0313 08:53:11.329831 20507 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0313 08:53:11.330055 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0313 08:53:11.330125 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } I0313 08:53:11.330215 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "bastions.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] } I0313 08:53:11.330231 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:53:11.330355 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:53:11.330383 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I0313 08:53:11.330411 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0313 08:53:11.330443 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0313 08:53:11.330501 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } I0313 08:53:11.330551 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0313 08:53:11.330550 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-subnet.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }, { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:53:11.330654 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:53:11.330814 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:11.330976 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:53:11.331126 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0313 08:53:11.331172 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0313 08:53:11.331374 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:53:11.331582 20507 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.333468 20507 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0313 08:53:11.333643 20507 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0313 08:53:11.333677 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0313 08:53:11.333858 20507 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0313 08:53:11.333936 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0313 08:53:11.333921 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0313 08:53:11.333941 20507 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-su-5ol32q", Port: 22, Protocol: "TCP", Tags: [{ Key: "Name", Value: "bastion-private-shared-su-5ol32q" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0313 08:53:11.334090 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0313 08:53:11.334170 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0313 08:53:11.334150 20507 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0313 08:53:11.334078 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0313 08:53:11.334256 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0313 08:53:11.334322 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0313 08:53:11.334375 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0313 08:53:11.334580 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0313 08:53:11.334664 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0313 08:53:11.334788 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:53:11.334854 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:11.334904 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0313 08:53:11.335120 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0313 08:53:11.335172 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:53:11.335304 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0313 08:53:11.335419 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0313 08:53:11.335511 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0313 08:53:11.335586 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0313 08:53:11.335669 20507 tags.go:42] CreateTags { Resources: ["subnet-abcdef"], Tags: [{ Key: "SubnetType", Value: "Utility" },{ Key: "kubernetes.io/role/elb", Value: "1" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" }] } I0313 08:53:11.335744 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-subnet.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0313 08:53:11.335834 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0313 08:53:11.335885 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0313 08:53:11.335935 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:53:11.336032 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:11.336121 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:53:11.336208 20507 tags.go:42] CreateTags { Resources: ["subnet-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "shared" },{ Key: "SubnetType", Value: "Private" },{ Key: "kubernetes.io/role/internal-elb", Value: "1" }] } I0313 08:53:11.336299 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0313 08:53:11.336360 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:53:11.336103 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-subnet.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-subnet.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-subnet.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0313 08:53:11.336508 20507 executor.go:111] Tasks: 72 done / 123 total; 31 can run I0313 08:53:11.336716 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } W0313 08:53:11.336855 20507 api.go:53] PageSize not implemented I0313 08:53:11.336941 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:11.337033 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:11.336935 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-2382to4000-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.337007 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:11.337099 20507 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"], Tags: [{ Key: "Name", Value: "api.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] } I0313 08:53:11.337174 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:11.337158 20507 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-su-5ol32q", SubnetMappings: [{ SubnetId: "subnet-abcdef" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }], Type: "network" } I0313 08:53:11.337218 20507 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0313 08:53:11.337174 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0313 08:53:11.337288 20507 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0313 08:53:11.337430 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-udp-1to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.337672 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-1to2379-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.337900 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0313 08:53:11.338053 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0313 08:53:11.338199 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.338371 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:11.338515 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.338792 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-tcp-4003to65535-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0313 08:53:11.339039 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0313 08:53:11.339175 20507 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1", Port: 22, Protocol: "TCP" } I0313 08:53:11.339120 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } W0313 08:53:11.339345 20507 api.go:53] PageSize not implemented I0313 08:53:11.339383 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:11.339373 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.339583 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" }] }] } I0313 08:53:11.339744 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.339903 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:11.340048 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.340214 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" }] }] } I0313 08:53:11.340375 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0313 08:53:11.340492 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.340640 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-ingress-all-0to0-nodes.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.340795 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0313 08:53:11.340914 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-subnet.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.341076 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-subnet.example.com-ingress-tcp-22to22-masters.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.341238 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-subnet.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" }] }] } I0313 08:53:11.341396 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-subnet.example.com" },{ Key: "kubernetes.io/cluster/private-shared-subnet.example.com", Value: "owned" },{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-subnet.example.com" }] }] } I0313 08:53:11.341593 20507 executor.go:111] Tasks: 103 done / 123 total; 5 can run I0313 08:53:11.341719 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:11.341802 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0313 08:53:11.341854 20507 api.go:53] PageSize not implemented I0313 08:53:11.341935 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:11.341883 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } W0313 08:53:11.342112 20507 api.go:53] PageSize not implemented I0313 08:53:11.342060 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:11.342165 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:11.347423 20507 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0313 08:53:11.347614 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:11.347727 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:11.347920 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:11.348061 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:11.348834 20507 executor.go:111] Tasks: 115 done / 123 total; 2 can run I0313 08:53:11.349100 20507 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0313 08:53:11.349399 20507 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0313 08:53:11.349451 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:11.349494 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:11.349565 20507 dns.go:235] Pre-creating DNS records I0313 08:53:11.349596 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:11.355934 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:53:11.361811 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:11.362082 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:11.362286 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:12.616280 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:12.798177 20507 iamrole.go:89] ListRoles: { } I0313 08:53:12.799552 20507 executor.go:111] Tasks: 0 done / 123 total; 46 can run I0313 08:53:12.800024 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:53:12.800175 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0313 08:53:12.800211 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0313 08:53:12.800543 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0313 08:53:12.800731 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-subnet.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:53:12.800952 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:12.802524 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-subnet.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0313 08:53:12.805079 20507 executor.go:111] Tasks: 46 done / 123 total; 26 can run I0313 08:53:12.805317 20507 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com I0313 08:53:12.805995 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-abcdef"] } I0313 08:53:12.806170 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0313 08:53:12.806139 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-subnet.example.com"] } ] } I0313 08:53:12.806224 20507 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0313 08:53:12.806233 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-su-5ol32q"] } I0313 08:53:12.806278 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:12.806300 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0313 08:53:12.806331 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } I0313 08:53:12.806316 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-12345678"] } I0313 08:53:12.806454 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-subnet.example.com"] } ] } I0313 08:53:12.806592 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:12.806630 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:53:12.806699 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-subnet.example.com"] } ] } I0313 08:53:12.806789 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0313 08:53:12.806826 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-subnet.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-subnet.example.com"] } ] } I0313 08:53:12.806912 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:53:12.807917 20507 executor.go:111] Tasks: 72 done / 123 total; 31 can run W0313 08:53:12.808102 20507 api.go:53] PageSize not implemented I0313 08:53:12.808150 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:12.808270 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:12.808308 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0313 08:53:12.808142 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:12.808395 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0313 08:53:12.808439 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:12.808395 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:12.808457 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } I0313 08:53:12.808514 20507 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } I0313 08:53:12.808564 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4"] } I0313 08:53:12.808590 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:12.808627 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } W0313 08:53:12.808719 20507 api.go:53] PageSize not implemented I0313 08:53:12.808741 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:12.808927 20507 executor.go:111] Tasks: 103 done / 123 total; 5 can run W0313 08:53:12.809050 20507 api.go:53] PageSize not implemented I0313 08:53:12.809037 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0313 08:53:12.809088 20507 api.go:53] PageSize not implemented I0313 08:53:12.809112 20507 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0313 08:53:12.809142 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:12.809155 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:12.809178 20507 dnsname.go:118] AliasTarget for "api.private-shared-subnet.example.com" is "api-private-shared-subnet-n2f8ak.elb.cloudmock.com" I0313 08:53:12.809293 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:12.809466 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:12.809574 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:12.815396 20507 executor.go:111] Tasks: 108 done / 123 total; 7 can run I0313 08:53:12.815507 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:12.815658 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:12.815809 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:12.815953 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:12.816732 20507 executor.go:111] Tasks: 115 done / 123 total; 2 can run W0313 08:53:12.816818 20507 api.go:53] PageSize not implemented I0313 08:53:12.816838 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:12.817031 20507 executor.go:111] Tasks: 117 done / 123 total; 6 can run I0313 08:53:12.817249 20507 executor.go:111] Tasks: 123 done / 123 total; 0 can run I0313 08:53:12.820553 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0313 08:53:12.820620 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0313 08:53:12.820657 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:53:12.820692 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0313 08:53:12.820726 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0313 08:53:12.820764 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0313 08:53:12.820800 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0313 08:53:12.820838 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0313 08:53:12.820881 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0313 08:53:12.820921 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0313 08:53:12.820955 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0313 08:53:12.820984 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0313 08:53:12.821013 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:53:12.821046 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:53:12.821081 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0313 08:53:12.821115 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0313 08:53:12.821150 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:53:12.821185 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0313 08:53:12.821220 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0313 08:53:12.821253 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:53:12.821288 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:53:12.821323 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0313 08:53:12.822873 20507 delete_cluster.go:128] Looking for cloud resources to delete W0313 08:53:12.822946 20507 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0313 08:53:12.822969 20507 keypairs.go:95] DescribeKeyPairs: { } I0313 08:53:12.823015 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0313 08:53:12.823074 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0313 08:53:12.823142 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0313 08:53:12.823207 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0313 08:53:12.823251 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0313 08:53:12.823292 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0313 08:53:12.823336 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0313 08:53:12.823374 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } I0313 08:53:12.823414 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0313 08:53:12.823462 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-subnet.example.com"] }] } I0313 08:53:12.823497 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-subnet.example.com"] }] } W0313 08:53:12.823546 20507 api.go:53] PageSize not implemented I0313 08:53:12.823564 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-subnet-n2f8ak"] } I0313 08:53:12.823608 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:12.823637 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:12.823653 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1"] } I0313 08:53:12.823693 20507 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0313 08:53:12.823719 20507 targetgroups.go:35] PageSize not implemented I0313 08:53:12.823736 20507 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" ] } I0313 08:53:12.823796 20507 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0313 08:53:12.823843 20507 iamrole.go:89] ListRoles: { } I0313 08:53:12.823891 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:12.823923 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:12.823970 20507 internetgateways.go:101] DescribeInternetGateways: { } I0313 08:53:12.824015 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:53:12.824516 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0313 08:53:12.824586 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-subnet.example.com" } iam-instance-profile:nodes.private-shared-subnet.example.com ok I0313 08:53:12.824555 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0313 08:53:12.824639 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0313 08:53:12.824625 20507 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-subnet-n2f8ak" } autoscaling-group:nodes.private-shared-subnet.example.com ok I0313 08:53:12.824687 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-subnet.example.com" } I0313 08:53:12.824654 20507 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-2 ok autoscaling-group:master-us-test-1a.masters.private-shared-subnet.example.com ok I0313 08:53:12.824745 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:12.824793 20507 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-su-5ol32q/1 ok load-balancer:api-private-shared-subnet-n2f8ak ok I0313 08:53:12.824798 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0313 08:53:12.824920 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:12.824938 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0313 08:53:12.824980 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:12.825041 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0313 08:53:12.824951 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-subnet-n2f8ak.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-subnet.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-subnet.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } autoscaling-group:bastion.private-shared-subnet.example.com ok I0313 08:53:12.825114 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.private-shared-subnet.example.com. ok I0313 08:53:12.825218 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-subnet.example.com" } iam-instance-profile:bastions.private-shared-subnet.example.com ok I0313 08:53:12.825140 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 } ] } iam-instance-profile:masters.private-shared-subnet.example.com ok I0313 08:53:12.825276 20507 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4" } target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-su-5ol32q/4 ok W0313 08:53:12.825336 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:12.825378 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0313 08:53:12.825420 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-4" }] } ] } W0313 08:53:12.825615 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:12.825638 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0313 08:53:12.825671 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok autoscaling-config:lt-3 ok autoscaling-config:lt-1 ok I0313 08:53:12.825783 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:53:12.825838 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-subnet.example.com" } I0313 08:53:12.825837 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 },{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }] } I0313 08:53:12.825934 20507 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-subnet.example.com W0313 08:53:12.825935 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:12.825970 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0313 08:53:12.825964 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-subnet.example.com", RoleName: "bastions.private-shared-subnet.example.com" } I0313 08:53:12.826021 20507 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-subnet.example.com" } iam-role:bastions.private-shared-subnet.example.com ok I0313 08:53:12.826061 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-subnet.example.com" } I0313 08:53:12.826118 20507 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-subnet.example.com I0313 08:53:12.826135 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-subnet.example.com", RoleName: "masters.private-shared-subnet.example.com" } I0313 08:53:12.826177 20507 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-subnet.example.com" } iam-role:masters.private-shared-subnet.example.com ok I0313 08:53:12.826212 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-subnet.example.com" } I0313 08:53:12.826256 20507 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-subnet.example.com I0313 08:53:12.826274 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-subnet.example.com", RoleName: "nodes.private-shared-subnet.example.com" } I0313 08:53:12.826303 20507 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-subnet.example.com" } iam-role:nodes.private-shared-subnet.example.com ok --- PASS: TestLifecyclePrivateSharedSubnet (2.97s) === RUN TestLifecyclePrivateSharedIP I0313 08:53:12.826739 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:53:12.826878 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:53:12.826918 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:53:12.826960 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:53:12.826998 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:53:12.827048 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:53:12.827092 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:53:12.827124 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:53:12.827165 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:53:12.827195 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster private-shared-ip.example.com I0313 08:53:12.854220 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:53:12.857758 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:12.857845 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:12.857904 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:14.154831 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:14.309143 20507 iamrole.go:89] ListRoles: { } I0313 08:53:14.311324 20507 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0313 08:53:14.311942 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } I0313 08:53:14.312083 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "bastions.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0313 08:53:14.312055 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] }] } I0313 08:53:14.312293 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:53:14.312358 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } I0313 08:53:14.312457 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:53:14.312473 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0313 08:53:14.312520 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:53:14.312681 20507 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0313 08:53:14.313027 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } I0313 08:53:14.313129 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] } I0313 08:53:14.313263 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:14.313462 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:53:14.313606 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:53:14.314069 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:53:14.314165 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0313 08:53:14.314203 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0313 08:53:14.314297 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:14.315921 20507 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0313 08:53:14.316059 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:14.316153 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0313 08:53:14.316197 20507 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0313 08:53:14.316189 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0313 08:53:14.316320 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0313 08:53:14.316270 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.4.0/22", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Utility" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "Name", Value: "utility-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I0313 08:53:14.316437 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0313 08:53:14.316482 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:53:14.316554 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:53:14.316488 20507 targetgroups.go:94] CreateTargetGroup { HealthCheckIntervalSeconds: 10, HealthyThresholdCount: 2, Name: "bastion-private-shared-ip-eepmph", Port: 22, Protocol: "TCP", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "bastion-private-shared-ip-eepmph" }], UnhealthyThresholdCount: 2, VpcId: "vpc-12345678" } I0313 08:53:14.316624 20507 targetgroups.go:149] ModifyTargetGroupAttributes { Attributes: [{ Key: "deregistration_delay.connection_termination.enabled", Value: "true" },{ Key: "deregistration_delay.timeout_seconds", Value: "30" }], TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0313 08:53:14.316558 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeRegions\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0313 08:53:14.316638 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:14.316781 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0313 08:53:14.316802 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0313 08:53:14.316893 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0313 08:53:14.316936 20507 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0313 08:53:14.316973 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:DescribeRegions\",\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0313 08:53:14.316951 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-12345678" } I0313 08:53:14.316962 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:53:14.317133 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0313 08:53:14.317369 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "masters.private-shared-ip.example.com" }] }], VpcId: "vpc-12345678" } I0313 08:53:14.317478 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0313 08:53:14.317600 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:14.317698 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:14.317791 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0313 08:53:14.317899 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for bastion", GroupName: "bastion.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0313 08:53:14.317893 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Private" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" } ] }], VpcId: "vpc-12345678" } I0313 08:53:14.317997 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:53:14.318053 20507 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0313 08:53:14.318135 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for api ELB", GroupName: "api-elb.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "api-elb.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0313 08:53:14.318245 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0313 08:53:14.318308 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:53:14.318355 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["private-us-test-1a"] }] } I0313 08:53:14.318489 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" }, { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" } ] }], VpcId: "vpc-12345678" } I0313 08:53:14.318280 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/private-shared-ip.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/private-shared-ip.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcs\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"private-shared-ip.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0313 08:53:14.318537 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.private-shared-ip.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }], VpcId: "vpc-12345678" } I0313 08:53:14.318684 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0313 08:53:14.318746 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0313 08:53:14.318792 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:53:14.318850 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:14.318911 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0313 08:53:14.318963 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:53:14.319002 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:53:14.319050 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0313 08:53:14.319099 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:14.319185 20507 tags.go:42] CreateTags { Resources: ["rtb-2"], Tags: [ { Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }, { Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "private-us-test-1a" }, { Key: "Name", Value: "private-us-test-1a.private-shared-ip.example.com" } ] } I0313 08:53:14.319329 20507 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0313 08:53:14.319539 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" }] }] } W0313 08:53:14.319688 20507 api.go:53] PageSize not implemented I0313 08:53:14.319814 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:14.319913 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:14.319800 20507 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0313 08:53:14.319824 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:14.320015 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:53:14.320103 20507 tags.go:74] AddTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "api.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] } I0313 08:53:14.320082 20507 loadbalancers.go:81] CreateLoadBalancer v2 { IpAddressType: "ipv4", Name: "bastion-private-shared-ip-eepmph", SubnetMappings: [{ SubnetId: "subnet-1" }], Tags: [{ Key: "Name", Value: "bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }], Type: "network" } I0313 08:53:14.320205 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:14.320225 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:53:14.320252 20507 healthcheck.go:31] ConfigureHealthCheck: { HealthCheck: { HealthyThreshold: 2, Interval: 10, Target: "SSL:443", Timeout: 5, UnhealthyThreshold: 2 }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } I0313 08:53:14.320321 20507 listeners.go:56] CreateListener v2 { DefaultActions: [{ TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4", Type: "forward" }], LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1", Port: 22, Protocol: "TCP" } I0313 08:53:14.320315 20507 attributes.go:31] ModifyLoadBalancerAttributes: { LoadBalancerAttributes: { AccessLog: { Enabled: false }, ConnectionDraining: { Enabled: true, Timeout: 300 }, ConnectionSettings: { IdleTimeout: 300 }, CrossZoneLoadBalancing: { Enabled: false } }, LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } W0313 08:53:14.320442 20507 api.go:53] PageSize not implemented I0313 08:53:14.320396 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:14.320479 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:14.320601 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0313 08:53:14.320695 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:14.320777 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-1to2379-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0313 08:53:14.320933 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-api-elb.private-shared-ip.example.com" }] }] } I0313 08:53:14.321179 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0313 08:53:14.321328 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-nodes.private-shared-ip.example.com" }] }] } I0313 08:53:14.321465 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-::/0" }] }] } I0313 08:53:14.321678 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-udp-1to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0313 08:53:14.321865 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0313 08:53:14.322056 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:14.322170 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:14.322297 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:53:14.322388 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0313 08:53:14.322456 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }] } I0313 08:53:14.322572 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-egress-all-0to0-::/0" }] }] } I0313 08:53:14.322706 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0313 08:53:14.322835 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0313 08:53:14.322969 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0313 08:53:14.323104 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:14.323207 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-4003to65535-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0313 08:53:14.323353 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0313 08:53:14.323400 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-172.20.4.0/22-ingress-tcp-22to22-bastion.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0313 08:53:14.323550 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0313 08:53:14.323644 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0313 08:53:14.323774 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.private-shared-ip.example.com-ingress-all-0to0-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0313 08:53:14.323902 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0313 08:53:14.324023 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.private-shared-ip.example.com-ingress-tcp-2382to4000-masters.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0313 08:53:14.324173 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } I0313 08:53:14.324261 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] }] } I0313 08:53:14.324351 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-3", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-api-elb.private-shared-ip.example.com-egress-all-0to0-0.0.0.0/0" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0313 08:53:14.324470 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-1", RouteTableId: "rtb-1" } I0313 08:53:14.324510 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" },{ Key: "Name", Value: "from-bastion.private-shared-ip.example.com-ingress-tcp-22to22-nodes.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" }] }] } I0313 08:53:14.324650 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-2"] }] } I0313 08:53:14.324691 20507 tags.go:42] CreateTags { Resources: ["eipalloc-12345678"], Tags: [{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "shared" }] } I0313 08:53:14.324739 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:14.324793 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-2", SubnetId: "subnet-2" } I0313 08:53:14.324920 20507 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0313 08:53:14.324994 20507 api.go:53] PageSize not implemented I0313 08:53:14.325036 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:14.325077 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:14.325077 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:14.325150 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } W0313 08:53:14.325219 20507 api.go:53] PageSize not implemented I0313 08:53:14.325203 20507 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedNatgateway"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:53:14.325300 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:14.325265 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:14.325449 20507 natgateway.go:74] CreateNatGateway: { AllocationId: "eipalloc-12345678", SubnetId: "subnet-1", TagSpecifications: [{ ResourceType: "natgateway", Tags: [{ Key: "Name", Value: "us-test-1a.private-shared-ip.example.com" },{ Key: "KubernetesCluster", Value: "private-shared-ip.example.com" },{ Key: "kubernetes.io/cluster/private-shared-ip.example.com", Value: "owned" }] }] } I0313 08:53:14.325483 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "UPSERT", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }] }, HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:14.325609 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0313 08:53:14.325680 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:53:14.325734 20507 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedNatgateway", Value: "nat-1" }] } I0313 08:53:14.330635 20507 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0313 08:53:14.330859 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:14.331089 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", NatGatewayId: "nat-1", RouteTableId: "rtb-2" } I0313 08:53:14.331259 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:14.331403 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:14.331622 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:14.331778 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:14.332490 20507 executor.go:111] Tasks: 124 done / 132 total; 2 can run I0313 08:53:14.332826 20507 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0313 08:53:14.333178 20507 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0313 08:53:14.333228 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:14.333263 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:14.333328 20507 dns.go:235] Pre-creating DNS records I0313 08:53:14.333354 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:14.338833 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:53:14.341169 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:14.341230 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:14.341273 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:15.585343 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:15.757938 20507 iamrole.go:89] ListRoles: { } I0313 08:53:15.760049 20507 executor.go:111] Tasks: 0 done / 132 total; 46 can run I0313 08:53:15.760790 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:15.761224 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-12345678"] } I0313 08:53:15.761335 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-12345678" } I0313 08:53:15.761373 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-12345678" } I0313 08:53:15.761495 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.private-shared-ip.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:53:15.761659 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.761800 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.763555 20507 executor.go:111] Tasks: 46 done / 132 total; 28 can run I0313 08:53:15.763817 20507 iamrole.go:161] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0313 08:53:15.763820 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["bastion.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["bastion.private-shared-ip.example.com"] } ] } I0313 08:53:15.764089 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0313 08:53:15.764079 20507 targetgroups.go:32] DescribeTargetGroups { Names: ["bastion-private-shared-ip-eepmph"] } I0313 08:53:15.764044 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] },{ Name: "tag:Name", Values: ["private-us-test-1a.private-shared-ip.example.com"] }] } I0313 08:53:15.764214 20507 iamrole.go:161] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0313 08:53:15.764216 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0313 08:53:15.764276 20507 targetgroups.go:139] DescribeTargetGroupAttributes { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } I0313 08:53:15.764321 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["masters.private-shared-ip.example.com"] } ] } I0313 08:53:15.764616 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:15.764699 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:15.764803 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["utility-us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.764986 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:53:15.765039 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-12345678"] }] } I0313 08:53:15.765152 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["api-elb.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["api-elb.private-shared-ip.example.com"] } ] } I0313 08:53:15.765341 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:53:15.765400 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.765534 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-2"] } I0313 08:53:15.765593 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.private-shared-ip.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }, { Name: "vpc-id", Values: ["vpc-12345678"] }, { Name: "group-name", Values: ["nodes.private-shared-ip.example.com"] } ] } I0313 08:53:15.765805 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0313 08:53:15.765892 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["private-shared-ip.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.766144 20507 executor.go:111] Tasks: 74 done / 132 total; 36 can run I0313 08:53:15.766333 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:15.766450 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } W0313 08:53:15.766556 20507 api.go:53] PageSize not implemented I0313 08:53:15.766534 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:15.766627 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:15.766551 20507 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0313 08:53:15.766591 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:15.766650 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0313 08:53:15.766688 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:15.766695 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0313 08:53:15.766699 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:53:15.766732 20507 listeners.go:32] DescribeListeners v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0313 08:53:15.766877 20507 targetgroups.go:32] DescribeTargetGroups { TargetGroupArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4"] } I0313 08:53:15.766946 20507 loadbalancers.go:156] DescribeLoadBalancerAttributes v2 { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } I0313 08:53:15.766928 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:15.766734 20507 attributes.go:52] DescribeLoadBalancerAttributes: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } W0313 08:53:15.767133 20507 api.go:53] PageSize not implemented I0313 08:53:15.767165 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:15.767370 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:15.767738 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:15.767924 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:15.768107 20507 executor.go:111] Tasks: 110 done / 132 total; 6 can run W0313 08:53:15.768206 20507 api.go:53] PageSize not implemented I0313 08:53:15.768233 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:15.768251 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:15.768294 20507 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0313 08:53:15.768312 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:15.768395 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "Z1AFAKE1ZON3YO" } I0313 08:53:15.768467 20507 dnsname.go:118] AliasTarget for "api.private-shared-ip.example.com" is "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com" I0313 08:53:15.768414 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0313 08:53:15.768322 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } W0313 08:53:15.768611 20507 api.go:53] PageSize not implemented I0313 08:53:15.768661 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:15.768724 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:15.774188 20507 executor.go:111] Tasks: 116 done / 132 total; 8 can run I0313 08:53:15.774381 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:15.774535 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:15.774628 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:15.774812 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:15.775036 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2"] } I0313 08:53:15.775476 20507 executor.go:111] Tasks: 124 done / 132 total; 2 can run W0313 08:53:15.775599 20507 api.go:53] PageSize not implemented I0313 08:53:15.775631 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:15.775875 20507 executor.go:111] Tasks: 126 done / 132 total; 6 can run I0313 08:53:15.776116 20507 executor.go:111] Tasks: 132 done / 132 total; 0 can run I0313 08:53:15.779400 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0313 08:53:15.779472 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0313 08:53:15.779540 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:53:15.779608 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0313 08:53:15.779671 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0313 08:53:15.779735 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0313 08:53:15.779804 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0313 08:53:15.779871 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0313 08:53:15.779944 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-3"] }] } I0313 08:53:15.780005 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-1"] }] } I0313 08:53:15.780071 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0313 08:53:15.780126 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0313 08:53:15.780189 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:53:15.780250 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0313 08:53:15.780307 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-2"] }] } I0313 08:53:15.780368 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:53:15.780430 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:53:15.780489 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-3"] }] } I0313 08:53:15.780551 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-4"] }] } I0313 08:53:15.780615 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:53:15.780682 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:53:15.780735 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-2"] }] } I0313 08:53:15.780803 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0313 08:53:15.780854 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0313 08:53:15.780915 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:53:15.780982 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:53:15.781047 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0313 08:53:15.782580 20507 delete_cluster.go:128] Looking for cloud resources to delete W0313 08:53:15.782676 20507 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0313 08:53:15.782711 20507 keypairs.go:95] DescribeKeyPairs: { } I0313 08:53:15.782779 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.782860 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0313 08:53:15.782961 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.783056 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.783115 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.783184 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.783250 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.783318 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } I0313 08:53:15.783407 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.783482 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:53:15.783535 20507 natgateway.go:117] DescribeNatGateways: { } I0313 08:53:15.783610 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["private-shared-ip.example.com"] }] } I0313 08:53:15.783662 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/private-shared-ip.example.com"] }] } W0313 08:53:15.783741 20507 api.go:53] PageSize not implemented I0313 08:53:15.783770 20507 tags.go:31] DescribeTags { LoadBalancerNames: ["api-private-shared-ip-exa-ohatqj"] } I0313 08:53:15.783842 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:15.783881 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:15.783910 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1"] } I0313 08:53:15.783978 20507 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0313 08:53:15.784019 20507 targetgroups.go:35] PageSize not implemented I0313 08:53:15.784048 20507 tags.go:64] DescribeTags v2 { ResourceArns: [ "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3", "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" ] } I0313 08:53:15.784125 20507 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0313 08:53:15.784191 20507 iamrole.go:89] ListRoles: { } I0313 08:53:15.784257 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:15.784302 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:15.784386 20507 internetgateways.go:101] DescribeInternetGateways: { } I0313 08:53:15.784455 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:53:15.784511 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-2","rtb-1"] } I0313 08:53:15.784569 20507 natgateway.go:117] DescribeNatGateways: { NatGatewayIds: ["nat-1"] } I0313 08:53:15.784629 20507 address.go:120] DescribeAddresses: { AllocationIds: ["eipalloc-12345678"] } I0313 08:53:15.785283 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0313 08:53:15.785322 20507 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } I0313 08:53:15.785358 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "bastions.private-shared-ip.example.com" } autoscaling-group:master-us-test-1a.masters.private-shared-ip.example.com ok autoscaling-group:bastion.private-shared-ip.example.com ok I0313 08:53:15.785414 20507 natgateway.go:186] DeleteNatGateway: { NatGatewayId: "nat-1" } iam-instance-profile:bastions.private-shared-ip.example.com ok I0313 08:53:15.785474 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0313 08:53:15.785450 20507 targetgroups.go:128] DeleteTargetGroup { TargetGroupArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4" } autoscaling-config:lt-2 ok I0313 08:53:15.785473 20507 api.go:149] DeleteLoadBalancer: { LoadBalancerName: "api-private-shared-ip-exa-ohatqj" } keypair:key-1 ok load-balancer:api-private-shared-ip-exa-ohatqj ok I0313 08:53:15.785546 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } nat-gateway:nat-1 ok I0313 08:53:15.785750 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0313 08:53:15.785827 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.private-shared-ip.example.com" } iam-instance-profile:masters.private-shared-ip.example.com ok I0313 08:53:15.785611 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [ { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-4" }] }, { FromPort: 443, IpProtocol: "tcp", ToPort: 443, UserIdGroupPairs: [{ GroupId: "sg-3" }] } ] } I0313 08:53:15.785846 20507 loadbalancers.go:208] DeleteLoadBalancer { LoadBalancerArn: "arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1" } load-balancer:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:loadbalancer/net/bastion-private-shared-ip-eepmph/1 ok W0313 08:53:15.785883 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:15.785623 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [ { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "AAAA" } }, { Action: "DELETE", ResourceRecordSet: { AliasTarget: { DNSName: "api-private-shared-ip-exa-ohatqj.elb.cloudmock.com", EvaluateTargetHealth: false, HostedZoneId: "FAKEZONE-CLOUDMOCK-ELB" }, Name: "api.private-shared-ip.example.com", Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }, { Action: "DELETE", ResourceRecordSet: { Name: "api.internal.private-shared-ip.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } } ] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/AAAA/api.private-shared-ip.example.com ok I0313 08:53:15.785926 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } autoscaling-config:lt-3 ok target-group:arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/bastion-private-shared-ip-eepmph/4 ok autoscaling-group:nodes.private-shared-ip.example.com ok I0313 08:53:15.785984 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0313 08:53:15.786050 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } security-group:sg-1 ok autoscaling-config:lt-1 ok I0313 08:53:15.786039 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0313 08:53:15.786135 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.private-shared-ip.example.com" } iam-instance-profile:nodes.private-shared-ip.example.com ok I0313 08:53:15.786116 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 4 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "172.20.4.0/22" }], ToPort: 22 }, { FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 } ] } W0313 08:53:15.786280 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:15.786306 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0313 08:53:15.786345 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-4"] } I0313 08:53:15.786395 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-4", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-4" }] },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] },{ FromPort: 22, IpProtocol: "tcp", ToPort: 22, UserIdGroupPairs: [{ GroupId: "sg-2" }] }] } W0313 08:53:15.786520 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:15.786534 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-4" } security-group:sg-4 ok I0313 08:53:15.786626 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0313 08:53:15.786642 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "bastions.private-shared-ip.example.com" } I0313 08:53:15.786693 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-3"] } I0313 08:53:15.786727 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.private-shared-ip.example.com" } I0313 08:53:15.786807 20507 iamrole.go:180] ListAttachedRolePolicies: masters.private-shared-ip.example.com I0313 08:53:15.786740 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-3", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 },{ FromPort: 3, IpProtocol: "icmp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 4 }] } W0313 08:53:15.786839 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:15.786834 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.private-shared-ip.example.com", RoleName: "masters.private-shared-ip.example.com" } I0313 08:53:15.786890 20507 iamrole.go:137] DeleteRole: { RoleName: "masters.private-shared-ip.example.com" } iam-role:masters.private-shared-ip.example.com ok I0313 08:53:15.786855 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-3" } security-group:sg-3 ok I0313 08:53:15.786945 20507 iamrole.go:180] ListAttachedRolePolicies: bastions.private-shared-ip.example.com I0313 08:53:15.786986 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "bastions.private-shared-ip.example.com", RoleName: "bastions.private-shared-ip.example.com" } I0313 08:53:15.787040 20507 iamrole.go:137] DeleteRole: { RoleName: "bastions.private-shared-ip.example.com" } iam-role:bastions.private-shared-ip.example.com ok I0313 08:53:15.786988 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-2" } I0313 08:53:15.787085 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.private-shared-ip.example.com" } subnet:subnet-2 ok I0313 08:53:15.787141 20507 iamrole.go:180] ListAttachedRolePolicies: nodes.private-shared-ip.example.com I0313 08:53:15.787159 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.private-shared-ip.example.com", RoleName: "nodes.private-shared-ip.example.com" } I0313 08:53:15.787189 20507 iamrole.go:137] DeleteRole: { RoleName: "nodes.private-shared-ip.example.com" } iam-role:nodes.private-shared-ip.example.com ok I0313 08:53:15.787273 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0313 08:53:15.787341 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-2" } route-table:rtb-2 ok --- PASS: TestLifecyclePrivateSharedIP (2.96s) === RUN TestLifecycleManyAddons I0313 08:53:15.787817 20507 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:53:15.787954 20507 internetgateways.go:66] CreateInternetGateway: { } I0313 08:53:15.787993 20507 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:53:15.788037 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:53:15.788078 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:53:15.788130 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:53:15.788173 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:53:15.788206 20507 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:53:15.788248 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:53:15.788278 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } lifecycle_integration_test.go:187: running lifecycle test for cluster minimal.example.com I0313 08:53:15.814420 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:53:15.817925 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:15.818006 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:17.082977 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:17.904422 20507 iamrole.go:89] ListRoles: { } I0313 08:53:17.906147 20507 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0313 08:53:17.906833 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:17.906940 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } I0313 08:53:17.907115 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0313 08:53:17.907093 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-main.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "k8s.io/etcd/main", Value: "us-test-1a/us-test-1a" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:53:17.907350 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:53:17.907382 20507 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } I0313 08:53:17.907437 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:53:17.907503 20507 iaminstanceprofile.go:100] CreateInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", Tags: [{ Key: "Name", Value: "nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] } I0313 08:53:17.907622 20507 keypairs.go:50] ImportKeyPair: { KeyName: "kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57", PublicKeyMaterial: len 212, TagSpecifications: [{ ResourceType: "key-pair", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:53:17.907798 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:17.907896 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:17.907968 20507 dhcpoptions.go:125] CreateDhcpOptions: { DhcpConfigurations: [{ Key: "domain-name-servers", Values: ["AmazonProvidedDNS"] },{ Key: "domain-name", Values: ["us-test-1.compute.internal"] }], TagSpecifications: [{ ResourceType: "dhcp-options", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:53:17.908084 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:53:17.908134 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:17.908266 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:17.908460 20507 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "minimal.example.com" }] }] } I0313 08:53:17.908457 20507 volumes.go:33] CreateVolume: { AvailabilityZone: "us-test-1a", Encrypted: false, Iops: 3000, Size: 20, TagSpecifications: [{ ResourceType: "volume", Tags: [ { Key: "k8s.io/etcd/events", Value: "us-test-1a/us-test-1a" }, { Key: "k8s.io/role/control-plane", Value: "1" }, { Key: "k8s.io/role/master", Value: "1" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "Name", Value: "us-test-1a.etcd-events.minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" } ] }], Throughput: 125, VolumeType: "gp3" } I0313 08:53:17.908664 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:53:17.908736 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsSupport: { Value: true }, VpcId: "vpc-1" } I0313 08:53:17.908772 20507 vpcs.go:190] ModifyVpcAttribute: { EnableDnsHostnames: { Value: true }, VpcId: "vpc-1" } I0313 08:53:17.908800 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:53:17.908841 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:17.910738 20507 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0313 08:53:17.910885 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0313 08:53:17.910962 20507 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0313 08:53:17.911033 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:17.911191 20507 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0313 08:53:17.911267 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:17.911300 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0313 08:53:17.911453 20507 dhcpoptions.go:91] AssociateDhcpOptions: { DhcpOptionsId: "dopt-1", VpcId: "vpc-1" } I0313 08:53:17.911498 20507 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0313 08:53:17.911507 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0313 08:53:17.911643 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"autoscaling:DescribeAutoScalingInstances\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeTags\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:GenerateRandom\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0313 08:53:17.911697 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for nodes", GroupName: "nodes.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "nodes.minimal.example.com" }] }], VpcId: "vpc-1" } I0313 08:53:17.911801 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:53:17.911873 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:17.911950 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:17.912209 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:17.912236 20507 subnets.go:110] CreateSubnet: { AvailabilityZone: "us-test-1a", CidrBlock: "172.20.32.0/19", TagSpecifications: [{ ResourceType: "subnet", Tags: [ { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "SubnetType", Value: "Public" }, { Key: "kubernetes.io/role/elb", Value: "1" }, { Key: "kubernetes.io/role/internal-elb", Value: "1" }, { Key: "Name", Value: "us-test-1a.minimal.example.com" } ] }], VpcId: "vpc-1" } I0313 08:53:17.912330 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] },{ Name: "tag:kubernetes.io/kops/role", Values: ["public"] }] } I0313 08:53:17.912392 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0313 08:53:17.912482 20507 routetable.go:106] CreateRouteTable: { TagSpecifications: [{ ResourceType: "route-table", Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] }], VpcId: "vpc-1" } I0313 08:53:17.912572 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:53:17.912620 20507 securitygroups.go:40] CreateSecurityGroup: { Description: "Security group for masters", GroupName: "masters.minimal.example.com", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }], VpcId: "vpc-1" } I0313 08:53:17.912724 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:53:17.912786 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:17.912850 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:53:17.912902 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:53:17.912953 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:17.913185 20507 internetgateways.go:66] CreateInternetGateway: { TagSpecifications: [{ ResourceType: "internet-gateway", Tags: [{ Key: "Name", Value: "minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:53:17.913283 20507 tags.go:42] CreateTags { Resources: ["rtb-1"], Tags: [ { Key: "Name", Value: "minimal.example.com" }, { Key: "KubernetesCluster", Value: "minimal.example.com" }, { Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }, { Key: "kubernetes.io/kops/role", Value: "public" } ] } I0313 08:53:17.913371 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:53:17.913534 20507 iamrolepolicy.go:71] PutRolePolicy: { PolicyDocument: "{\n \"Statement\": [\n {\n \"Action\": \"ec2:AttachVolume\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\",\n \"aws:ResourceTag/k8s.io/role/master\": \"1\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": [\n \"s3:Get*\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-read-bucket/clusters.example.com/minimal.example.com/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/main/*\"\n },\n {\n \"Action\": [\n \"s3:GetObject\",\n \"s3:DeleteObject\",\n \"s3:DeleteObjectVersion\",\n \"s3:PutObject\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:s3:::placeholder-write-bucket/clusters.example.com/minimal.example.com/backups/etcd/events/*\"\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-read-bucket\"\n ]\n },\n {\n \"Action\": [\n \"s3:GetBucketLocation\",\n \"s3:GetEncryptionConfiguration\",\n \"s3:ListBucket\",\n \"s3:ListBucketVersions\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:s3:::placeholder-write-bucket\"\n ]\n },\n {\n \"Action\": [\n \"route53:ChangeResourceRecordSets\",\n \"route53:ListResourceRecordSets\",\n \"route53:GetHostedZone\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::hostedzone/Z1AFAKE1ZON3YO\"\n ]\n },\n {\n \"Action\": [\n \"route53:GetChange\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:route53:::change/*\"\n ]\n },\n {\n \"Action\": [\n \"route53:ListHostedZones\",\n \"route53:ListTagsForResource\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateVolume\",\n \"CreateSnapshot\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:volume/*\",\n \"arn:aws-test:ec2:*:*:snapshot/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": \"ec2:CreateTags\",\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\",\n \"ec2:CreateAction\": [\n \"CreateSecurityGroup\"\n ]\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\",\n \"ec2:DeleteTags\"\n ],\n \"Condition\": {\n \"Null\": {\n \"aws:RequestTag/KubernetesCluster\": \"true\"\n },\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:security-group/*\"\n ]\n },\n {\n \"Action\": [\n \"ec2:CreateTags\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": [\n \"arn:aws-test:ec2:*:*:network-interface/*\"\n ]\n },\n {\n \"Action\": [\n \"acm:DescribeCertificate\",\n \"acm:ListCertificates\",\n \"autoscaling:DescribeAutoScalingGroups\",\n \"autoscaling:DescribeAutoScalingInstances\",\n \"autoscaling:DescribeLaunchConfigurations\",\n \"autoscaling:DescribeScalingActivities\",\n \"autoscaling:DescribeTags\",\n \"cognito-idp:DescribeUserPoolClient\",\n \"ec2:AssignPrivateIpAddresses\",\n \"ec2:AttachNetworkInterface\",\n \"ec2:CreateNetworkInterface\",\n \"ec2:CreateSnapshot\",\n \"ec2:DeleteNetworkInterface\",\n \"ec2:DescribeAccountAttributes\",\n \"ec2:DescribeAvailabilityZones\",\n \"ec2:DescribeInstanceTypes\",\n \"ec2:DescribeInstances\",\n \"ec2:DescribeInternetGateways\",\n \"ec2:DescribeLaunchTemplateVersions\",\n \"ec2:DescribeNetworkInterfaces\",\n \"ec2:DescribeRegions\",\n \"ec2:DescribeRouteTables\",\n \"ec2:DescribeSecurityGroups\",\n \"ec2:DescribeSnapshots\",\n \"ec2:DescribeSubnets\",\n \"ec2:DescribeTags\",\n \"ec2:DescribeVolumes\",\n \"ec2:DescribeVolumesModifications\",\n \"ec2:DescribeVpcPeeringConnections\",\n \"ec2:DescribeVpcs\",\n \"ec2:DetachNetworkInterface\",\n \"ec2:ModifyNetworkInterfaceAttribute\",\n \"ec2:UnassignPrivateIpAddresses\",\n \"elasticloadbalancing:DescribeListenerCertificates\",\n \"elasticloadbalancing:DescribeListeners\",\n \"elasticloadbalancing:DescribeLoadBalancerAttributes\",\n \"elasticloadbalancing:DescribeLoadBalancerPolicies\",\n \"elasticloadbalancing:DescribeLoadBalancers\",\n \"elasticloadbalancing:DescribeRules\",\n \"elasticloadbalancing:DescribeTags\",\n \"elasticloadbalancing:DescribeTargetGroupAttributes\",\n \"elasticloadbalancing:DescribeTargetGroups\",\n \"elasticloadbalancing:DescribeTargetHealth\",\n \"iam:GetServerCertificate\",\n \"iam:ListServerCertificates\",\n \"kms:DescribeKey\",\n \"kms:GenerateRandom\",\n \"sqs:DeleteMessage\",\n \"sqs:ReceiveMessage\"\n ],\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"autoscaling:CompleteLifecycleAction\",\n \"autoscaling:SetDesiredCapacity\",\n \"autoscaling:TerminateInstanceInAutoScalingGroup\",\n \"ec2:AttachVolume\",\n \"ec2:AuthorizeSecurityGroupIngress\",\n \"ec2:DeleteSecurityGroup\",\n \"ec2:DeleteSnapshot\",\n \"ec2:DeleteVolume\",\n \"ec2:DetachVolume\",\n \"ec2:ModifyInstanceAttribute\",\n \"ec2:ModifyVolume\",\n \"ec2:RevokeSecurityGroupIngress\",\n \"elasticloadbalancing:AddListenerCertificates\",\n \"elasticloadbalancing:AddTags\",\n \"elasticloadbalancing:ApplySecurityGroupsToLoadBalancer\",\n \"elasticloadbalancing:AttachLoadBalancerToSubnets\",\n \"elasticloadbalancing:ConfigureHealthCheck\",\n \"elasticloadbalancing:CreateLoadBalancerListeners\",\n \"elasticloadbalancing:CreateLoadBalancerPolicy\",\n \"elasticloadbalancing:DeleteListener\",\n \"elasticloadbalancing:DeleteLoadBalancer\",\n \"elasticloadbalancing:DeleteLoadBalancerListeners\",\n \"elasticloadbalancing:DeleteRule\",\n \"elasticloadbalancing:DeleteTargetGroup\",\n \"elasticloadbalancing:DeregisterInstancesFromLoadBalancer\",\n \"elasticloadbalancing:DeregisterTargets\",\n \"elasticloadbalancing:DetachLoadBalancerFromSubnets\",\n \"elasticloadbalancing:ModifyListener\",\n \"elasticloadbalancing:ModifyLoadBalancerAttributes\",\n \"elasticloadbalancing:ModifyRule\",\n \"elasticloadbalancing:ModifyTargetGroup\",\n \"elasticloadbalancing:ModifyTargetGroupAttributes\",\n \"elasticloadbalancing:RegisterInstancesWithLoadBalancer\",\n \"elasticloadbalancing:RegisterTargets\",\n \"elasticloadbalancing:RemoveListenerCertificates\",\n \"elasticloadbalancing:RemoveTags\",\n \"elasticloadbalancing:SetIpAddressType\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesForBackendServer\",\n \"elasticloadbalancing:SetLoadBalancerPoliciesOfListener\",\n \"elasticloadbalancing:SetSecurityGroups\",\n \"elasticloadbalancing:SetSubnets\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:ResourceTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": [\n \"ec2:CreateSecurityGroup\",\n \"ec2:CreateSnapshot\",\n \"ec2:CreateVolume\",\n \"elasticloadbalancing:CreateListener\",\n \"elasticloadbalancing:CreateLoadBalancer\",\n \"elasticloadbalancing:CreateRule\",\n \"elasticloadbalancing:CreateTargetGroup\"\n ],\n \"Condition\": {\n \"StringEquals\": {\n \"aws:RequestTag/KubernetesCluster\": \"minimal.example.com\"\n }\n },\n \"Effect\": \"Allow\",\n \"Resource\": \"*\"\n },\n {\n \"Action\": \"ec2:CreateSecurityGroup\",\n \"Effect\": \"Allow\",\n \"Resource\": \"arn:aws-test:ec2:*:*:vpc/*\"\n }\n ],\n \"Version\": \"2012-10-17\"\n}", PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0313 08:53:17.917780 20507 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0313 08:53:17.918063 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:53:17.918405 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-masters.minimal.example.com" }] }] } I0313 08:53:17.918626 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:17.918739 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:17.918877 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-udp-1to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:53:17.919197 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-1to2379-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:53:17.919388 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:17.919520 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:17.919649 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:17.919796 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" }] }] } I0313 08:53:17.920018 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "association.subnet-id", Values: ["subnet-1"] }] } I0313 08:53:17.920066 20507 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-1", SubnetId: "subnet-1" } I0313 08:53:17.920112 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-443to443-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0313 08:53:17.920257 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0313 08:53:17.920394 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-0.0.0.0/0-ingress-tcp-22to22-nodes.minimal.example.com" }] }] } I0313 08:53:17.920534 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", Ipv6Ranges: [{ CidrIpv6: "::/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-::/0" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:53:17.920667 20507 securitygroups.go:246] AuthorizeSecurityGroupEgress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", IpRanges: [{ CidrIp: "0.0.0.0/0" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-egress-all-0to0-0.0.0.0/0" }] }] } I0313 08:53:17.920794 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-masters.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" }] }] } I0313 08:53:17.920931 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:17.921045 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:17.921134 20507 routetable.go:149] CreateRoute: { DestinationIpv6CidrBlock: "::/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0313 08:53:17.921229 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-nodes.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0313 08:53:17.921397 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-all-0to0-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" },{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" }] }] } I0313 08:53:17.921532 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-2382to4000-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0313 08:53:17.921680 20507 securitygroups.go:357] AuthorizeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [{ FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }], TagSpecifications: [{ ResourceType: "security-group-rule", Tags: [{ Key: "kubernetes.io/cluster/minimal.example.com", Value: "owned" },{ Key: "Name", Value: "from-nodes.minimal.example.com-ingress-tcp-4003to65535-masters.minimal.example.com" },{ Key: "KubernetesCluster", Value: "minimal.example.com" }] }] } I0313 08:53:17.921819 20507 routetable.go:149] CreateRoute: { DestinationCidrBlock: "0.0.0.0/0", GatewayId: "igw-2", RouteTableId: "rtb-1" } I0313 08:53:17.921981 20507 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0313 08:53:17.922301 20507 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0313 08:53:17.922618 20507 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0313 08:53:17.922680 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:17.922721 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:17.922790 20507 dns.go:235] Pre-creating DNS records I0313 08:53:17.922822 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "CREATE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "CREATE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:17.931965 20507 zones.go:93] ListHostedZonesPages { } ********************************************************************************* A new kops version is available: 1.26.5 Upgrading is recommended More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_kops.md#1.26.5 ********************************************************************************* ********************************************************************************* A new kubernetes version is available: 1.26.8 Upgrading is recommended (try kops upgrade cluster) More information: https://github.com/kubernetes/kops/blob/master/permalinks/upgrade_k8s.md#1.26.8 ********************************************************************************* I0313 08:53:17.936582 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:17.936683 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:19.254724 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:20.053460 20507 iamrole.go:89] ListRoles: { } I0313 08:53:20.054638 20507 executor.go:111] Tasks: 0 done / 108 total; 51 can run I0313 08:53:20.054891 20507 keypairs.go:95] DescribeKeyPairs: { KeyNames: ["kubernetes.minimal.example.com-c4:a6:ed:9a:a8:89:b9:e2:c3:9c:d6:63:eb:9c:71:57"] } I0313 08:53:20.055310 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.055564 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:53:20.055632 20507 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:53:20.055731 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:20.055908 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-main.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.056183 20507 zones.go:40] GetHostedZone { Id: "Z1AFAKE1ZON3YO" } I0313 08:53:20.056364 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:Name", Values: ["us-test-1a.etcd-events.minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.056847 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.058480 20507 executor.go:111] Tasks: 51 done / 108 total; 23 can run I0313 08:53:20.058665 20507 iamrole.go:161] ListAttachedRolePolicies: masters.minimal.example.com I0313 08:53:20.058639 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:20.058763 20507 iamrole.go:161] ListAttachedRolePolicies: nodes.minimal.example.com I0313 08:53:20.058739 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.058851 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:Name", Values: ["masters.minimal.example.com"] }, { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["masters.minimal.example.com"] } ] } I0313 08:53:20.058994 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } I0313 08:53:20.059064 20507 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:53:20.059145 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:Name", Values: ["minimal.example.com"] },{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.059254 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [ { Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }, { Name: "tag:Name", Values: ["nodes.minimal.example.com"] }, { Name: "vpc-id", Values: ["vpc-1"] }, { Name: "group-name", Values: ["nodes.minimal.example.com"] } ] } I0313 08:53:20.059367 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:20.059428 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] },{ Name: "tag:Name", Values: ["us-test-1a.minimal.example.com"] }] } I0313 08:53:20.059599 20507 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:53:20.062303 20507 executor.go:111] Tasks: 74 done / 108 total; 26 can run I0313 08:53:20.062476 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:20.062575 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:20.062725 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:20.063006 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:20.063208 20507 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: ["images/hvm-ssd/ubuntu-focal-20.04-amd64-server-20220404"] }], Owners: ["099720109477"] } I0313 08:53:20.063362 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:20.063514 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:20.064051 20507 executor.go:111] Tasks: 100 done / 108 total; 2 can run I0313 08:53:20.064347 20507 executor.go:111] Tasks: 102 done / 108 total; 6 can run I0313 08:53:20.064598 20507 executor.go:111] Tasks: 108 done / 108 total; 0 can run I0313 08:53:20.067630 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["ami-12345678"] }] } I0313 08:53:20.067697 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["dopt-1"] }] } I0313 08:53:20.067737 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eigw-1"] }] } I0313 08:53:20.067773 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-12345678"] }] } I0313 08:53:20.067807 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-b2345678"] }] } I0313 08:53:20.067843 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-1"] }] } I0313 08:53:20.067875 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["igw-2"] }] } I0313 08:53:20.067909 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["key-1"] }] } I0313 08:53:20.067942 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-1"] }] } I0313 08:53:20.067980 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["lt-2"] }] } I0313 08:53:20.068019 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-a2345678"] }] } I0313 08:53:20.068052 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["nat-b2345678"] }] } I0313 08:53:20.068081 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-1"] }] } I0313 08:53:20.068116 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["rtb-12345678"] }] } I0313 08:53:20.068145 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:53:20.068179 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-2"] }] } I0313 08:53:20.068214 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:53:20.068248 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-12345678"] }] } I0313 08:53:20.068280 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-abcdef"] }] } I0313 08:53:20.068311 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-b2345678"] }] } I0313 08:53:20.068342 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-1"] }] } I0313 08:53:20.068378 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vol-2"] }] } I0313 08:53:20.068417 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:53:20.068453 20507 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-12345678"] }] } I0313 08:53:20.070128 20507 delete_cluster.go:128] Looking for cloud resources to delete W0313 08:53:20.070200 20507 instances.go:27] MockEc2::DescribeInstances is stub-implemented I0313 08:53:20.070223 20507 keypairs.go:95] DescribeKeyPairs: { } I0313 08:53:20.070271 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.070326 20507 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0313 08:53:20.070389 20507 volumes.go:128] DescribeVolumes: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.070454 20507 dhcpoptions.go:33] DescribeDhcpOptions: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.070506 20507 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.070565 20507 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.070611 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.070650 20507 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } I0313 08:53:20.070698 20507 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.070749 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["minimal.example.com"] }] } I0313 08:53:20.070790 20507 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/minimal.example.com"] }] } W0313 08:53:20.070837 20507 tags.go:48] unknown cluster tag on vpc:vpc-12345678: "kubernetes.io/cluster/minimal.example.com"="" W0313 08:53:20.070874 20507 api.go:53] PageSize not implemented I0313 08:53:20.070898 20507 loadbalancers.go:32] DescribeLoadBalancers v2 { PageSize: 20 } W0313 08:53:20.070926 20507 loadbalancers.go:35] PageSize not implemented I0313 08:53:20.070952 20507 targetgroups.go:32] DescribeTargetGroups { PageSize: 20 } W0313 08:53:20.070979 20507 targetgroups.go:35] PageSize not implemented I0313 08:53:20.070999 20507 tags.go:64] DescribeTags v2 { ResourceArns: ["arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-1/1","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-2/2","arn:aws-test:elasticloadbalancing:us-test-1:000000000000:targetgroup/my-external-tg-3/3"] } I0313 08:53:20.071052 20507 iaminstanceprofile.go:193] ListInstanceProfiles: { } I0313 08:53:20.071098 20507 iamrole.go:89] ListRoles: { } I0313 08:53:20.071143 20507 zones.go:93] ListHostedZonesPages { } I0313 08:53:20.071174 20507 records.go:48] ListResourceRecordSetsPages { HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } I0313 08:53:20.071221 20507 internetgateways.go:101] DescribeInternetGateways: { } I0313 08:53:20.071270 20507 routetable.go:53] DescribeRouteTables: { } I0313 08:53:20.071307 20507 routetable.go:53] DescribeRouteTables: { RouteTableIds: ["rtb-1"] } I0313 08:53:20.071747 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-2"] } autoscaling-group:master-us-test-1a.masters.minimal.example.com ok I0313 08:53:20.071837 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0313 08:53:20.071945 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "nodes.minimal.example.com" } iam-instance-profile:nodes.minimal.example.com ok I0313 08:53:20.072001 20507 iaminstanceprofile.go:156] RemoveRoleFromInstanceProfile: { InstanceProfileName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0313 08:53:20.071821 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-2", IpPermissions: [ { FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 }, { FromPort: 1, IpProtocol: "udp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 1, IpProtocol: "tcp", ToPort: 2379, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 443, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 443 }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] }, { IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 2382, IpProtocol: "tcp", ToPort: 4000, UserIdGroupPairs: [{ GroupId: "sg-1" }] }, { FromPort: 4003, IpProtocol: "tcp", ToPort: 65535, UserIdGroupPairs: [{ GroupId: "sg-1" }] } ] } I0313 08:53:20.072051 20507 iaminstanceprofile.go:241] DeleteInstanceProfile: { InstanceProfileName: "masters.minimal.example.com" } iam-instance-profile:masters.minimal.example.com ok W0313 08:53:20.072078 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions autoscaling-group:nodes.minimal.example.com ok I0313 08:53:20.072099 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-2" } security-group:sg-2 ok I0313 08:53:20.072141 20507 securitygroups.go:115] DescribeSecurityGroups: { GroupIds: ["sg-1"] } I0313 08:53:20.072000 20507 records.go:89] ChangeResourceRecordSets { ChangeBatch: { Changes: [{ Action: "DELETE", ResourceRecordSet: { Name: "api.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "api.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } },{ Action: "DELETE", ResourceRecordSet: { Name: "kops-controller.internal.minimal.example.com.", ResourceRecords: [{ Value: "203.0.113.123" }], TTL: 10, Type: "A" } }] }, HostedZoneId: "/hostedzone/Z1AFAKE1ZON3YO" } route53-record:Z1AFAKE1ZON3YO/A/api.internal.minimal.example.com. ok I0313 08:53:20.072201 20507 securitygroups.go:210] RevokeSecurityGroupIngress: { GroupId: "sg-1", IpPermissions: [{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-2" }] },{ FromPort: 22, IpProtocol: "tcp", IpRanges: [{ CidrIp: "0.0.0.0/0" }], ToPort: 22 },{ IpProtocol: "-1", UserIdGroupPairs: [{ GroupId: "sg-1" }] }] } W0313 08:53:20.072315 20507 securitygroups.go:228] RevokeSecurityGroupIngress mock not implemented - does not actually revoke permissions I0313 08:53:20.072339 20507 securitygroups.go:79] DeleteSecurityGroup: { GroupId: "sg-1" } security-group:sg-1 ok I0313 08:53:20.072398 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-1" } volume:vol-1 ok I0313 08:53:20.072518 20507 keypairs.go:154] DeleteKeyPair: { KeyPairId: "key-1" } keypair:key-1 ok autoscaling-config:lt-1 ok autoscaling-config:lt-2 ok I0313 08:53:20.072668 20507 volumes.go:203] DeleteVolume: { VolumeId: "vol-2" } volume:vol-2 ok I0313 08:53:20.072765 20507 internetgateways.go:101] DescribeInternetGateways: { InternetGatewayIds: ["igw-2"] } I0313 08:53:20.072846 20507 internetgateways.go:227] DeleteInternetGateway: { InternetGatewayId: "igw-2" } internet-gateway:igw-2 ok I0313 08:53:20.072964 20507 subnets.go:238] DeleteSubnet: { SubnetId: "subnet-1" } subnet:subnet-1 ok I0313 08:53:20.073009 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "nodes.minimal.example.com" } I0313 08:53:20.073089 20507 iamrole.go:180] ListAttachedRolePolicies: nodes.minimal.example.com I0313 08:53:20.073110 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "nodes.minimal.example.com", RoleName: "nodes.minimal.example.com" } I0313 08:53:20.073146 20507 iamrole.go:137] DeleteRole: { RoleName: "nodes.minimal.example.com" } iam-role:nodes.minimal.example.com ok I0313 08:53:20.073189 20507 iamrolepolicy.go:108] ListRolePolicies: { RoleName: "masters.minimal.example.com" } I0313 08:53:20.073267 20507 iamrole.go:180] ListAttachedRolePolicies: masters.minimal.example.com I0313 08:53:20.073283 20507 iamrolepolicy.go:156] DeleteRolePolicy: { PolicyName: "masters.minimal.example.com", RoleName: "masters.minimal.example.com" } I0313 08:53:20.073318 20507 iamrole.go:137] DeleteRole: { RoleName: "masters.minimal.example.com" } iam-role:masters.minimal.example.com ok I0313 08:53:20.073401 20507 routetable.go:188] DeleteRouteTable: { RouteTableId: "rtb-1" } route-table:rtb-1 ok I0313 08:53:20.073495 20507 vpcs.go:222] DeleteVpc: { VpcId: "vpc-1" } vpc:vpc-1 ok I0313 08:53:20.073577 20507 dhcpoptions.go:173] DeleteDhcpOptions: { DhcpOptionsId: "dopt-1" } dhcp-options:dopt-1 ok --- PASS: TestLifecycleManyAddons (4.29s) === RUN TestGetFilters --- PASS: TestGetFilters (0.00s) === RUN TestGetInstanceSelectorOpts --- PASS: TestGetInstanceSelectorOpts (0.00s) === RUN TestValidateAllPrivateOrPublicSubnets --- PASS: TestValidateAllPrivateOrPublicSubnets (0.00s) === RUN TestValidateUserSubnetsWithClusterSubnets --- PASS: TestValidateUserSubnetsWithClusterSubnets (0.00s) === RUN TestCreateInstanceGroup --- PASS: TestCreateInstanceGroup (0.00s) === RUN TestDecorateWithInstanceGroupSpecs --- PASS: TestDecorateWithInstanceGroupSpecs (0.00s) === RUN TestDecorateWithMixedInstancesPolicy --- PASS: TestDecorateWithMixedInstancesPolicy (0.00s) === RUN TestDecorateWithClusterAutoscalerLabels --- PASS: TestDecorateWithClusterAutoscalerLabels (0.00s) === RUN TestNewTemplateContext --- PASS: TestNewTemplateContext (0.00s) PASS ok k8s.io/kops/cmd/kops 207.204s === RUN TestBuildProxyRequest === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/livez === RUN TestBuildProxyRequest/http://127.0.0.1:3990/healthz === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ready === RUN TestBuildProxyRequest/http://127.0.0.1:3990/ === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz? === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose === RUN TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude --- PASS: TestBuildProxyRequest (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/livez (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/healthz (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ready (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/ (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz/foo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyzfoo (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz? (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?foo=bar (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&exclude=2 (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude=1&verbose (0.00s) --- PASS: TestBuildProxyRequest/http://127.0.0.1:3990/readyz?exclude (0.00s) PASS ok k8s.io/kops/cmd/kube-apiserver-healthcheck 0.004s === RUN TestAliasForNodesInRole --- PASS: TestAliasForNodesInRole (0.00s) === RUN TestEnsureDotSuffix --- PASS: TestEnsureDotSuffix (0.00s) === RUN TestParseZoneSpec --- PASS: TestParseZoneSpec (0.00s) === RUN TestParseZoneRules I0313 08:49:53.837873 20826 zonespec.go:75] No rules specified, will permit management of all zones --- PASS: TestParseZoneRules (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/dns 0.004s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) PASS ok k8s.io/kops/dns-controller/pkg/util 0.004s === RUN TestPodController I0313 08:49:53.863928 20828 pod.go:59] starting pod controller I0313 08:49:53.864222 20828 stoppable.go:62] shutting down controller I0313 08:49:53.864281 20828 pod.go:107] Got stop signal --- PASS: TestPodController (0.00s) PASS I0313 08:49:53.864370 20828 pod.go:65] shutting down pod controller ok k8s.io/kops/dns-controller/pkg/watchers 0.032s === RUN TestEquivalent --- PASS: TestEquivalent (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider 0.004s Parsing flags. Getting new test interface. Running tests... === RUN TestZonesList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035490} route53_test.go:93: Got zone list: [0xc0000354c0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c0f0} --- PASS: TestZonesList (0.00s) === RUN TestZonesID route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000355f0} route53_test.go:93: Got zone list: [0xc000035620] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c108} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess route53_test.go:79: Got zones {0xc000035720} route53_test.go:170: Successfully added managed DNS zone: &{0xc0003ef230 0xc00009c128} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0000358e0} route53_test.go:93: Got zone list: [0xc000035910] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c148} route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035a70} route53_test.go:93: Got zone list: [0xc000035aa0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c170} route53_test.go:187: Successfully added resource record set: {0xc0003ede60 0xc00009c190} --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000035d80} route53_test.go:93: Got zone list: [0xc000035db0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c220} route53_test.go:199: Successfully added resource record set: {0xc00040e090 0xc00009c240} route53_test.go:118: Got 1 recordsets: [0xc000035f50] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000410160} route53_test.go:93: Got zone list: [0xc000410190] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c2e0} route53_test.go:221: Successfully added resource record set: {0xc00040e240 0xc00009c300} route53_test.go:228: Correctly failed to add duplicate resource record {0xc00040e240 0xc00009c300}: attempt to create duplicate rrset www11.example.com::A --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000410550} route53_test.go:93: Got zone list: [0xc000410580] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c3c0} route53_test.go:246: Successfully removed resource set {0xc00040e480 0xc00009c3e0} after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000410860} route53_test.go:93: Got zone list: [0xc000410890] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c470} route53_test.go:264: Successfully removed resource set {0xc00040e630 0xc00009c490} after adding route53_test.go:118: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000410ba0} route53_test.go:93: Got zone list: [0xc000410bd0] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c528} commontests.go:192: Successfully added resource record set: {0xc00040e7e0 0xc00009c548} commontests.go:45: Correctly replaced resource record {0xc00040e7e0 0xc00009c548} -> {0xc00040e900 0xc00009c598} commontests.go:142: Got 1 recordsets: [0xc000410ee0] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000411110} route53_test.go:93: Got zone list: [0xc000411140] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c650} commontests.go:192: Successfully added resource record set: {0xc00040ebd0 0xc00009c670} commontests.go:70: Correctly replaced resource record {0xc00040ebd0 0xc00009c670} -> {0xc00040ecf0 0xc00009c6c0} commontests.go:142: Got 1 recordsets: [0xc000411450] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc0004116d0} route53_test.go:93: Got zone list: [0xc000411700] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c788} commontests.go:192: Successfully added resource record set: {0xc00040efc0 0xc00009c7a8} commontests.go:142: Got 2 recordsets: [0xc000411970 0xc000411990] commontests.go:142: Got 2 recordsets: [0xc000411a00 0xc000411a20] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract route53_test.go:87: Getting zones route53_test.go:79: Got zones {0xc000411c20} route53_test.go:93: Got zone list: [0xc000411c50] route53_test.go:98: Got at least 1 zone in list:&{0xc0003eeff0 0xc00009c8b0} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/aws/route53 0.017s === RUN TestZonesList --- PASS: TestZonesList (0.00s) === RUN TestAdd --- PASS: TestAdd (0.00s) === RUN TestRemove --- PASS: TestRemove (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/do 0.007s === RUN TestZonesList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc000559da0} clouddns_test.go:71: Got zone list: [0xc000280a98] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000578f80 0xc000280a68} --- PASS: TestZonesList (0.00s) === RUN TestZonesID clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc000559ea0} clouddns_test.go:71: Got zone list: [0xc000280b58] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000578f80 0xc000280b28} --- PASS: TestZonesID (0.00s) === RUN TestZoneAddSuccess clouddns_test.go:131: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc000592020} clouddns_test.go:133: Got zones, making new Zone clouddns_test.go:149: Successfully added managed DNS zone: &{0xc000579100 0xc000280c18} --- PASS: TestZoneAddSuccess (0.00s) === RUN TestResourceRecordSetsList clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc0005920e0} clouddns_test.go:71: Got zone list: [0xc000280cd8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000578f80 0xc000280ca8} clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsList (0.00s) === RUN TestResourceRecordSetsAddSuccess clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc000592200} clouddns_test.go:71: Got zone list: [0xc000280e10] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000578f80 0xc000280de0} clouddns_test.go:165: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> --- PASS: TestResourceRecordSetsAddSuccess (0.00s) === RUN TestResourceRecordSetsAdditionVisible clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc000592340} clouddns_test.go:71: Got zone list: [0xc000280f78] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000578f80 0xc000280f48} clouddns_test.go:176: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:96: Got 1 recordsets: [<(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>] --- PASS: TestResourceRecordSetsAdditionVisible (0.00s) === RUN TestResourceRecordSetsAddDuplicateFailure clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc0005924a0} clouddns_test.go:71: Got zone list: [0xc000281188] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000578f80 0xc000281158} clouddns_test.go:198: Successfully added resource record set: <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> clouddns_test.go:205: Correctly failed to add duplicate resource record <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180>: attempt to insert duplicate rrset {www11.example.com [10.10.10.10 169.20.20.20] 180 A} --- PASS: TestResourceRecordSetsAddDuplicateFailure (0.00s) === RUN TestResourceRecordSetsRemove clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc000592600} clouddns_test.go:71: Got zone list: [0xc000281320] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000578f80 0xc0002812f0} clouddns_test.go:223: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding --- PASS: TestResourceRecordSetsRemove (0.00s) === RUN TestResourceRecordSetsRemoveGone clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc000592740} clouddns_test.go:71: Got zone list: [0xc000281488] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000578f80 0xc000281458} clouddns_test.go:241: Successfully removed resource set <(clouddns) "www11.example.com" type=A rrdatas=["10.10.10.10" "169.20.20.20"] ttl=180> after adding clouddns_test.go:96: Got 0 recordsets: [] --- PASS: TestResourceRecordSetsRemoveGone (0.00s) === RUN TestResourceRecordSetsReplace clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc0005928a0} clouddns_test.go:71: Got zone list: [0xc000281650] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000578f80 0xc000281620} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:45: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] --- PASS: TestResourceRecordSetsReplace (0.00s) === RUN TestResourceRecordSetsReplaceAll clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc000592a00} clouddns_test.go:71: Got zone list: [0xc000281920] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000578f80 0xc0002818f0} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:70: Correctly replaced resource record <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> -> <(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80> commontests.go:142: Got 1 recordsets: [<(clouddns) "beta.test.com" type=A rrdatas=["8.8.8.8"] ttl=80>] commontests.go:117: Did not Get recordset: alpha.test.com --- PASS: TestResourceRecordSetsReplaceAll (0.00s) === RUN TestResourceRecordSetsDifferentTypes clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc000592b80} clouddns_test.go:71: Got zone list: [0xc000281c50] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000578f80 0xc000281c20} commontests.go:192: Successfully added resource record set: <(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] commontests.go:142: Got 2 recordsets: [<(clouddns) "alpha.test.com" type=A rrdatas=["8.8.4.4"] ttl=40> <(clouddns) "alpha.test.com" type=AAAA rrdatas=["2001:4860:4860::8888"] ttl=80>] --- PASS: TestResourceRecordSetsDifferentTypes (0.00s) === RUN TestContract clouddns_test.go:66: Getting zones clouddns_test.go:58: Got zones {0xc0005dd768 0xc000592d60} clouddns_test.go:71: Got zone list: [0xc0005b80a8] clouddns_test.go:76: Got at least 1 zone in list:&{0xc000578f80 0xc0005b8078} --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/google/clouddns 0.075s === RUN TestContract --- PASS: TestContract (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/openstack/designate 0.030s === RUN TestZonesListValid --- PASS: TestZonesListValid (0.00s) === RUN TestZonesListShouldFail --- PASS: TestZonesListShouldFail (0.00s) === RUN TestAddValid --- PASS: TestAddValid (0.00s) === RUN TestAddShouldFail --- PASS: TestAddShouldFail (0.00s) === RUN TestRemoveValid --- PASS: TestRemoveValid (0.00s) === RUN TestRemoveShouldFail --- PASS: TestRemoveShouldFail (0.00s) === RUN TestNewZone --- PASS: TestNewZone (0.00s) === RUN TestNewResourceRecordSet --- PASS: TestNewResourceRecordSet (0.00s) === RUN TestResourceRecordChangeset --- PASS: TestResourceRecordChangeset (0.00s) PASS ok k8s.io/kops/dnsprovider/pkg/dnsprovider/providers/scaleway 0.007s === RUN TestBootstarapBuilder_Simple --- PASS: TestBootstarapBuilder_Simple (0.00s) PASS ok k8s.io/kops/nodeup/pkg/bootstrap 0.060s === RUN TestBuildAzure --- PASS: TestBuildAzure (0.00s) === RUN TestBuildAWSCustomNodeIPFamilies --- PASS: TestBuildAWSCustomNodeIPFamilies (0.00s) === RUN TestContainerdBuilder_Docker_19_03_13 I0313 08:50:01.581343 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.581469 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.581506 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.581546 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.581573 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.581614 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.581644 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.581660 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.581694 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.581714 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.588255 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_13 (0.01s) === RUN TestContainerdBuilder_Docker_19_03_14 I0313 08:50:01.591674 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.591742 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.591763 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.591786 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.591815 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.591842 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.591864 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.591883 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.591904 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.591917 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.592679 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdBuilder_Docker_19_03_14 (0.00s) === RUN TestContainerdBuilder_Simple I0313 08:50:01.595329 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.595393 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.595411 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.595429 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.595447 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.595468 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.595486 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.595501 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.595521 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.595533 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.596232 21552 zones.go:93] ListHostedZonesPages { } I0313 08:50:01.597459 21552 assetstore.go:108] Matching assets for "^bin/(containerd|ctr)": I0313 08:50:01.597474 21552 assetstore.go:111] bin/containerd I0313 08:50:01.597481 21552 assetstore.go:111] bin/containerd-shim I0313 08:50:01.597487 21552 assetstore.go:111] bin/containerd-shim-runc-v1 I0313 08:50:01.597493 21552 assetstore.go:111] bin/containerd-shim-runc-v2 I0313 08:50:01.597497 21552 assetstore.go:111] bin/containerd-stress I0313 08:50:01.597502 21552 assetstore.go:111] bin/ctr I0313 08:50:01.597533 21552 assetstore.go:108] Matching assets for "/runc\\.(amd64|arm64)$": I0313 08:50:01.597544 21552 assetstore.go:111] https://github.com/opencontainers/runc/releases/download/v1.1.0/runc.amd64 --- PASS: TestContainerdBuilder_Simple (0.00s) === RUN TestContainerdBuilder_Flatcar I0313 08:50:01.599877 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.599932 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.599949 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.599969 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.599988 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.600010 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.600029 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.600044 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.600063 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.600075 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.600769 21552 zones.go:93] ListHostedZonesPages { } I0313 08:50:01.601883 21552 containerd.go:60] Detected Flatcar; won't install containerd --- PASS: TestContainerdBuilder_Flatcar (0.00s) === RUN TestContainerdBuilder_SkipInstall I0313 08:50:01.604510 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.604607 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.604634 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.604666 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.604687 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.604710 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.604750 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.604769 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.604788 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.604800 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.605581 21552 zones.go:93] ListHostedZonesPages { } I0313 08:50:01.606762 21552 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestContainerdBuilder_SkipInstall (0.00s) === RUN TestContainerdBuilder_BuildFlags --- PASS: TestContainerdBuilder_BuildFlags (0.00s) === RUN TestContainerdConfig --- PASS: TestContainerdConfig (0.00s) === RUN TestAppendGPURuntimeContainerdConfig --- PASS: TestAppendGPURuntimeContainerdConfig (0.00s) === RUN TestDockerBuilder_19_03_11 I0313 08:50:01.607264 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.607315 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.607331 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.607349 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.607367 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.607386 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.607404 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.607418 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.607435 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.607446 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.608105 21552 zones.go:93] ListHostedZonesPages { } I0313 08:50:01.609350 21552 assetstore.go:108] Matching assets for "^docker/": I0313 08:50:01.609364 21552 assetstore.go:111] docker/containerd I0313 08:50:01.609370 21552 assetstore.go:111] docker/containerd-shim I0313 08:50:01.609375 21552 assetstore.go:111] docker/ctr I0313 08:50:01.609380 21552 assetstore.go:111] docker/docker I0313 08:50:01.609384 21552 assetstore.go:111] docker/docker-init I0313 08:50:01.609389 21552 assetstore.go:111] docker/docker-proxy I0313 08:50:01.609393 21552 assetstore.go:111] docker/dockerd I0313 08:50:01.609397 21552 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_19_03_11 (0.00s) === RUN TestDockerBuilder_LogFlags I0313 08:50:01.611734 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.611786 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.611803 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.611820 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.611837 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.611857 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.611876 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.611890 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.611931 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.611949 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.612641 21552 zones.go:93] ListHostedZonesPages { } I0313 08:50:01.613923 21552 assetstore.go:108] Matching assets for "^docker/": I0313 08:50:01.613936 21552 assetstore.go:111] docker/containerd I0313 08:50:01.613943 21552 assetstore.go:111] docker/containerd-shim I0313 08:50:01.613948 21552 assetstore.go:111] docker/ctr I0313 08:50:01.613954 21552 assetstore.go:111] docker/docker I0313 08:50:01.613958 21552 assetstore.go:111] docker/docker-init I0313 08:50:01.613962 21552 assetstore.go:111] docker/docker-proxy I0313 08:50:01.613966 21552 assetstore.go:111] docker/dockerd I0313 08:50:01.613970 21552 assetstore.go:111] docker/runc --- PASS: TestDockerBuilder_LogFlags (0.00s) === RUN TestDockerBuilder_SkipInstall I0313 08:50:01.616047 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.616100 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.616117 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.616136 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.616155 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.616174 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.616194 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.616208 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.616226 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.616238 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.616885 21552 zones.go:93] ListHostedZonesPages { } I0313 08:50:01.618049 21552 docker.go:63] SkipInstall is set to true; won't install Docker --- PASS: TestDockerBuilder_SkipInstall (0.00s) === RUN TestDockerBuilder_HealthCheck I0313 08:50:01.618157 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.618210 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.618227 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.618252 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.618283 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.618337 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.618370 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.618410 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.618444 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.618469 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.619654 21552 zones.go:93] ListHostedZonesPages { } I0313 08:50:01.622366 21552 assetstore.go:108] Matching assets for "^docker/": I0313 08:50:01.622386 21552 assetstore.go:111] docker/docker I0313 08:50:01.622398 21552 assetstore.go:111] docker/docker-containerd I0313 08:50:01.622407 21552 assetstore.go:111] docker/docker-containerd-ctr I0313 08:50:01.622415 21552 assetstore.go:111] docker/docker-containerd-shim I0313 08:50:01.622423 21552 assetstore.go:111] docker/docker-init I0313 08:50:01.622431 21552 assetstore.go:111] docker/docker-proxy I0313 08:50:01.622440 21552 assetstore.go:111] docker/docker-runc I0313 08:50:01.622448 21552 assetstore.go:111] docker/dockerd --- PASS: TestDockerBuilder_HealthCheck (0.01s) === RUN TestDockerBuilder_BuildFlags --- PASS: TestDockerBuilder_BuildFlags (0.00s) === RUN TestContainerdHooksBuilder I0313 08:50:01.625722 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.625785 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.625803 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.625827 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.625849 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.625881 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.625908 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.625925 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.625946 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.625959 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.627837 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestContainerdHooksBuilder (0.00s) === RUN TestDockerHooksBuilder I0313 08:50:01.629682 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.629746 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.629771 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.629790 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.629808 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.629829 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.629856 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.629872 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.629890 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.629902 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.631398 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestDockerHooksBuilder (0.01s) === RUN TestKopsControllerBuilder I0313 08:50:01.635931 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.636060 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.636101 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.636151 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.636194 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.636245 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.636294 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.636328 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.636372 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.636405 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.639065 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestKopsControllerBuilder (0.01s) === RUN Test_KubeAPIServer_BuildFlags --- PASS: Test_KubeAPIServer_BuildFlags (0.00s) === RUN TestKubeAPIServerBuilder I0313 08:50:01.647304 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.647403 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.647432 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.647462 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.647485 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.647518 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.647544 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.647568 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.647593 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.647611 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.649333 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilder (0.01s) === RUN TestAuditConfigAPIServerBuilder I0313 08:50:01.658929 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.659011 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.659037 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.659063 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.659088 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.659121 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.659146 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.659168 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.659195 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.659210 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.661302 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestAuditConfigAPIServerBuilder (0.01s) === RUN TestOIDCConfigAPIServerBuilder I0313 08:50:01.668730 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.668815 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.668841 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.668866 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.668903 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.668934 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.668959 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.668979 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.669003 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.669021 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.672583 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestOIDCConfigAPIServerBuilder (0.01s) === RUN TestDeddicatedAPIServerBuilder I0313 08:50:01.680234 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.680323 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.680353 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.680387 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.680419 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.680470 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.680515 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.680548 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.680589 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.680616 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.682541 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestDeddicatedAPIServerBuilder (0.01s) === RUN TestWithoutEtcdEventsAPIServerBuilder I0313 08:50:01.688869 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.688962 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.688987 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.689012 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.689045 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.689074 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.689109 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.689128 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.689154 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.689180 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.690611 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestWithoutEtcdEventsAPIServerBuilder (0.01s) === RUN TestAwsIamAuthenticator I0313 08:50:01.696849 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.696932 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.696956 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.696983 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.697015 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.697043 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.697067 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.697093 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.697116 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.697131 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.698817 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestAwsIamAuthenticator (0.01s) === RUN TestKubeAPIServerBuilderAMD64 I0313 08:50:01.707401 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:01.707485 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:01.707524 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:01.707553 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:01.707583 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:01.707611 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:01.707633 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:01.707660 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:01.707680 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:01.707695 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:01.709094 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderAMD64 (1.80s) === RUN TestKubeAPIServerBuilderARM64 I0313 08:50:03.511401 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:03.511560 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:03.511642 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:03.511723 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:03.511799 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:03.511888 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:03.511958 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:03.511996 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:03.512041 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:03.512072 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:03.513955 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeAPIServerBuilderARM64 (1.15s) === RUN TestKubeControllerManagerBuilder I0313 08:50:04.660457 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:04.660557 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:04.660590 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:04.660623 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:04.660648 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:04.660682 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:04.660712 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:04.660733 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:04.660760 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:04.660778 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:04.662529 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilder (0.01s) === RUN TestKubeControllerManagerBuilderAMD64 I0313 08:50:04.668678 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:04.668776 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:04.668807 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:04.668838 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:04.668868 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:04.668902 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:04.668929 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:04.668950 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:04.668987 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:04.669009 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:04.670802 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderAMD64 (1.18s) === RUN TestKubeControllerManagerBuilderARM64 I0313 08:50:05.850650 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:05.850771 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:05.850809 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:05.850854 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:05.850888 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:05.850932 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:05.850969 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:05.850993 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:05.851032 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:05.851062 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:05.853809 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeControllerManagerBuilderARM64 (1.16s) === RUN TestKubeProxyBuilder_buildPod === RUN TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 --- PASS: TestKubeProxyBuilder_buildPod (0.00s) --- PASS: TestKubeProxyBuilder_buildPod/Setup_KubeProxy_for_kubernetes_version_1.20 (0.00s) === RUN TestKubeProxyBuilder I0313 08:50:07.015265 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:07.015377 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:07.015409 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:07.015443 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:07.015472 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:07.015506 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:07.015536 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:07.015558 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:07.015586 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:07.015605 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:07.017445 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilder (0.01s) === RUN TestKubeProxyBuilderAMD64 I0313 08:50:07.021232 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:07.021314 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:07.021341 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:07.021371 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:07.021400 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:07.021432 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:07.021461 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:07.021481 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:07.021505 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:07.021526 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:07.023198 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderAMD64 (1.14s) === RUN TestKubeProxyBuilderARM64 I0313 08:50:08.163789 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:08.163922 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:08.163963 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:08.164018 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:08.164062 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:08.164112 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:08.164155 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:08.164189 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:08.164234 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:08.164261 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:08.167062 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestKubeProxyBuilderARM64 (1.14s) === RUN TestParseDefault --- PASS: TestParseDefault (0.00s) === RUN TestParse --- PASS: TestParse (0.00s) === RUN TestKubeSchedulerBuilder I0313 08:50:09.309476 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:09.309594 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:09.309631 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:09.309673 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:09.309711 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:09.309761 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:09.309801 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:09.309834 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:09.309876 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:09.309902 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:09.312336 21552 zones.go:93] ListHostedZonesPages { } W0313 08:50:09.316072 21552 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilder (0.01s) === RUN TestKubeSchedulerBuilderAMD64 I0313 08:50:09.318650 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:09.318751 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:09.318782 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:09.318818 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:09.318852 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:09.318895 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:09.318930 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:09.318961 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:09.318997 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:09.319021 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:09.321327 21552 zones.go:93] ListHostedZonesPages { } W0313 08:50:10.460149 21552 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderAMD64 (1.15s) === RUN TestKubeSchedulerBuilderARM64 I0313 08:50:10.464195 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:10.464293 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:10.464325 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:10.464360 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:10.464387 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:10.464420 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:10.464449 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:10.464469 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:10.464497 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:10.464516 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:10.466258 21552 zones.go:93] ListHostedZonesPages { } W0313 08:50:11.645426 21552 kube_scheduler.go:112] using embedded kubescheduler configuration --- PASS: TestKubeSchedulerBuilderARM64 (1.19s) === RUN TestKubectlBuilder I0313 08:50:11.649650 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:11.649797 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:11.649851 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:11.649910 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:11.649965 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:11.650021 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:11.650074 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:11.650114 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:11.650172 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:11.650215 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:11.653596 21552 zones.go:93] ListHostedZonesPages { } I0313 08:50:11.657772 21552 assetstore.go:159] Resolved asset kubectl: to /path/to/kubectl/asset --- PASS: TestKubectlBuilder (0.01s) === RUN TestTaintsApplied --- PASS: TestTaintsApplied (0.00s) === RUN Test_RunKubeletBuilder I0313 08:50:11.662005 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:11.662208 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:11.662344 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:11.662469 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:11.662547 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:11.662620 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:11.662679 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:11.662740 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:11.662813 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:11.662852 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:11.665588 21552 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilder (0.01s) === RUN Test_RunKubeletBuilderWarmPool I0313 08:50:11.672193 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:11.672282 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:11.672345 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:11.672392 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:11.672427 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:11.672478 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:11.672519 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:11.672555 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:11.672599 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:11.672630 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:11.674633 21552 zones.go:93] ListHostedZonesPages { } --- PASS: Test_RunKubeletBuilderWarmPool (0.01s) === RUN Test_BuildComponentConfigFile --- PASS: Test_BuildComponentConfigFile (0.00s) === RUN TestProtokubeBuilder I0313 08:50:11.680603 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:11.680678 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:11.680700 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:11.680723 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:11.680752 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:11.680781 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:11.680803 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:11.680823 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:11.680846 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:11.680862 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:11.682594 21552 zones.go:93] ListHostedZonesPages { } I0313 08:50:11.684949 21552 assetstore.go:108] Matching assets for "protokube$": I0313 08:50:11.684974 21552 assetstore.go:111] /opt/kops/bin/protokube I0313 08:50:11.684991 21552 assetstore.go:129] Found single matching asset for expr "protokube$": "protokube" I0313 08:50:11.685027 21552 assetstore.go:108] Matching assets for "channels$": I0313 08:50:11.685044 21552 assetstore.go:111] /opt/kops/bin/channels I0313 08:50:11.685057 21552 assetstore.go:129] Found single matching asset for expr "channels$": "channels" --- PASS: TestProtokubeBuilder (0.01s) === RUN TestSecretBuilder I0313 08:50:11.687002 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:11.687111 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:11.687143 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:11.687183 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:11.687224 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:11.687275 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:11.687314 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:11.687349 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:11.687394 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:11.687424 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:11.689933 21552 zones.go:93] ListHostedZonesPages { } --- PASS: TestSecretBuilder (0.01s) === RUN TestUpdateServiceBuilderAutomaticUpgrade I0313 08:50:11.692237 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:11.692301 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:11.692322 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:11.692346 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:11.692367 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:11.692393 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:11.692417 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:11.692443 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:11.692474 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:11.692489 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:11.695372 21552 zones.go:93] ListHostedZonesPages { } I0313 08:50:11.696991 21552 update_service.go:91] Detected OS {deb ubuntu focal 20.04}; installing unattended-upgrades package --- PASS: TestUpdateServiceBuilderAutomaticUpgrade (0.01s) === RUN TestUpdateServiceBuilderExternal I0313 08:50:11.697334 21552 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:11.697404 21552 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:11.697427 21552 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:11.697454 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:11.697476 21552 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:11.697502 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:11.697526 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:11.697545 21552 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:11.697569 21552 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:11.697584 21552 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:11.698981 21552 zones.go:93] ListHostedZonesPages { } I0313 08:50:11.700556 21552 update_service.go:86] UpdatePolicy requests automatic updates; skipping installation of package "unattended-upgrades" --- PASS: TestUpdateServiceBuilderExternal (0.00s) PASS ok k8s.io/kops/nodeup/pkg/model 10.184s === RUN TestWarmPoolSpec_IsEnabled === RUN TestWarmPoolSpec_IsEnabled/nil === RUN TestWarmPoolSpec_IsEnabled/empty === RUN TestWarmPoolSpec_IsEnabled/1 === RUN TestWarmPoolSpec_IsEnabled/0 --- PASS: TestWarmPoolSpec_IsEnabled (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/nil (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/empty (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/1 (0.00s) --- PASS: TestWarmPoolSpec_IsEnabled/0 (0.00s) === RUN TestWarmPoolSpec_ResolveDefaults === RUN TestWarmPoolSpec_ResolveDefaults/MinSize === RUN TestWarmPoolSpec_ResolveDefaults/MaxSize === RUN TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook --- PASS: TestWarmPoolSpec_ResolveDefaults (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MinSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/MaxSize (0.00s) --- PASS: TestWarmPoolSpec_ResolveDefaults/EnableLifecycleHook (0.00s) === RUN Test_ParseInstanceGroupRole --- PASS: Test_ParseInstanceGroupRole (0.00s) === RUN TestParseConfigYAML === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" === RUN TestParseConfigYAML/"kubeAPIServer:_{}" --- PASS: TestParseConfigYAML (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3140m_}" (0.01s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.14_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{__auditWebhookBatchThrottleQps:_3.140_}" (0.00s) --- PASS: TestParseConfigYAML/"kubeAPIServer:_{}" (0.00s) === RUN Test_SemverOrdering --- PASS: Test_SemverOrdering (0.00s) PASS ok k8s.io/kops/pkg/apis/kops 0.036s === RUN TestRoundTripTypes --- PASS: TestRoundTripTypes (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/install 0.024s === RUN TestUseCiliumEtcd --- PASS: TestUseCiliumEtcd (0.00s) === RUN Test_FindSubnet --- PASS: Test_FindSubnet (0.00s) === RUN Test_FindZonesForInstanceGroup --- PASS: Test_FindZonesForInstanceGroup (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/model 0.025s === RUN TestGetNodeRole === RUN TestGetNodeRole/RoleNone === RUN TestGetNodeRole/RoleNewerLabel === RUN TestGetNodeRole/RoleOlderLabel --- PASS: TestGetNodeRole (0.00s) --- PASS: TestGetNodeRole/RoleNone (0.00s) --- PASS: TestGetNodeRole/RoleNewerLabel (0.00s) --- PASS: TestGetNodeRole/RoleOlderLabel (0.00s) === RUN Test_ParseKubernetesVersion === RUN Test_ParseKubernetesVersion/1.3.7 === RUN Test_ParseKubernetesVersion/v1.4.0-beta.8 === RUN Test_ParseKubernetesVersion/1.5.0 === RUN Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ === RUN Test_ParseKubernetesVersion/#00 E0313 08:50:01.547305 21556 versions.go:96] unable to parse Kubernetes version "" === RUN Test_ParseKubernetesVersion/abc E0313 08:50:01.547410 21556 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: Test_ParseKubernetesVersion (0.00s) --- PASS: Test_ParseKubernetesVersion/1.3.7 (0.00s) --- PASS: Test_ParseKubernetesVersion/v1.4.0-beta.8 (0.00s) --- PASS: Test_ParseKubernetesVersion/1.5.0 (0.00s) --- PASS: Test_ParseKubernetesVersion/https://storage.googleapis.com/k8s-release-dev/ci/v1.4.0-alpha.2.677+ea69570f61af8e/ (0.00s) --- PASS: Test_ParseKubernetesVersion/#00 (0.00s) --- PASS: Test_ParseKubernetesVersion/abc (0.00s) === RUN Test_IsKubernetesGTEWithPatch --- PASS: Test_IsKubernetesGTEWithPatch (0.00s) === RUN Test_IsKubernetesGTEWithoutPatch --- PASS: Test_IsKubernetesGTEWithoutPatch (0.00s) === RUN Test_IsKubernetesGTEWithPre --- PASS: Test_IsKubernetesGTEWithPre (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/util 0.024s === RUN TestAWSValidateExternalCloudConfig --- PASS: TestAWSValidateExternalCloudConfig (0.00s) === RUN TestValidateInstanceGroupSpec I0313 08:50:02.097434 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097522 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097551 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097572 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097594 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestValidateInstanceGroupSpec (0.00s) === RUN TestMixedInstancePolicies I0313 08:50:02.097747 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097773 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097791 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097808 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097829 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097845 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097865 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097881 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097914 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097935 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097951 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097970 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.097987 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.098003 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.098017 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.098048 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.098076 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.098095 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } I0313 08:50:02.098110 21817 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: TestMixedInstancePolicies (0.00s) === RUN TestInstanceMetadataOptions I0313 08:50:02.098263 21817 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } I0313 08:50:02.098313 21817 images.go:53] DescribeImagesPages: { Filters: [{ Name: "name", Values: [""] }], Owners: ["self"] } --- PASS: TestInstanceMetadataOptions (0.00s) === RUN TestLoadBalancerSubnets --- PASS: TestLoadBalancerSubnets (0.00s) === RUN TestAWSAuthentication --- PASS: TestAWSAuthentication (0.00s) === RUN TestAWSAdditionalRoutes === RUN TestAWSAdditionalRoutes/valid_pcx === RUN TestAWSAdditionalRoutes/valid_instance === RUN TestAWSAdditionalRoutes/valid_nat === RUN TestAWSAdditionalRoutes/valid_transit_gateway === RUN TestAWSAdditionalRoutes/valid_internet_gateway === RUN TestAWSAdditionalRoutes/valid_egress_only_internet_gateway === RUN TestAWSAdditionalRoutes/bad_cluster_cidr === RUN TestAWSAdditionalRoutes/bad_cidr === RUN TestAWSAdditionalRoutes/bad_target === RUN TestAWSAdditionalRoutes/target_more_specific === RUN TestAWSAdditionalRoutes/target_more_specific_additionalCIDR === RUN TestAWSAdditionalRoutes/duplicates_cidr === RUN TestAWSAdditionalRoutes/shared_subnet === RUN TestAWSAdditionalRoutes/not_a_private_subnet --- PASS: TestAWSAdditionalRoutes (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_pcx (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_instance (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_nat (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_transit_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/valid_egress_only_internet_gateway (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cluster_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/bad_target (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific (0.00s) --- PASS: TestAWSAdditionalRoutes/target_more_specific_additionalCIDR (0.00s) --- PASS: TestAWSAdditionalRoutes/duplicates_cidr (0.00s) --- PASS: TestAWSAdditionalRoutes/shared_subnet (0.00s) --- PASS: TestAWSAdditionalRoutes/not_a_private_subnet (0.00s) === RUN TestValidEtcdChanges --- PASS: TestValidEtcdChanges (0.00s) === RUN TestValidateInstanceProfile --- PASS: TestValidateInstanceProfile (0.00s) === RUN TestValidMasterInstanceGroup --- PASS: TestValidMasterInstanceGroup (0.00s) === RUN TestValidBootDevice --- PASS: TestValidBootDevice (0.00s) === RUN TestValidNodeLabels --- PASS: TestValidNodeLabels (0.00s) === RUN TestValidateIGCloudLabels --- PASS: TestValidateIGCloudLabels (0.00s) === RUN TestIGCloudLabelIsIGName --- PASS: TestIGCloudLabelIsIGName (0.00s) === RUN TestValidTaints --- PASS: TestValidTaints (0.00s) === RUN TestIGUpdatePolicy === RUN TestIGUpdatePolicy/missing === RUN TestIGUpdatePolicy/automatic === RUN TestIGUpdatePolicy/external === RUN TestIGUpdatePolicy/empty === RUN TestIGUpdatePolicy/unknown --- PASS: TestIGUpdatePolicy (0.00s) --- PASS: TestIGUpdatePolicy/missing (0.00s) --- PASS: TestIGUpdatePolicy/automatic (0.00s) --- PASS: TestIGUpdatePolicy/external (0.00s) --- PASS: TestIGUpdatePolicy/empty (0.00s) --- PASS: TestIGUpdatePolicy/unknown (0.00s) === RUN TestValidInstanceGroup --- PASS: TestValidInstanceGroup (0.00s) === RUN Test_Validate_DNS --- PASS: Test_Validate_DNS (0.00s) === RUN TestValidateCIDR --- PASS: TestValidateCIDR (0.00s) === RUN TestValidateSubnets --- PASS: TestValidateSubnets (0.00s) === RUN TestValidateKubeAPIServer --- PASS: TestValidateKubeAPIServer (0.00s) === RUN Test_Validate_DockerConfig_Storage --- PASS: Test_Validate_DockerConfig_Storage (0.00s) === RUN Test_Validate_Networking_Flannel --- PASS: Test_Validate_Networking_Flannel (0.00s) === RUN Test_Validate_AdditionalPolicies --- PASS: Test_Validate_AdditionalPolicies (0.00s) === RUN Test_Validate_Calico === RUN Test_Validate_Calico/empty_specs === RUN Test_Validate_Calico/positive_Typha_replica_count === RUN Test_Validate_Calico/negative_Typha_replica_count === RUN Test_Validate_Calico/with_etcd_version === RUN Test_Validate_Calico/IPv4_autodetection_method === RUN Test_Validate_Calico/IPv6_autodetection_method === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method === RUN Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter === RUN Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) === RUN Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name === RUN Test_Validate_Calico/AWS_source/destination_checks_off === RUN Test_Validate_Calico/AWS_source/destination_checks_enabled === RUN Test_Validate_Calico/AWS_source/destination_checks_disabled === RUN Test_Validate_Calico/AWS_source/destination_checks_left_as_is === RUN Test_Validate_Calico/encapsulation_none_with_IPv4 === RUN Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 === RUN Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 === RUN Test_Validate_Calico/unknown_Calico_IPIP_mode === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) === RUN Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) === RUN Test_Validate_Calico/Calico_IPv6_without_encapsulation --- PASS: Test_Validate_Calico (0.00s) --- PASS: Test_Validate_Calico/empty_specs (0.00s) --- PASS: Test_Validate_Calico/positive_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/negative_Typha_replica_count (0.00s) --- PASS: Test_Validate_Calico/with_etcd_version (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv6_autodetection_method_missing_parameter (0.00s) --- PASS: Test_Validate_Calico/IPv4_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/IPv6_autodetection_method_with_parameter_list (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(parenthesis) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_(equals) (0.00s) --- PASS: Test_Validate_Calico/invalid_IPv4_autodetection_method_parameter_with_no_name (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_off (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_enabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_disabled (0.00s) --- PASS: Test_Validate_Calico/AWS_source/destination_checks_left_as_is (0.00s) --- PASS: Test_Validate_Calico/encapsulation_none_with_IPv4 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_IPIP_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/encapsulation_mode_VXLAN_for_IPv6 (0.00s) --- PASS: Test_Validate_Calico/unknown_Calico_IPIP_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(implicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPIP_encapsulation_mode_(explicit)_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(always) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(cross-subnet) (0.00s) --- PASS: Test_Validate_Calico/Calico_VXLAN_encapsulation_mode_with_IPIP_IPPool_mode_(never) (0.00s) --- PASS: Test_Validate_Calico/Calico_IPv6_without_encapsulation (0.00s) === RUN Test_Validate_Cilium --- PASS: Test_Validate_Cilium (0.00s) === RUN Test_Validate_RollingUpdate --- PASS: Test_Validate_RollingUpdate (0.00s) === RUN Test_Validate_NodeLocalDNS --- PASS: Test_Validate_NodeLocalDNS (0.00s) === RUN Test_Validate_CloudConfiguration === RUN Test_Validate_CloudConfiguration/neither === RUN Test_Validate_CloudConfiguration/all_false === RUN Test_Validate_CloudConfiguration/all_true === RUN Test_Validate_CloudConfiguration/os_false === RUN Test_Validate_CloudConfiguration/os_true === RUN Test_Validate_CloudConfiguration/all_false,_os_false === RUN Test_Validate_CloudConfiguration/all_false,_os_true === RUN Test_Validate_CloudConfiguration/all_true,_os_false === RUN Test_Validate_CloudConfiguration/all_true,_os_true --- PASS: Test_Validate_CloudConfiguration (0.00s) --- PASS: Test_Validate_CloudConfiguration/neither (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_false,_os_true (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_false (0.00s) --- PASS: Test_Validate_CloudConfiguration/all_true,_os_true (0.00s) === RUN TestValidateSAExternalPermissions === RUN TestValidateSAExternalPermissions/Duplicate_SA === RUN TestValidateSAExternalPermissions/Missing_permissions === RUN TestValidateSAExternalPermissions/Setting_both_arn_and_inline === RUN TestValidateSAExternalPermissions/Empty_SA_name === RUN TestValidateSAExternalPermissions/Empty_SA_namespace --- PASS: TestValidateSAExternalPermissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Duplicate_SA (0.00s) --- PASS: TestValidateSAExternalPermissions/Missing_permissions (0.00s) --- PASS: TestValidateSAExternalPermissions/Setting_both_arn_and_inline (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_name (0.00s) --- PASS: TestValidateSAExternalPermissions/Empty_SA_namespace (0.00s) === RUN Test_Validate_Nvidia_Cluster --- PASS: Test_Validate_Nvidia_Cluster (0.00s) === RUN Test_Validate_Nvidia_Ig --- PASS: Test_Validate_Nvidia_Ig (0.00s) PASS ok k8s.io/kops/pkg/apis/kops/validation 0.073s === RUN TestManagedFieldsMigrator === RUN TestManagedFieldsMigrator/csa-migration === RUN TestManagedFieldsMigrator/merge-owners === RUN TestManagedFieldsMigrator/ssa-unchanged === RUN TestManagedFieldsMigrator/unknown-unchanged --- PASS: TestManagedFieldsMigrator (0.00s) --- PASS: TestManagedFieldsMigrator/csa-migration (0.00s) --- PASS: TestManagedFieldsMigrator/merge-owners (0.00s) --- PASS: TestManagedFieldsMigrator/ssa-unchanged (0.00s) --- PASS: TestManagedFieldsMigrator/unknown-unchanged (0.00s) PASS ok k8s.io/kops/pkg/applylib/applyset 0.011s === RUN TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub W0313 08:50:02.078633 21819 builder.go:232] failed to digest image "proxy.example.com/weaveworks/weave-kube": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToDockerHub (0.01s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub W0313 08:50:02.079962 21819 builder.go:232] failed to digest image "proxy.example.com/debian": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedDockerHub (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL W0313 08:50:02.081095 21819 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToSimplifiedKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL W0313 08:50:02.082029 21819 builder.go:232] failed to digest image "proxy.example.com/google_containers/kube-apiserver": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToLegacyKubernetesURL (0.00s) === RUN TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags W0313 08:50:02.083052 21819 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerProxy_AppliesToImagesWithTags (0.00s) === RUN TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges W0313 08:50:02.084078 21819 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host W0313 08:50:02.087702 21819 builder.go:232] failed to digest image "proxy.example.com/kube-apiserver:1.2.3": Get "https://proxy.example.com/v2/": dial tcp: lookup proxy.example.com on 172.16.22.1:53: no such host --- PASS: TestValidate_RemapImage_ContainerRegistry_MappingMultipleTimesConverges (0.00s) === RUN TestRemapEmptySection --- PASS: TestRemapEmptySection (0.00s) === RUN Test_BuildVFSPath E0313 08:50:02.088483 21819 copyfile.go:209] Unable to determine VFS path from supplied URL: https://foo/k8s-for-greeks-kops/kubernetes-release/release/v1.7.2/bin/linux/amd64/kubectl E0313 08:50:02.088495 21819 copyfile.go:210] S3, Google Cloud Storage, and File Paths are supported. E0313 08:50:02.088502 21819 copyfile.go:211] For S3, please make sure that the supplied file repository URL adhere to S3 naming conventions, https://docs.aws.amazon.com/general/latest/gr/rande.html#s3_region. E0313 08:50:02.088509 21819 copyfile.go:212] For GCS, please make sure that the supplied file repository URL adheres to https://storage.googleapis.com/ --- PASS: Test_BuildVFSPath (0.00s) PASS ok k8s.io/kops/pkg/assets 0.055s === RUN TestBackoff --- PASS: TestBackoff (0.00s) PASS ok k8s.io/kops/pkg/backoff 0.004s === RUN TestSSHCredentialStoreOnConfigBase --- PASS: TestSSHCredentialStoreOnConfigBase (0.00s) === RUN TestSSHCredentialStoreOnOwnCFS --- PASS: TestSSHCredentialStoreOnOwnCFS (0.00s) PASS ok k8s.io/kops/pkg/client/simple/vfsclientset 0.069s === RUN TestToAzureVMName === RUN TestToAzureVMName/test_case_0 === RUN TestToAzureVMName/test_case_1 --- PASS: TestToAzureVMName (0.00s) --- PASS: TestToAzureVMName/test_case_0 (0.00s) --- PASS: TestToAzureVMName/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/cloudinstances 0.028s === RUN TestSetClusterBadInput --- PASS: TestSetClusterBadInput (0.00s) === RUN TestSetClusterFields --- PASS: TestSetClusterFields (0.00s) === RUN TestSetCiliumFields --- PASS: TestSetCiliumFields (0.00s) === RUN TestSetInstanceGroupsBadInput --- PASS: TestSetInstanceGroupsBadInput (0.00s) === RUN TestSetInstanceGroupsFields --- PASS: TestSetInstanceGroupsFields (0.00s) === RUN TestUnsetClusterBadInput --- PASS: TestUnsetClusterBadInput (0.00s) === RUN TestUnsetClusterFields --- PASS: TestUnsetClusterFields (0.00s) === RUN TestUnsetCiliumFields --- PASS: TestUnsetCiliumFields (0.00s) === RUN TestUnsetInstanceGroupsBadInput --- PASS: TestUnsetInstanceGroupsBadInput (0.00s) === RUN TestUnsetInstanceGroupsFields --- PASS: TestUnsetInstanceGroupsFields (0.00s) PASS ok k8s.io/kops/pkg/commands 0.104s === RUN Test_cacheFilePath --- PASS: Test_cacheFilePath (0.00s) PASS ok k8s.io/kops/pkg/commands/helpers 0.102s === RUN TestGetStructVal --- PASS: TestGetStructVal (0.00s) === RUN TestWrongStructField --- PASS: TestWrongStructField (0.00s) PASS ok k8s.io/kops/pkg/configbuilder 0.024s === RUN Test_Diff_1 --- PASS: Test_Diff_1 (0.00s) === RUN Test_Diff_2 --- PASS: Test_Diff_2 (0.00s) === RUN Test_Diff_3 --- PASS: Test_Diff_3 (0.00s) === RUN Test_Diff_ChangedLine --- PASS: Test_Diff_ChangedLine (0.00s) === RUN Test_Diff_4 --- PASS: Test_Diff_4 (0.00s) PASS ok k8s.io/kops/pkg/diff 0.004s === RUN TestIsGossipHostname --- PASS: TestIsGossipHostname (0.00s) PASS ok k8s.io/kops/pkg/dns 0.004s === RUN TestHasExtraFields === RUN TestHasExtraFields/minimal === RUN TestHasExtraFields/extraFields === RUN TestHasExtraFields/spec2 === RUN TestHasExtraFields/isolateMasters === RUN TestHasExtraFields/instanceGroup --- PASS: TestHasExtraFields (0.02s) --- PASS: TestHasExtraFields/minimal (0.01s) --- PASS: TestHasExtraFields/extraFields (0.00s) --- PASS: TestHasExtraFields/spec2 (0.00s) --- PASS: TestHasExtraFields/isolateMasters (0.00s) --- PASS: TestHasExtraFields/instanceGroup (0.00s) PASS ok k8s.io/kops/pkg/edit 0.049s === RUN TestFlagToFalse I0313 08:50:10.016095 22989 featureflag_test.go:32] Created flag Unittest1 I0313 08:50:10.016154 22989 featureflag.go:164] FeatureFlag "UnitTest1"=false I0313 08:50:10.016163 22989 featureflag.go:164] FeatureFlag "UnitTest1"=true --- PASS: TestFlagToFalse (0.00s) === RUN TestSetenv I0313 08:50:10.016225 22989 featureflag.go:164] FeatureFlag "UnitTest2"=false --- PASS: TestSetenv (0.00s) === RUN TestGetPositive --- PASS: TestGetPositive (0.00s) === RUN TestGetNegative --- PASS: TestGetNegative (0.00s) PASS ok k8s.io/kops/pkg/featureflag 0.004s === RUN TestBuildKCMFlags --- PASS: TestBuildKCMFlags (0.00s) === RUN TestKubeletConfigSpec --- PASS: TestKubeletConfigSpec (0.00s) === RUN TestBuildAPIServerFlags --- PASS: TestBuildAPIServerFlags (0.00s) PASS ok k8s.io/kops/pkg/flagbuilder 0.038s === RUN TestRenderInstanceGroupZones W0313 08:50:10.044055 22991 instancegroup.go:42] error fetching zones for instancegroup: cannot find subnet "badsubnet" (declared in instance group "", not found in cluster) --- PASS: TestRenderInstanceGroupZones (0.00s) === RUN TestRenderInstanceGroupSubnets --- PASS: TestRenderInstanceGroupSubnets (0.00s) PASS ok k8s.io/kops/pkg/formatter 0.033s === RUN TestWarmPoolOnlyRoll I0313 08:50:22.924484 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.924555 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.924573 23503 instancegroups.go:136] deleting warm pool instance "node-1" --- PASS: TestWarmPoolOnlyRoll (0.00s) === RUN TestRollingUpdateDisabledSurgeOS rollingupdate_os_test.go:96: Failing in new release PR when build is not yet published --- SKIP: TestRollingUpdateDisabledSurgeOS (0.00s) === RUN TestRollingUpdateAllNeedUpdate I0313 08:50:22.924966 23503 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0313 08:50:22.924989 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:22.926215 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.926282 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:22.931555 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.931636 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.931674 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.931703 23503 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0313 08:50:22.936477 23503 instancegroups.go:431] Draining the node: "master-1a.local". I0313 08:50:22.937911 23503 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0313 08:50:22.938190 23503 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0313 08:50:22.938256 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:22.939466 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.939505 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:22.944761 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.944841 23503 instancegroups.go:431] Draining the node: "master-1b.local". I0313 08:50:22.945835 23503 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0313 08:50:22.945899 23503 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0313 08:50:22.945930 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:22.947061 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.947087 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:22.952277 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.952315 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.952328 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.952339 23503 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0313 08:50:22.953119 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:22.953674 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:22.953702 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:22.954818 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.954838 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:22.960050 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.960098 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:22.960769 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:22.960805 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:22.961930 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.961951 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:22.967120 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.967162 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:22.967813 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:22.967841 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:22.968972 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.968992 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:22.974191 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.974223 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.974240 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.974255 23503 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0313 08:50:22.975214 23503 instancegroups.go:431] Draining the node: "node-2a.local". I0313 08:50:22.976024 23503 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0313 08:50:22.976061 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:22.977221 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.977241 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:22.982450 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.982515 23503 instancegroups.go:431] Draining the node: "node-2b.local". I0313 08:50:22.983528 23503 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0313 08:50:22.983564 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:22.984684 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.984704 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:22.989913 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.989983 23503 instancegroups.go:431] Draining the node: "node-2c.local". I0313 08:50:22.990993 23503 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0313 08:50:22.991031 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:22.992202 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:22.992228 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:22.997457 23503 instancegroups.go:540] Cluster validated. I0313 08:50:22.997506 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdate (0.07s) === RUN TestRollingUpdateAllNeedUpdateCloudonly I0313 08:50:22.998092 23503 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0313 08:50:22.998122 23503 instancegroups.go:469] waiting for 1ms after terminating instance W0313 08:50:22.999277 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0313 08:50:22.999364 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0313 08:50:22.999420 23503 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0313 08:50:22.999444 23503 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0313 08:50:22.999478 23503 instancegroups.go:469] waiting for 1ms after terminating instance W0313 08:50:23.000609 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0313 08:50:23.000672 23503 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0313 08:50:23.000695 23503 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0313 08:50:23.000730 23503 instancegroups.go:469] waiting for 1ms after terminating instance W0313 08:50:23.001832 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0313 08:50:23.001861 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0313 08:50:23.001901 23503 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0313 08:50:23.001929 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:23.001964 23503 instancegroups.go:469] waiting for 1ms after terminating instance W0313 08:50:23.003091 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0313 08:50:23.003130 23503 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0313 08:50:23.003146 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:23.003170 23503 instancegroups.go:469] waiting for 1ms after terminating instance W0313 08:50:23.004295 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0313 08:50:23.004335 23503 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0313 08:50:23.004353 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:23.004378 23503 instancegroups.go:469] waiting for 1ms after terminating instance W0313 08:50:23.005494 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0313 08:50:23.005514 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0313 08:50:23.005552 23503 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0313 08:50:23.005568 23503 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0313 08:50:23.005592 23503 instancegroups.go:469] waiting for 1ms after terminating instance W0313 08:50:23.006715 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0313 08:50:23.006754 23503 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0313 08:50:23.006770 23503 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0313 08:50:23.006794 23503 instancegroups.go:469] waiting for 1ms after terminating instance W0313 08:50:23.007911 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. W0313 08:50:23.007959 23503 instancegroups.go:428] Not draining cluster nodes as 'cloudonly' flag is set. I0313 08:50:23.007976 23503 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0313 08:50:23.008002 23503 instancegroups.go:469] waiting for 1ms after terminating instance W0313 08:50:23.009115 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0313 08:50:23.009141 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateCloudonly (0.01s) === RUN TestRollingUpdateAllNeedUpdateNoFailOnValidate I0313 08:50:23.009428 23503 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0313 08:50:23.009451 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.010581 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.010607 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0313 08:50:23.010623 23503 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0313 08:50:23.010654 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.010667 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0313 08:50:23.010676 23503 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0313 08:50:23.010687 23503 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0313 08:50:23.011216 23503 instancegroups.go:431] Draining the node: "master-1a.local". I0313 08:50:23.011658 23503 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0313 08:50:23.011709 23503 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0313 08:50:23.011726 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.012828 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.012856 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0313 08:50:23.012876 23503 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0313 08:50:23.012907 23503 instancegroups.go:431] Draining the node: "master-1b.local". I0313 08:50:23.013387 23503 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0313 08:50:23.013433 23503 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0313 08:50:23.013459 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.014598 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.014620 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0313 08:50:23.014633 23503 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0313 08:50:23.014646 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.014655 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0313 08:50:23.014663 23503 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0313 08:50:23.014671 23503 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0313 08:50:23.015226 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:23.015695 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:23.015716 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.016814 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.016832 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0313 08:50:23.016845 23503 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0313 08:50:23.016865 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:23.017316 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:23.017336 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.018467 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.018488 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0313 08:50:23.018502 23503 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0313 08:50:23.018524 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:23.019040 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:23.019062 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.020194 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.020221 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0313 08:50:23.020242 23503 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0313 08:50:23.020260 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.020279 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0313 08:50:23.020297 23503 instancegroups.go:516] Cluster validation failed, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0313 08:50:23.020311 23503 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0313 08:50:23.020911 23503 instancegroups.go:431] Draining the node: "node-2a.local". I0313 08:50:23.021343 23503 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0313 08:50:23.021370 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.022491 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.022513 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0313 08:50:23.022527 23503 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0313 08:50:23.022548 23503 instancegroups.go:431] Draining the node: "node-2b.local". I0313 08:50:23.023042 23503 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0313 08:50:23.023061 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.024178 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.024204 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0313 08:50:23.024225 23503 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0313 08:50:23.024275 23503 instancegroups.go:431] Draining the node: "node-2c.local". I0313 08:50:23.024796 23503 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0313 08:50:23.024822 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.025939 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.025960 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. W0313 08:50:23.025973 23503 instancegroups.go:516] Cluster validation failed after terminating instance, proceeding since fail-on-validate is set to false: cluster did not validate within a duration of "0s" I0313 08:50:23.025987 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateAllNeedUpdateNoFailOnValidate (0.02s) === RUN TestRollingUpdateNoneNeedUpdate I0313 08:50:23.026248 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdate (0.00s) === RUN TestRollingUpdateNoneNeedUpdateWithForce I0313 08:50:23.026420 23503 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0313 08:50:23.026437 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.027575 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.027593 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.032780 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.032819 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.032830 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.032838 23503 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0313 08:50:23.033309 23503 instancegroups.go:431] Draining the node: "master-1a.local". I0313 08:50:23.033734 23503 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0313 08:50:23.033778 23503 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0313 08:50:23.033794 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.034911 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.034932 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.040115 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.040148 23503 instancegroups.go:431] Draining the node: "master-1b.local". I0313 08:50:23.040619 23503 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0313 08:50:23.040674 23503 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0313 08:50:23.040703 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.041828 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.041854 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.047061 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.047120 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.047148 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.047170 23503 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0313 08:50:23.048386 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:23.049237 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:23.049272 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.050436 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.050463 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.055660 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.055713 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:23.056651 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:23.056683 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.057860 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.057881 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.064898 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.064972 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:23.065808 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:23.065840 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.067003 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.067024 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.072233 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.072272 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.072292 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.072308 23503 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0313 08:50:23.073321 23503 instancegroups.go:431] Draining the node: "node-2a.local". I0313 08:50:23.074078 23503 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0313 08:50:23.074112 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.075280 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.075298 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.080510 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.080576 23503 instancegroups.go:431] Draining the node: "node-2b.local". I0313 08:50:23.081519 23503 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0313 08:50:23.081552 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.082686 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.082712 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.087923 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.087984 23503 instancegroups.go:431] Draining the node: "node-2c.local". I0313 08:50:23.088817 23503 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0313 08:50:23.088852 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.089987 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.090007 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.095202 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.095248 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNoneNeedUpdateWithForce (0.07s) === RUN TestRollingUpdateEmptyGroup I0313 08:50:23.095473 23503 rollingupdate.go:111] Cloud Instance Group length is zero. Not doing a rolling-update. --- PASS: TestRollingUpdateEmptyGroup (0.00s) === RUN TestRollingUpdateUnknownRole --- PASS: TestRollingUpdateUnknownRole (0.00s) === RUN TestRollingUpdateAllNeedUpdateFailsValidation I0313 08:50:23.095879 23503 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0313 08:50:23.095902 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.097037 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.097080 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0313 08:50:23.097102 23503 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateFailsValidation (0.00s) === RUN TestRollingUpdateAllNeedUpdateErrorsValidation I0313 08:50:23.097497 23503 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0313 08:50:23.097526 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.098730 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.098751 23503 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0313 08:50:23.098766 23503 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateAllNeedUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateFailsValidation I0313 08:50:23.098964 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.098981 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0313 08:50:23.098991 23503 instancegroups.go:509] Cluster did not validate within 0s E0313 08:50:23.099000 23503 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateFailsValidation (0.00s) === RUN TestRollingUpdateNodes1NeedsUpdateErrorsValidation I0313 08:50:23.099124 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.099137 23503 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0313 08:50:23.099148 23503 instancegroups.go:509] Cluster did not validate within 0s E0313 08:50:23.099157 23503 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateNodes1NeedsUpdateErrorsValidation (0.00s) === RUN TestRollingUpdateClusterFailsValidationAfterOneMaster I0313 08:50:23.099305 23503 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0313 08:50:23.099323 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.100439 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.100459 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.105686 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.105749 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.105787 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.105797 23503 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0313 08:50:23.106386 23503 instancegroups.go:431] Draining the node: "master-1a.local". I0313 08:50:23.106823 23503 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0313 08:50:23.106877 23503 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0313 08:50:23.106895 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.108044 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.108089 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0313 08:50:23.108106 23503 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterFailsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneMaster I0313 08:50:23.108373 23503 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0313 08:50:23.108391 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.109529 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.109559 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.114798 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.114859 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.114876 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.114885 23503 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0313 08:50:23.115507 23503 instancegroups.go:431] Draining the node: "master-1a.local". I0313 08:50:23.116041 23503 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0313 08:50:23.116105 23503 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0313 08:50:23.116126 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.117261 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.117292 23503 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0313 08:50:23.117329 23503 instancegroups.go:509] Cluster did not validate within 0s --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneMaster (0.01s) === RUN TestRollingUpdateNonRelatedInstanceGroupFailure I0313 08:50:23.117674 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.117697 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.117709 23503 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0313 08:50:23.118695 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:23.119473 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:23.119514 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.120675 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.120695 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.125951 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.126013 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:23.126741 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:23.126770 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.127908 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.127936 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.133166 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.133240 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:23.134302 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:23.134337 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.135477 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.135505 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.140727 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.140775 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateNonRelatedInstanceGroupFailure (0.02s) === RUN TestRollingUpdateRelatedInstanceGroupFailure I0313 08:50:23.141153 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.141181 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0313 08:50:23.141202 23503 instancegroups.go:509] Cluster did not validate within 0s E0313 08:50:23.141219 23503 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateRelatedInstanceGroupFailure (0.00s) === RUN TestRollingUpdateMasterGroupFailure I0313 08:50:23.141467 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.141491 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0313 08:50:23.141507 23503 instancegroups.go:509] Cluster did not validate within 0s E0313 08:50:23.141523 23503 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateMasterGroupFailure (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupNil I0313 08:50:23.141766 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.141788 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0313 08:50:23.141802 23503 instancegroups.go:509] Cluster did not validate within 0s E0313 08:50:23.141816 23503 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupNil (0.00s) === RUN TestRollingUpdateValidationErrorInstanceGroupExitableError I0313 08:50:23.142136 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.142162 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.142177 23503 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0313 08:50:23.143277 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:23.144047 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:23.144079 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.145233 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.145278 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.150512 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.150593 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:23.151626 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:23.151670 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.152821 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.152861 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.158093 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.158169 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:23.159214 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:23.159255 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.160433 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.160479 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.165705 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.165744 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.165770 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0313 08:50:23.165803 23503 instancegroups.go:509] Cluster did not validate within 0s E0313 08:50:23.165850 23503 rollingupdate.go:218] failed to roll InstanceGroup "node-2": error validating cluster: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateValidationErrorInstanceGroupExitableError (0.02s) === RUN TestRollingUpdateClusterFailsValidationAfterOneNode I0313 08:50:23.166189 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.166215 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.166229 23503 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0313 08:50:23.167437 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:23.168313 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:23.168350 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.169526 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.169576 23503 instancegroups.go:560] Cluster did not pass validation within deadline: testing failure. E0313 08:50:23.169601 23503 instancegroups.go:509] Cluster did not validate within 0s E0313 08:50:23.169622 23503 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterFailsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateClusterErrorsValidationAfterOneNode I0313 08:50:23.169875 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.169919 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.169934 23503 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0313 08:50:23.171043 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:23.171830 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:23.171862 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.173020 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.173068 23503 instancegroups.go:550] Cluster did not validate within deadline: testing validation error. E0313 08:50:23.173096 23503 instancegroups.go:509] Cluster did not validate within 0s E0313 08:50:23.173116 23503 rollingupdate.go:218] failed to roll InstanceGroup "node-1": error validating cluster after terminating instance: cluster did not validate within a duration of "0s" --- PASS: TestRollingUpdateClusterErrorsValidationAfterOneNode (0.00s) === RUN TestRollingUpdateFlappingValidation I0313 08:50:23.173429 23503 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0313 08:50:23.173457 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.174561 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.174604 23503 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0313 08:50:23.175740 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.181104 23503 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0313 08:50:23.182279 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.187525 23503 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0313 08:50:23.188717 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.193961 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.194052 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.194081 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.194100 23503 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0313 08:50:23.194989 23503 instancegroups.go:431] Draining the node: "master-1a.local". I0313 08:50:23.195810 23503 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0313 08:50:23.195882 23503 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0313 08:50:23.195918 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.197097 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.197169 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.202395 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.202460 23503 instancegroups.go:431] Draining the node: "master-1b.local". I0313 08:50:23.203389 23503 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0313 08:50:23.203484 23503 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0313 08:50:23.203522 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.204697 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.204750 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.209977 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.210027 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.210059 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.210079 23503 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0313 08:50:23.211206 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:23.212036 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:23.212073 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.213250 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.213303 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.218551 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.218626 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:23.220936 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:23.220969 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.222122 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.222202 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.227709 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.227801 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:23.228825 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:23.228865 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.230022 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.230069 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.235297 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.235339 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.235360 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.235371 23503 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0313 08:50:23.236124 23503 instancegroups.go:431] Draining the node: "node-2a.local". I0313 08:50:23.236595 23503 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0313 08:50:23.236619 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.237739 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.237768 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.243027 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.243101 23503 instancegroups.go:431] Draining the node: "node-2b.local". I0313 08:50:23.243823 23503 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0313 08:50:23.243854 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.245014 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.245047 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.251968 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.252057 23503 instancegroups.go:431] Draining the node: "node-2c.local". I0313 08:50:23.252811 23503 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0313 08:50:23.252840 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.253974 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.254026 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.259262 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.259295 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateFlappingValidation (0.09s) === RUN TestRollingUpdateValidatesAfterBastion I0313 08:50:23.259551 23503 instancegroups.go:630] Stopping instance "bastion-1a", in group "bastion-1" (this may take a while). I0313 08:50:23.259571 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.260770 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.260823 23503 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0313 08:50:23.261967 23503 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0313 08:50:23.263135 23503 instancegroups.go:563] Cluster did not pass validation, will retry in "1ms": testing failure. I0313 08:50:23.264253 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.269435 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.269523 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.269545 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.269562 23503 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0313 08:50:23.270239 23503 instancegroups.go:431] Draining the node: "master-1a.local". I0313 08:50:23.270682 23503 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0313 08:50:23.270735 23503 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0313 08:50:23.270758 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.271867 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.271885 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.277072 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.277129 23503 instancegroups.go:431] Draining the node: "master-1b.local". I0313 08:50:23.277944 23503 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0313 08:50:23.278017 23503 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0313 08:50:23.278050 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.279175 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.279198 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.284427 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.284471 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.284491 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.284508 23503 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0313 08:50:23.285529 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:23.286294 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:23.286328 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.287469 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.287488 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.292681 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.292741 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:23.293610 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:23.293646 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.294770 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.294789 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.299963 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.300011 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:23.300567 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:23.300591 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.301729 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.301748 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.306951 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.306983 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.306995 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.307006 23503 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0313 08:50:23.307920 23503 instancegroups.go:431] Draining the node: "node-2a.local". I0313 08:50:23.308503 23503 instancegroups.go:628] Stopping instance "node-2a", node "node-2a.local", in group "node-2" (this may take a while). I0313 08:50:23.308530 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.309646 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.309665 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.314831 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.314884 23503 instancegroups.go:431] Draining the node: "node-2b.local". I0313 08:50:23.315495 23503 instancegroups.go:628] Stopping instance "node-2b", node "node-2b.local", in group "node-2" (this may take a while). I0313 08:50:23.315522 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.316653 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.316680 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.321903 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.321958 23503 instancegroups.go:431] Draining the node: "node-2c.local". I0313 08:50:23.322511 23503 instancegroups.go:628] Stopping instance "node-2c", node "node-2c.local", in group "node-2" (this may take a while). I0313 08:50:23.322534 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.323638 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.323655 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.330922 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.330969 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateValidatesAfterBastion (0.07s) === RUN TestAddAnnotatedNodesToNeedsUpdate --- PASS: TestAddAnnotatedNodesToNeedsUpdate (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateCloudonly --- PASS: TestAddAnnotatedNodesToNeedsUpdateCloudonly (0.00s) === RUN TestAddAnnotatedNodesToNeedsUpdateNodesMissing --- PASS: TestAddAnnotatedNodesToNeedsUpdateNodesMissing (0.00s) === RUN TestRollingUpdateTaintAllButOneNeedUpdate I0313 08:50:23.331464 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.331480 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.331489 23503 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0313 08:50:23.332005 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:23.332456 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:23.332481 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.333645 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.333674 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.338910 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.338963 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:23.339561 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:23.339586 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.340757 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.340791 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.345999 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.346032 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateTaintAllButOneNeedUpdate (0.01s) === RUN TestRollingUpdateMaxSurgeIgnoredForMaster I0313 08:50:23.346264 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.346279 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.346288 23503 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0313 08:50:23.346774 23503 instancegroups.go:431] Draining the node: "master-1a.local". I0313 08:50:23.347194 23503 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0313 08:50:23.347243 23503 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0313 08:50:23.347263 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.348408 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.348431 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.353619 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.353659 23503 instancegroups.go:431] Draining the node: "master-1b.local". I0313 08:50:23.354206 23503 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0313 08:50:23.354255 23503 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0313 08:50:23.354273 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.355412 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.355431 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.360616 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.360641 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeIgnoredForMaster (0.01s) === RUN TestRollingUpdateDisabled I0313 08:50:23.360892 23503 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled W0313 08:50:23.360916 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0313 08:50:23.360926 23503 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled W0313 08:50:23.360935 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0313 08:50:23.360945 23503 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled W0313 08:50:23.360952 23503 instancegroups.go:502] Not validating cluster as cloudonly flag is set. I0313 08:50:23.360962 23503 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0313 08:50:23.360970 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabled (0.00s) === RUN TestRollingUpdateDisabledSurge I0313 08:50:23.361121 23503 instancegroups.go:607] Detaching instance "bastion-1a", in group "bastion-1". I0313 08:50:23.361154 23503 instancegroups.go:203] waiting for 1ms after detaching instance I0313 08:50:23.362299 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.362318 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.367508 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.367544 23503 instancegroups.go:216] Rolling updates for InstanceGroup bastion-1 are disabled I0313 08:50:23.367597 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.367621 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.367635 23503 instancegroups.go:342] Tainting 2 nodes in "master-1" instancegroup. I0313 08:50:23.368329 23503 instancegroups.go:216] Rolling updates for InstanceGroup master-1 are disabled I0313 08:50:23.368353 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.368371 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.368385 23503 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0313 08:50:23.369109 23503 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0313 08:50:23.369153 23503 instancegroups.go:203] waiting for 1ms after detaching instance I0313 08:50:23.370533 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.370549 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.375718 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.375748 23503 instancegroups.go:216] Rolling updates for InstanceGroup node-1 are disabled I0313 08:50:23.375769 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.375781 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.375791 23503 instancegroups.go:342] Tainting 3 nodes in "node-2" instancegroup. I0313 08:50:23.376376 23503 instancegroups.go:605] Detaching instance "node-2c", node "node-2c.local", in group "node-2". I0313 08:50:23.376417 23503 instancegroups.go:203] waiting for 1ms after detaching instance I0313 08:50:23.377562 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.377588 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:23.382767 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.382797 23503 instancegroups.go:216] Rolling updates for InstanceGroup node-2 are disabled I0313 08:50:23.382821 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDisabledSurge (0.02s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdate I0313 08:50:23.383041 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.383062 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.383072 23503 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0313 08:50:23.384285 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:23.384767 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:23.384797 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.385940 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.385965 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.385988 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:23.386017 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:23.386812 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:23.386986 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:23.387013 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.388160 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.388198 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.488629 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.488691 23503 instancegroups.go:431] Draining the node: "node-1e.local". I0313 08:50:23.488739 23503 instancegroups.go:431] Draining the node: "node-1d.local". I0313 08:50:23.489313 23503 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0313 08:50:23.489720 23503 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0313 08:50:23.489753 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.490899 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.490927 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.490948 23503 instancegroups.go:431] Draining the node: "node-1f.local". I0313 08:50:23.491462 23503 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0313 08:50:23.491486 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.492622 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.492659 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.593080 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.593154 23503 instancegroups.go:431] Draining the node: "node-1g.local". I0313 08:50:23.594185 23503 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0313 08:50:23.594237 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.595391 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.595419 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.595433 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllButOneNeedUpdate I0313 08:50:23.595620 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.595638 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.595646 23503 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0313 08:50:23.596659 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:23.596713 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:23.597328 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:23.597494 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:23.597527 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.598633 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.598682 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.699092 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.699166 23503 instancegroups.go:431] Draining the node: "node-1d.local". I0313 08:50:23.699203 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:23.700188 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:23.700431 23503 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0313 08:50:23.700473 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.701624 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.701661 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.701694 23503 instancegroups.go:431] Draining the node: "node-1e.local". I0313 08:50:23.702201 23503 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0313 08:50:23.702236 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.703367 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.703419 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.803843 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.803907 23503 instancegroups.go:431] Draining the node: "node-1f.local". I0313 08:50:23.804513 23503 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0313 08:50:23.804550 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.805685 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.805720 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.805741 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxUnavailableAllNeedUpdateMaster I0313 08:50:23.805984 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.806016 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.806031 23503 instancegroups.go:342] Tainting 7 nodes in "master-1" instancegroup. I0313 08:50:23.808200 23503 instancegroups.go:431] Draining the node: "master-1a.local". I0313 08:50:23.808992 23503 instancegroups.go:691] skipping deregistration of instance "master-1a", as part of instancegroup with role "ControlPlane" I0313 08:50:23.809053 23503 instancegroups.go:628] Stopping instance "master-1a", node "master-1a.local", in group "master-1" (this may take a while). I0313 08:50:23.809090 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.810249 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.810277 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.810302 23503 instancegroups.go:431] Draining the node: "master-1c.local". I0313 08:50:23.810332 23503 instancegroups.go:431] Draining the node: "master-1b.local". I0313 08:50:23.810790 23503 instancegroups.go:691] skipping deregistration of instance "master-1c", as part of instancegroup with role "ControlPlane" I0313 08:50:23.810825 23503 instancegroups.go:628] Stopping instance "master-1c", node "master-1c.local", in group "master-1" (this may take a while). I0313 08:50:23.811148 23503 instancegroups.go:691] skipping deregistration of instance "master-1b", as part of instancegroup with role "ControlPlane" I0313 08:50:23.811182 23503 instancegroups.go:628] Stopping instance "master-1b", node "master-1b.local", in group "master-1" (this may take a while). I0313 08:50:23.811202 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.812342 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.812381 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.912839 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.912897 23503 instancegroups.go:431] Draining the node: "master-1e.local". I0313 08:50:23.912944 23503 instancegroups.go:431] Draining the node: "master-1d.local". I0313 08:50:23.913471 23503 instancegroups.go:691] skipping deregistration of instance "master-1e", as part of instancegroup with role "ControlPlane" I0313 08:50:23.913525 23503 instancegroups.go:628] Stopping instance "master-1e", node "master-1e.local", in group "master-1" (this may take a while). I0313 08:50:23.913874 23503 instancegroups.go:691] skipping deregistration of instance "master-1d", as part of instancegroup with role "ControlPlane" I0313 08:50:23.913909 23503 instancegroups.go:628] Stopping instance "master-1d", node "master-1d.local", in group "master-1" (this may take a while). I0313 08:50:23.913933 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.915039 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.915068 23503 instancegroups.go:540] Cluster validated. I0313 08:50:23.915089 23503 instancegroups.go:431] Draining the node: "master-1f.local". I0313 08:50:23.915618 23503 instancegroups.go:691] skipping deregistration of instance "master-1f", as part of instancegroup with role "ControlPlane" I0313 08:50:23.915654 23503 instancegroups.go:628] Stopping instance "master-1f", node "master-1f.local", in group "master-1" (this may take a while). I0313 08:50:23.915676 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:23.916767 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:23.916802 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.017171 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.017248 23503 instancegroups.go:431] Draining the node: "master-1g.local". I0313 08:50:24.018110 23503 instancegroups.go:691] skipping deregistration of instance "master-1g", as part of instancegroup with role "ControlPlane" I0313 08:50:24.018179 23503 instancegroups.go:628] Stopping instance "master-1g", node "master-1g.local", in group "master-1" (this may take a while). I0313 08:50:24.018223 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.019378 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.019408 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.019422 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxUnavailableAllNeedUpdateMaster (0.21s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdate I0313 08:50:24.019611 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.019634 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.019643 23503 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0313 08:50:24.020621 23503 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0313 08:50:24.020660 23503 instancegroups.go:203] waiting for 1ms after detaching instance I0313 08:50:24.021777 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.021808 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.021821 23503 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0313 08:50:24.021867 23503 instancegroups.go:203] waiting for 1ms after detaching instance I0313 08:50:24.022974 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.023003 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.023032 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:24.023060 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:24.023894 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:24.024149 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:24.024191 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.025375 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.025458 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.125841 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.125900 23503 instancegroups.go:431] Draining the node: "node-1d.local". I0313 08:50:24.125965 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:24.126915 23503 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0313 08:50:24.127089 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:24.127120 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.128247 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.128283 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.128316 23503 instancegroups.go:431] Draining the node: "node-1e.local". I0313 08:50:24.129057 23503 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0313 08:50:24.129101 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.130241 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.130283 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.239143 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.239224 23503 instancegroups.go:431] Draining the node: "node-1f.local". I0313 08:50:24.240104 23503 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0313 08:50:24.240165 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.241653 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.241711 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.241736 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdate (0.22s) === RUN TestRollingUpdateMaxSurgeAllButOneNeedUpdate I0313 08:50:24.242067 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.242101 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.242115 23503 instancegroups.go:342] Tainting 6 nodes in "node-1" instancegroup. I0313 08:50:24.243465 23503 instancegroups.go:605] Detaching instance "node-1f", node "node-1f.local", in group "node-1". I0313 08:50:24.243505 23503 instancegroups.go:605] Detaching instance "node-1e", node "node-1e.local", in group "node-1". I0313 08:50:24.243549 23503 instancegroups.go:203] waiting for 1ms after detaching instance I0313 08:50:24.244685 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.244710 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.244737 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:24.244776 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:24.245864 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:24.246025 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:24.246051 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.247198 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.247234 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.347676 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.347739 23503 instancegroups.go:431] Draining the node: "node-1d.local". I0313 08:50:24.347793 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:24.348787 23503 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0313 08:50:24.349061 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:24.349111 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.350268 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.350296 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.350318 23503 instancegroups.go:431] Draining the node: "node-1e.local". I0313 08:50:24.350769 23503 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0313 08:50:24.350801 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.351934 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.351993 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.452724 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.452800 23503 instancegroups.go:431] Draining the node: "node-1f.local". I0313 08:50:24.453593 23503 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0313 08:50:24.453646 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.454829 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.454879 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.454895 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllButOneNeedUpdate (0.21s) === RUN TestRollingUpdateMaxSurgeGreaterThanNeedUpdate I0313 08:50:24.455107 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.455121 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.455129 23503 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0313 08:50:24.455591 23503 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0313 08:50:24.455613 23503 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". I0313 08:50:24.455633 23503 instancegroups.go:203] waiting for 1ms after detaching instance I0313 08:50:24.456805 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.456834 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:24.462039 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.462080 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:24.462104 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:24.462629 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:24.462652 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.463002 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:24.463022 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.463774 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.463795 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:24.469040 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.469070 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeGreaterThanNeedUpdate (0.01s) === RUN TestRollingUpdateDetachFails I0313 08:50:24.469268 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.469283 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.469291 23503 instancegroups.go:342] Tainting 2 nodes in "node-1" instancegroup. I0313 08:50:24.469716 23503 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". E0313 08:50:24.469753 23503 instancegroups.go:191] Failed to detach instance "node-1b": error detaching instance "node-1b", node "node-1b.local": error detaching instance "node-1b": testing error I0313 08:50:24.469762 23503 instancegroups.go:605] Detaching instance "node-1a", node "node-1a.local", in group "node-1". E0313 08:50:24.469782 23503 instancegroups.go:191] Failed to detach instance "node-1a": error detaching instance "node-1a", node "node-1a.local": error detaching instance "node-1a": testing error I0313 08:50:24.469798 23503 instancegroups.go:203] waiting for 1ms after detaching instance I0313 08:50:24.470941 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.470960 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:24.476136 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.476186 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:24.476247 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:24.476760 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:24.476784 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.477692 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:24.477740 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.477937 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.477958 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:24.483216 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.483259 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateDetachFails (0.01s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached I0313 08:50:24.483613 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.483658 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.483678 23503 instancegroups.go:342] Tainting 4 nodes in "node-1" instancegroup. I0313 08:50:24.485385 23503 instancegroups.go:605] Detaching instance "node-1c", node "node-1c.local", in group "node-1". I0313 08:50:24.485473 23503 instancegroups.go:203] waiting for 1ms after detaching instance I0313 08:50:24.486644 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.486685 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.486695 23503 instancegroups.go:605] Detaching instance "node-1b", node "node-1b.local", in group "node-1". I0313 08:50:24.486736 23503 instancegroups.go:203] waiting for 1ms after detaching instance I0313 08:50:24.487876 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.487918 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.487970 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:24.488010 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:24.488071 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:24.488642 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:24.488680 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.489574 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:24.489635 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.489768 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:24.489799 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.489822 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.590744 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.590802 23503 instancegroups.go:431] Draining the node: "node-1d.local". I0313 08:50:24.591436 23503 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0313 08:50:24.591473 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.592587 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.592615 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.592629 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateOneAlreadyDetached (0.11s) === RUN TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached I0313 08:50:24.592812 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.592832 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.592840 23503 instancegroups.go:342] Tainting 7 nodes in "node-1" instancegroup. I0313 08:50:24.594054 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:24.594506 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:24.594550 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.595725 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.595753 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.595777 23503 instancegroups.go:431] Draining the node: "node-1e.local". I0313 08:50:24.595831 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:24.596279 23503 instancegroups.go:628] Stopping instance "node-1e", node "node-1e.local", in group "node-1" (this may take a while). I0313 08:50:24.596707 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:24.596732 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.597912 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.597953 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.698278 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.698341 23503 instancegroups.go:431] Draining the node: "node-1g.local". I0313 08:50:24.698387 23503 instancegroups.go:431] Draining the node: "node-1f.local". I0313 08:50:24.700941 23503 instancegroups.go:628] Stopping instance "node-1g", node "node-1g.local", in group "node-1" (this may take a while). I0313 08:50:24.701102 23503 instancegroups.go:628] Stopping instance "node-1f", node "node-1f.local", in group "node-1" (this may take a while). I0313 08:50:24.701130 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.702263 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.702309 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.702355 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:24.703160 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:24.703201 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.704436 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.704528 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.804729 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.804804 23503 instancegroups.go:431] Draining the node: "node-1d.local". I0313 08:50:24.805783 23503 instancegroups.go:628] Stopping instance "node-1d", node "node-1d.local", in group "node-1" (this may take a while). I0313 08:50:24.805833 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.806989 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.807019 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.807033 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateMaxSurgeAllNeedUpdateMaxAlreadyDetached (0.21s) === RUN TestRollingUpdateOnlyWarmPoolNodes I0313 08:50:24.807215 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.807231 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.807240 23503 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0313 08:50:24.807251 23503 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0313 08:50:24.807258 23503 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0313 08:50:24.807271 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingUpdateOnlyWarmPoolNodes (0.00s) === RUN TestRollingWarmPoolBeforeJoinedNodes I0313 08:50:24.807364 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.807378 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.807386 23503 instancegroups.go:342] Tainting 3 nodes in "node-1" instancegroup. I0313 08:50:24.807937 23503 instancegroups.go:136] deleting warm pool instance "node-1-wp-a" I0313 08:50:24.807956 23503 instancegroups.go:136] deleting warm pool instance "node-1-wp-b" I0313 08:50:24.807964 23503 instancegroups.go:136] deleting warm pool instance "node-1-wp-c" I0313 08:50:24.807988 23503 instancegroups.go:431] Draining the node: "node-1a.local". I0313 08:50:24.808427 23503 instancegroups.go:628] Stopping instance "node-1a", node "node-1a.local", in group "node-1" (this may take a while). I0313 08:50:24.808446 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.809567 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.809590 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:24.814992 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.815041 23503 instancegroups.go:431] Draining the node: "node-1b.local". I0313 08:50:24.815674 23503 instancegroups.go:628] Stopping instance "node-1b", node "node-1b.local", in group "node-1" (this may take a while). I0313 08:50:24.815700 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.816822 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.816846 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:24.822058 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.822108 23503 instancegroups.go:431] Draining the node: "node-1c.local". I0313 08:50:24.822727 23503 instancegroups.go:628] Stopping instance "node-1c", node "node-1c.local", in group "node-1" (this may take a while). I0313 08:50:24.822752 23503 instancegroups.go:469] waiting for 1ms after terminating instance I0313 08:50:24.823896 23503 instancegroups.go:504] Validating the cluster. I0313 08:50:24.823920 23503 instancegroups.go:543] Cluster validated; revalidating in 5ms to make sure it does not flap. I0313 08:50:24.829146 23503 instancegroups.go:540] Cluster validated. I0313 08:50:24.829175 23503 rollingupdate.go:234] Rolling update completed for cluster ""! --- PASS: TestRollingWarmPoolBeforeJoinedNodes (0.02s) === RUN TestSettings === RUN TestSettings/DrainAndTerminate === RUN TestSettings/MaxUnavailable === RUN TestSettings/MaxSurge --- PASS: TestSettings (0.00s) --- PASS: TestSettings/DrainAndTerminate (0.00s) --- PASS: TestSettings/MaxUnavailable (0.00s) --- PASS: TestSettings/MaxSurge (0.00s) === RUN TestMaxUnavailable === RUN TestMaxUnavailable/0_1 === RUN TestMaxUnavailable/0%_1 === RUN TestMaxUnavailable/39%_10 === RUN TestMaxUnavailable/100%_10 --- PASS: TestMaxUnavailable (0.00s) --- PASS: TestMaxUnavailable/0_1 (0.00s) --- PASS: TestMaxUnavailable/0%_1 (0.00s) --- PASS: TestMaxUnavailable/39%_10 (0.00s) --- PASS: TestMaxUnavailable/100%_10 (0.00s) === RUN TestMaxSurge === RUN TestMaxSurge/0_1 === RUN TestMaxSurge/0%_1 === RUN TestMaxSurge/31%_10 === RUN TestMaxSurge/100%_10 --- PASS: TestMaxSurge (0.00s) --- PASS: TestMaxSurge/0_1 (0.00s) --- PASS: TestMaxSurge/0%_1 (0.00s) --- PASS: TestMaxSurge/31%_10 (0.00s) --- PASS: TestMaxSurge/100%_10 (0.00s) === RUN TestAWSDefault --- PASS: TestAWSDefault (0.00s) PASS ok k8s.io/kops/pkg/instancegroups 2.019s === RUN TestWriteToken === RUN TestWriteToken/WriteJson === RUN TestWriteToken/WriteJsonWithIndent --- PASS: TestWriteToken (0.00s) --- PASS: TestWriteToken/WriteJson (0.00s) --- PASS: TestWriteToken/WriteJsonWithIndent (0.00s) PASS ok k8s.io/kops/pkg/jsonutils 0.013s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.00s) PASS ok k8s.io/kops/pkg/k8scodecs 0.018s === RUN TestParse E0313 08:50:22.830846 23505 versions.go:96] unable to parse Kubernetes version "" E0313 08:50:22.830950 23505 versions.go:96] unable to parse Kubernetes version "abc" --- PASS: TestParse (0.00s) === RUN TestIsGTE === RUN TestIsGTE/KV_greater_than_Version === RUN TestIsGTE/KV_greater_than_Version#01 === RUN TestIsGTE/KV_equal_Version === RUN TestIsGTE/KV_equal_Version#01 === RUN TestIsGTE/Version_greater_than_KV === RUN TestIsGTE/Version_greater_than_KV#01 --- PASS: TestIsGTE (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version (0.00s) --- PASS: TestIsGTE/KV_greater_than_Version#01 (0.00s) --- PASS: TestIsGTE/KV_equal_Version (0.00s) --- PASS: TestIsGTE/KV_equal_Version#01 (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV (0.00s) --- PASS: TestIsGTE/Version_greater_than_KV#01 (0.00s) PASS ok k8s.io/kops/pkg/k8sversion 0.014s === RUN TestToVersionedYaml --- PASS: TestToVersionedYaml (0.01s) === RUN TestToVersionedJSON --- PASS: TestToVersionedJSON (0.00s) === RUN TestRewriteAPIGroup --- PASS: TestRewriteAPIGroup (0.00s) PASS ok k8s.io/kops/pkg/kopscodecs 0.046s === RUN TestBuildKubecfg === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster === RUN TestBuildKubecfg/Public_DNS_with_kops_auth_plugin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin === RUN TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option === RUN TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option --- PASS: TestBuildKubecfg (0.20s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin (0.04s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_secondary_NLB_port (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_admin_and_CLB_ACM_Certificate (0.02s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin_and_with_ACM_certificate (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_without_admin (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Public_DNS_with_Empty_Master_Name (0.01s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster (0.00s) --- PASS: TestBuildKubecfg/Public_DNS_with_kops_auth_plugin (0.00s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_internal_DNS_name_with_admin (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_For_Gossip_cluster_with_admin_and_secondary_NLB_port (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_with_admin_and_internal_option (0.03s) --- PASS: TestBuildKubecfg/Test_Kube_Config_Data_for_Public_cluster_without_admin_and_with_internal_option (0.00s) PASS ok k8s.io/kops/pkg/kubeconfig 0.292s === RUN Test_ProxyFunc --- PASS: Test_ProxyFunc (0.00s) === RUN TestBootstrapUserData --- PASS: TestBootstrapUserData (0.02s) === RUN TestValidateAWSVolumeAllow50ratio --- PASS: TestValidateAWSVolumeAllow50ratio (0.00s) PASS ok k8s.io/kops/pkg/model 0.094s === RUN TestRootVolumeOptimizationFlag --- PASS: TestRootVolumeOptimizationFlag (0.00s) === RUN TestAPIServerAdditionalSecurityGroupsWithNLB === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane === RUN TestAPIServerAdditionalSecurityGroupsWithNLB/Node --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Bastion (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/ControlPlane (0.00s) --- PASS: TestAPIServerAdditionalSecurityGroupsWithNLB/Node (0.00s) === RUN TestJoinSuffixes --- PASS: TestJoinSuffixes (0.00s) === RUN TestIAMServiceEC2 --- PASS: TestIAMServiceEC2 (0.00s) === RUN Test_formatAWSIAMStatement === RUN Test_formatAWSIAMStatement/namespace_and_name_without_wildcard === RUN Test_formatAWSIAMStatement/name_contains_wildcard === RUN Test_formatAWSIAMStatement/namespace_contains_wildcard --- PASS: Test_formatAWSIAMStatement (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_and_name_without_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/name_contains_wildcard (0.00s) --- PASS: Test_formatAWSIAMStatement/namespace_contains_wildcard (0.00s) PASS ok k8s.io/kops/pkg/model/awsmodel 0.063s === RUN TestAPILoadBalancerModelBuilder_Build --- PASS: TestAPILoadBalancerModelBuilder_Build (0.00s) === RUN TestSubnetForLoadbalancer --- PASS: TestSubnetForLoadbalancer (0.00s) === RUN TestCloudTagsForInstanceGroup --- PASS: TestCloudTagsForInstanceGroup (0.00s) === RUN TestNetworkModelBuilder_Build --- PASS: TestNetworkModelBuilder_Build (0.00s) === RUN TestResourceGroupModelBuilder_Build --- PASS: TestResourceGroupModelBuilder_Build (0.00s) === RUN TestVMScaleSetModelBuilder_Build --- PASS: TestVMScaleSetModelBuilder_Build (0.00s) === RUN TestGetCapacity === RUN TestGetCapacity/test_case_0 === RUN TestGetCapacity/test_case_1 === RUN TestGetCapacity/test_case_2 === RUN TestGetCapacity/test_case_3 --- PASS: TestGetCapacity (0.00s) --- PASS: TestGetCapacity/test_case_0 (0.00s) --- PASS: TestGetCapacity/test_case_1 (0.00s) --- PASS: TestGetCapacity/test_case_2 (0.00s) --- PASS: TestGetCapacity/test_case_3 (0.00s) === RUN TestGetStorageProfile === RUN TestGetStorageProfile/test_case_0 === RUN TestGetStorageProfile/test_case_1 --- PASS: TestGetStorageProfile (0.00s) --- PASS: TestGetStorageProfile/test_case_0 (0.00s) --- PASS: TestGetStorageProfile/test_case_1 (0.00s) === RUN TestParseImage === RUN TestParseImage/test_case_0 === RUN TestParseImage/test_case_1 === RUN TestParseImage/test_case_2 === RUN TestParseImage/test_case_3 --- PASS: TestParseImage (0.00s) --- PASS: TestParseImage/test_case_0 (0.00s) --- PASS: TestParseImage/test_case_1 (0.00s) --- PASS: TestParseImage/test_case_2 (0.00s) --- PASS: TestParseImage/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/model/azuremodel 0.128s === RUN TestCloudConfigurationOptionsBuilder === RUN TestCloudConfigurationOptionsBuilder/neither === RUN TestCloudConfigurationOptionsBuilder/all_false === RUN TestCloudConfigurationOptionsBuilder/all_true === RUN TestCloudConfigurationOptionsBuilder/os_false === RUN TestCloudConfigurationOptionsBuilder/os_true === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_false,_os_true === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_false === RUN TestCloudConfigurationOptionsBuilder/all_true,_os_true --- PASS: TestCloudConfigurationOptionsBuilder (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/neither (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_false,_os_true (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_false (0.00s) --- PASS: TestCloudConfigurationOptionsBuilder/all_true,_os_true (0.00s) === RUN Test_Build_Containerd_Supported_Version --- PASS: Test_Build_Containerd_Supported_Version (0.00s) === RUN Test_Build_Containerd_Unneeded_Runtime --- PASS: Test_Build_Containerd_Unneeded_Runtime (0.00s) === RUN Test_Build_Containerd_Needed_Runtime --- PASS: Test_Build_Containerd_Needed_Runtime (0.00s) === RUN TestImage I0313 08:50:22.885638 23512 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestImage (0.00s) === RUN Test_Build_KCM_Builder --- PASS: Test_Build_KCM_Builder (0.00s) === RUN Test_Build_KCM_Builder_Change_Duration --- PASS: Test_Build_KCM_Builder_Change_Duration (0.00s) === RUN Test_Build_KCM_Builder_CIDR_Mask_Size === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: === RUN Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/100.64.1.0/11: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/65: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/32:2001:DB8::/65 (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/95: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/96: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/97: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/98: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/99: (0.00s) --- PASS: Test_Build_KCM_Builder_CIDR_Mask_Size/2001:DB8::/100: (0.00s) === RUN TestFeatureGatesKubernetesVersion --- PASS: TestFeatureGatesKubernetesVersion (0.00s) === RUN TestFeatureGatesOverride --- PASS: TestFeatureGatesOverride (0.00s) === RUN Test_Build_Scheduler_Without_PolicyConfigMap --- PASS: Test_Build_Scheduler_Without_PolicyConfigMap (0.00s) === RUN Test_Build_Scheduler_PolicyConfigMap_Supported_Version --- PASS: Test_Build_Scheduler_PolicyConfigMap_Supported_Version (0.00s) PASS ok k8s.io/kops/pkg/model/components 0.073s === RUN Test_RunEtcdManagerBuilder I0313 08:50:22.883877 23513 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunEtcdManagerBuilder/basedir=tests/minimal === RUN Test_RunEtcdManagerBuilder/basedir=tests/interval === RUN Test_RunEtcdManagerBuilder/basedir=tests/proxy === RUN Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings W0313 08:50:22.927498 23513 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 W0313 08:50:22.929559 23513 model.go:421] overriding log level in manifest (embedded etcd manifest), new level is 3 --- PASS: Test_RunEtcdManagerBuilder (0.05s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/minimal (0.02s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/interval (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/proxy (0.01s) --- PASS: Test_RunEtcdManagerBuilder/basedir=tests/overwrite_settings (0.01s) PASS ok k8s.io/kops/pkg/model/components/etcdmanager 0.119s === RUN Test_RunKubeApiserverBuilder I0313 08:50:22.911620 23514 featureflag.go:164] FeatureFlag "ImageDigest"=false === RUN Test_RunKubeApiserverBuilder/basedir=tests/minimal --- PASS: Test_RunKubeApiserverBuilder (0.02s) --- PASS: Test_RunKubeApiserverBuilder/basedir=tests/minimal (0.02s) PASS ok k8s.io/kops/pkg/model/components/kubeapiserver 0.126s === RUN Test_RunKubeSchedulerBuilder === RUN Test_RunKubeSchedulerBuilder/basedir=tests/minimal === RUN Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig === RUN Test_RunKubeSchedulerBuilder/basedir=tests/mixing --- PASS: Test_RunKubeSchedulerBuilder (0.03s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/minimal (0.02s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/kubeschedulerconfig (0.00s) --- PASS: Test_RunKubeSchedulerBuilder/basedir=tests/mixing (0.00s) PASS ok k8s.io/kops/pkg/model/components/kubescheduler 0.128s === RUN TestDefaultInstanceGroupVolumeSize --- PASS: TestDefaultInstanceGroupVolumeSize (0.00s) PASS ok k8s.io/kops/pkg/model/defaults 0.028s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) === RUN TestPolicyGeneration --- PASS: TestPolicyGeneration (0.00s) === RUN TestEmptyPolicy --- PASS: TestEmptyPolicy (0.00s) PASS ok k8s.io/kops/pkg/model/iam 0.064s === RUN TestServerGroupBuilder I0313 08:50:30.727511 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.738267 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.821223 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.838143 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.851602 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.869393 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.885126 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.948737 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.964617 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.977087 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.986078 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.997705 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:31.005047 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:31.011108 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:31.021087 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:31.028780 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:31.087493 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:31.093067 24422 featureflag.go:164] FeatureFlag "ImageDigest"=false --- PASS: TestServerGroupBuilder (0.37s) PASS ok k8s.io/kops/pkg/model/openstackmodel 0.471s === RUN Test_NodeUpTabs --- PASS: Test_NodeUpTabs (0.00s) PASS ok k8s.io/kops/pkg/model/resources 0.036s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetVMSSNameFromProviderID === RUN TestGetVMSSNameFromProviderID/test_case_0 === RUN TestGetVMSSNameFromProviderID/test_case_1 === RUN TestGetVMSSNameFromProviderID/test_case_2 --- PASS: TestGetVMSSNameFromProviderID (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_0 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_1 (0.00s) --- PASS: TestGetVMSSNameFromProviderID/test_case_2 (0.00s) === RUN TestIdentifyNode === RUN TestIdentifyNode/test_case_0 === RUN TestIdentifyNode/test_case_1 --- PASS: TestIdentifyNode (0.00s) --- PASS: TestIdentifyNode/test_case_0 (0.00s) --- PASS: TestIdentifyNode/test_case_1 (0.00s) PASS ok k8s.io/kops/pkg/nodeidentity/azure 0.039s === RUN TestBuildNodeLabels === RUN TestBuildNodeLabels/RoleControlPlane === RUN TestBuildNodeLabels/RoleNode --- PASS: TestBuildNodeLabels (0.00s) --- PASS: TestBuildNodeLabels/RoleControlPlane (0.00s) --- PASS: TestBuildNodeLabels/RoleNode (0.00s) PASS ok k8s.io/kops/pkg/nodelabels 0.034s === RUN TestGenerateCertificate === RUN TestGenerateCertificate/selfsigned === RUN TestGenerateCertificate/client === RUN TestGenerateCertificate/server --- PASS: TestGenerateCertificate (0.01s) --- PASS: TestGenerateCertificate/selfsigned (0.01s) --- PASS: TestGenerateCertificate/client (0.00s) --- PASS: TestGenerateCertificate/server (0.00s) === RUN TestCertificateRoundTrip --- PASS: TestCertificateRoundTrip (0.00s) === RUN TestIssueCert === RUN TestIssueCert/ca === RUN TestIssueCert/client === RUN TestIssueCert/clientOneYear === RUN TestIssueCert/#00 === RUN TestIssueCert/server --- PASS: TestIssueCert (2.30s) --- PASS: TestIssueCert/ca (0.60s) --- PASS: TestIssueCert/client (1.38s) --- PASS: TestIssueCert/clientOneYear (0.31s) --- PASS: TestIssueCert/#00 (0.00s) --- PASS: TestIssueCert/server (0.00s) === RUN TestPrivateKeyRoundTripRSA === RUN TestPrivateKeyRoundTripRSA/rsa === RUN TestPrivateKeyRoundTripRSA/ecdsa --- PASS: TestPrivateKeyRoundTripRSA (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/rsa (0.00s) --- PASS: TestPrivateKeyRoundTripRSA/ecdsa (0.00s) === RUN Test_AWSFingerprint_RsaKey1 --- PASS: Test_AWSFingerprint_RsaKey1 (0.00s) === RUN Test_AWSFingerprint_RsaKeyEncrypted --- PASS: Test_AWSFingerprint_RsaKeyEncrypted (0.00s) === RUN Test_AWSFingerprint_Ed25519Key --- PASS: Test_AWSFingerprint_Ed25519Key (0.00s) === RUN Test_AWSFingerprint_TrickyWhitespace --- PASS: Test_AWSFingerprint_TrickyWhitespace (0.00s) === RUN Test_AWSFingerprint_DsaKey --- PASS: Test_AWSFingerprint_DsaKey (0.00s) === RUN Test_OpenSSHFingerprint_RsaKey1 --- PASS: Test_OpenSSHFingerprint_RsaKey1 (0.00s) PASS ok k8s.io/kops/pkg/pki 2.310s === RUN TestLongDesc --- PASS: TestLongDesc (0.00s) PASS ok k8s.io/kops/pkg/pretty 0.005s === RUN TestAddUntaggedRouteTables I0313 08:50:30.711197 24430 routetable.go:53] DescribeRouteTables: { } W0313 08:50:30.711297 24430 tags.go:67] cluster tag not found on route-table:rtb-1234 I0313 08:50:30.711313 24430 aws.go:230] Skipping route table in VPC, but with wrong cluster tag ("other.example.com") --- PASS: TestAddUntaggedRouteTables (0.00s) === RUN TestListIAMInstanceProfiles I0313 08:50:30.711442 24430 iaminstanceprofile.go:193] ListInstanceProfiles: { } W0313 08:50:30.711502 24430 aws.go:2076] could not find instance profile "__no_entity__.me.example.com". Resource may already have been deleted: NoSuchEntity: No such entity --- PASS: TestListIAMInstanceProfiles (0.00s) === RUN TestListIAMRoles I0313 08:50:30.711589 24430 iamrole.go:89] ListRoles: { } --- PASS: TestListIAMRoles (0.00s) === RUN TestListRouteTables I0313 08:50:30.711676 24430 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["me.example.com"] }] } I0313 08:50:30.711741 24430 routetable.go:53] DescribeRouteTables: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/me.example.com"] }] } --- PASS: TestListRouteTables (0.00s) === RUN TestSharedVolume I0313 08:50:30.711807 24430 volumes.go:33] CreateVolume: { TagSpecifications: [{ ResourceType: "volume", Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "shared" }] }] } I0313 08:50:30.711890 24430 volumes.go:33] CreateVolume: { TagSpecifications: [{ Tags: [{ Key: "kubernetes.io/cluster/me.example.com", Value: "owned" }] }] } I0313 08:50:30.711942 24430 volumes.go:128] DescribeVolumes: { } W0313 08:50:30.711962 24430 aws.go:2229] (new) cluster tag not found on volume:vol-2 aws_test.go:334: 2 --- PASS: TestSharedVolume (0.00s) === RUN TestMatchesElbTags --- PASS: TestMatchesElbTags (0.00s) === RUN TestListVPCs I0313 08:50:30.712122 24430 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:30.712233 24430 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:30.712270 24430 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:30.712350 24430 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:30.712397 24430 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:30.712469 24430 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:30.712517 24430 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:30.712557 24430 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:30.712596 24430 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:30.712632 24430 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:30.712671 24430 tags.go:42] CreateTags { Resources: ["vpc-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "legacy.example.com" }] } I0313 08:50:30.712714 24430 tags.go:42] CreateTags { Resources: ["vpc-shared"], Tags: [{ Key: "kubernetes.io/cluster/shared.example.com", Value: "shared" }] } I0313 08:50:30.712756 24430 tags.go:42] CreateTags { Resources: ["vpc-shared-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "shared-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/shared-with-legacy.example.com", Value: "shared" }] } I0313 08:50:30.712807 24430 tags.go:42] CreateTags { Resources: ["vpc-owned"], Tags: [{ Key: "kubernetes.io/cluster/owned.example.com", Value: "owned" }] } I0313 08:50:30.712843 24430 tags.go:42] CreateTags { Resources: ["vpc-owned-with-legacy"], Tags: [{ Key: "KubernetesCluster", Value: "owned-with-legacy.example.com" },{ Key: "kubernetes.io/cluster/owned-with-legacy.example.com", Value: "owned" }] } I0313 08:50:30.712887 24430 tags.go:42] CreateTags { Resources: ["vpc-other"], Tags: [{ Key: "KubernetesCluster", Value: "other.example.com" },{ Key: "kubernetes.io/cluster/other.example.com", Value: "shared" }] } I0313 08:50:30.712935 24430 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["mismatch.example.com"] }] } I0313 08:50:30.712974 24430 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/mismatch.example.com"] }] } I0313 08:50:30.713010 24430 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["legacy.example.com"] }] } I0313 08:50:30.713043 24430 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/legacy.example.com"] }] } I0313 08:50:30.713077 24430 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared-with-legacy.example.com"] }] } I0313 08:50:30.713108 24430 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared-with-legacy.example.com"] }] } I0313 08:50:30.713143 24430 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["shared.example.com"] }] } I0313 08:50:30.713172 24430 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/shared.example.com"] }] } I0313 08:50:30.713206 24430 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned-with-legacy.example.com"] }] } I0313 08:50:30.713236 24430 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned-with-legacy.example.com"] }] } I0313 08:50:30.713269 24430 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:KubernetesCluster", Values: ["owned.example.com"] }] } I0313 08:50:30.713298 24430 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag-key", Values: ["kubernetes.io/cluster/owned.example.com"] }] } --- PASS: TestListVPCs (0.00s) PASS ok k8s.io/kops/pkg/resources/aws 0.079s === RUN TestListResourcesAzure --- PASS: TestListResourcesAzure (0.00s) === RUN TestIsOwnedByCluster === RUN TestIsOwnedByCluster/test_case_0 === RUN TestIsOwnedByCluster/test_case_1 === RUN TestIsOwnedByCluster/test_case_2 === RUN TestIsOwnedByCluster/test_case_3 --- PASS: TestIsOwnedByCluster (0.00s) --- PASS: TestIsOwnedByCluster/test_case_0 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_1 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_2 (0.00s) --- PASS: TestIsOwnedByCluster/test_case_3 (0.00s) PASS ok k8s.io/kops/pkg/resources/azure 0.030s === RUN TestNameMatch --- PASS: TestNameMatch (0.00s) === RUN TestMatchesClusterNameWithUUID --- PASS: TestMatchesClusterNameWithUUID (0.00s) PASS ok k8s.io/kops/pkg/resources/gce 0.069s === RUN TestEscapeCommand --- PASS: TestEscapeCommand (0.00s) === RUN TestRawManifest --- PASS: TestRawManifest (0.00s) === RUN TestRawMixedManifest --- PASS: TestRawMixedManifest (0.00s) === RUN TestKeyPairOnlyManifest --- PASS: TestKeyPairOnlyManifest (0.00s) === RUN TestUnitFileExtensionValid === RUN TestUnitFileExtensionValid/valid_extension:_.automount === RUN TestUnitFileExtensionValid/valid_extension:_.device === RUN TestUnitFileExtensionValid/valid_extension:_.mount === RUN TestUnitFileExtensionValid/valid_extension:_.path === RUN TestUnitFileExtensionValid/valid_extension:_.scope === RUN TestUnitFileExtensionValid/valid_extension:_.service === RUN TestUnitFileExtensionValid/valid_extension:_.slice === RUN TestUnitFileExtensionValid/valid_extension:_.socket === RUN TestUnitFileExtensionValid/valid_extension:_.swap === RUN TestUnitFileExtensionValid/valid_extension:_.target === RUN TestUnitFileExtensionValid/valid_extension:_.timer === RUN TestUnitFileExtensionValid/invalid_extension:_(no_extension) === RUN TestUnitFileExtensionValid/invalid_extension:_.not-valid --- PASS: TestUnitFileExtensionValid (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.automount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.device (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.mount (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.path (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.scope (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.service (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.slice (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.socket (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.swap (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.target (0.00s) --- PASS: TestUnitFileExtensionValid/valid_extension:_.timer (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_(no_extension) (0.00s) --- PASS: TestUnitFileExtensionValid/invalid_extension:_.not-valid (0.00s) PASS ok k8s.io/kops/pkg/systemd 0.005s === RUN TestTruncateString === RUN TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false === RUN TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true === RUN TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false --- PASS: TestTruncateString (0.00s) --- PASS: TestTruncateString/input:foo/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_33_characters_long/maxLength:64/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:false (0.00s) --- PASS: TestTruncateString/input:this_string_is_longer_it_is_46_characters_long/maxLength:32/alwaysAddHash:true (0.00s) --- PASS: TestTruncateString/input:this_string_is_even_longer_due_to_extreme_verbosity_it_is_in_fact_84_characters_long/maxLength:64/alwaysAddHash:false (0.00s) PASS ok k8s.io/kops/pkg/truncate 0.005s === RUN TestJoin --- PASS: TestJoin (0.00s) PASS ok k8s.io/kops/pkg/urls 0.005s === RUN TestRoundTrip --- PASS: TestRoundTrip (0.00s) PASS ok k8s.io/kops/pkg/util/stringorslice 0.005s === RUN Test_Overlap --- PASS: Test_Overlap (0.00s) === RUN Test_BelongsTo --- PASS: Test_BelongsTo (0.00s) === RUN Test_SplitInto8 --- PASS: Test_SplitInto8 (0.00s) PASS ok k8s.io/kops/pkg/util/subnet 0.004s === RUN TestRenderGeneralOK --- PASS: TestRenderGeneralOK (0.01s) === RUN TestRenderMissingValue --- PASS: TestRenderMissingValue (0.00s) === RUN TestRenderIndent --- PASS: TestRenderIndent (0.00s) === RUN TestRenderChannelFunctions --- PASS: TestRenderChannelFunctions (0.00s) === RUN TestRenderSnippet --- PASS: TestRenderSnippet (0.00s) === RUN TestRenderContext --- PASS: TestRenderContext (0.00s) === RUN TestAllowForMissingVars --- PASS: TestAllowForMissingVars (0.00s) === RUN TestRenderIntegration --- PASS: TestRenderIntegration (0.00s) PASS ok k8s.io/kops/pkg/util/templater 0.048s === RUN Test_ValidateCloudGroupMissing --- PASS: Test_ValidateCloudGroupMissing (0.00s) === RUN Test_ValidateNodesNotEnough --- PASS: Test_ValidateNodesNotEnough (0.00s) === RUN Test_ValidateDetachedNodesDontCount --- PASS: Test_ValidateDetachedNodesDontCount (0.00s) === RUN Test_ValidateNodeNotReady --- PASS: Test_ValidateNodeNotReady (0.00s) === RUN Test_ValidateMastersNotEnough --- PASS: Test_ValidateMastersNotEnough (0.00s) === RUN Test_ValidateMasterNotReady --- PASS: Test_ValidateMasterNotReady (0.00s) === RUN Test_ValidateMasterStaticPods --- PASS: Test_ValidateMasterStaticPods (0.00s) === RUN Test_ValidateNoPodFailures --- PASS: Test_ValidateNoPodFailures (0.00s) === RUN Test_ValidatePodFailure === RUN Test_ValidatePodFailure/pending-node-kube-system === RUN Test_ValidatePodFailure/pending-node-kube-system#01 === RUN Test_ValidatePodFailure/pending-node-kube-system#02 === RUN Test_ValidatePodFailure/pending-node-otherNamespace === RUN Test_ValidatePodFailure/pending-node-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-node-otherNamespace#02 === RUN Test_ValidatePodFailure/pending-cluster-kube-system === RUN Test_ValidatePodFailure/pending-cluster-kube-system#01 === RUN Test_ValidatePodFailure/pending-cluster-kube-system#02 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/pending-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-node-kube-system === RUN Test_ValidatePodFailure/notready-node-kube-system#01 === RUN Test_ValidatePodFailure/notready-node-kube-system#02 === RUN Test_ValidatePodFailure/notready-node-otherNamespace === RUN Test_ValidatePodFailure/notready-node-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-node-otherNamespace#02 === RUN Test_ValidatePodFailure/notready-cluster-kube-system === RUN Test_ValidatePodFailure/notready-cluster-kube-system#01 === RUN Test_ValidatePodFailure/notready-cluster-kube-system#02 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/notready-cluster-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-node-kube-system === RUN Test_ValidatePodFailure/unknown-node-kube-system#01 === RUN Test_ValidatePodFailure/unknown-node-kube-system#02 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-node-otherNamespace#02 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#01 === RUN Test_ValidatePodFailure/unknown-cluster-kube-system#02 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 === RUN Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 --- PASS: Test_ValidatePodFailure (0.01s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/pending-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/notready-cluster-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-node-otherNamespace#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-kube-system#02 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#01 (0.00s) --- PASS: Test_ValidatePodFailure/unknown-cluster-otherNamespace#02 (0.00s) === RUN Test_ValidateBastionNodes === RUN Test_ValidateBastionNodes/instancegroup's_nodes_not_ready === RUN Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready --- PASS: Test_ValidateBastionNodes (0.00s) --- PASS: Test_ValidateBastionNodes/instancegroup's_nodes_not_ready (0.00s) --- PASS: Test_ValidateBastionNodes/bastion_instancegroup_nodes_not_ready (0.00s) === RUN Test_ValidateDetachedNodesNotValidated --- PASS: Test_ValidateDetachedNodesNotValidated (0.00s) PASS ok k8s.io/kops/pkg/validation 0.089s === RUN TestUnmarshalMetadata --- PASS: TestUnmarshalMetadata (0.00s) === RUN TestGetInternalIP --- PASS: TestGetInternalIP (0.00s) === RUN TestGetSeeds --- PASS: TestGetSeeds (0.00s) PASS ok k8s.io/kops/protokube/pkg/gossip/azure 0.014s === RUN TestRemovesDuplicateGuardedBlocks W0313 08:50:38.564429 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.564485 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.564491 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.564497 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.564502 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.564507 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.564511 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.564516 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.564520 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.564525 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.564529 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.564534 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.564538 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.564543 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.564547 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.564551 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.578077 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.578122 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.578191 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.578201 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.578255 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.578264 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.578322 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.578331 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.578380 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.578390 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.578451 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.578461 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.578512 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.578521 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.578606 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.578622 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.578713 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.578730 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.578809 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.578823 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.578903 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.578917 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.579027 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.579043 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.579133 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.579144 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.579204 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.579213 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.579274 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.579284 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.579356 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.579366 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.579433 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.579447 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.579519 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.579532 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.579643 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.579661 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.579800 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.579814 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.579883 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.579896 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.579992 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.580005 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.580080 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.580094 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.580184 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.580198 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.580293 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.580306 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.580375 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.580406 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.580486 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.580500 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.580573 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.580586 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.580660 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.580673 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.580744 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.580757 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.580832 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.580845 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.580937 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.580953 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.581045 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.581059 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.581134 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.581147 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.581221 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.581233 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.581315 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.581328 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.581409 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.581422 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.581511 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.581524 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.581593 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.581606 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.581692 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.581706 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.581804 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.581821 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.581887 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.581897 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.582036 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.582048 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.582140 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.582156 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.582237 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.582253 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.582403 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.582420 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.582503 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.582519 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.582611 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.582625 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.582718 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.582734 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.582815 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.582829 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.582922 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.582988 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.583083 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.583099 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.583174 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.583188 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.583285 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.583300 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.583379 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.583390 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.583458 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.583467 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.583517 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.583526 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.583574 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.583583 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.583638 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.583652 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.583704 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.583717 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.583788 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.583797 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.583847 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.583855 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.583947 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.583958 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584037 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584056 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584110 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584119 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584168 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584176 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584231 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584240 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584291 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584299 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584352 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584362 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584411 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584420 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584468 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584476 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584534 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584555 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584619 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584633 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584703 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584716 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584793 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584806 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584886 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.584899 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.584988 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.585001 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.585083 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.585100 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.585166 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.585179 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.585271 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.585286 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.585351 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.585364 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.585432 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.585444 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.585521 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.585534 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.585642 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.585657 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.585774 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.585788 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.585867 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.585883 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.585955 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.585967 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.586053 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.586067 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.586151 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.586165 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.586243 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.586256 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.586345 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.586398 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.586481 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.586492 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.586545 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.586554 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.586610 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.586619 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.586670 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.586678 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.586747 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.586757 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.586813 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.586822 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.586876 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.586885 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.586931 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.586940 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRemovesDuplicateGuardedBlocks (0.02s) === RUN TestRecoversFromBadNesting W0313 08:50:38.587402 25767 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0313 08:50:38.587413 25767 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0313 08:50:38.587421 25767 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0313 08:50:38.587426 25767 hosts.go:144] /etc/hosts guard-block end seen before guard-block start; will ignore end W0313 08:50:38.587433 25767 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0313 08:50:38.587438 25767 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0313 08:50:38.587443 25767 hosts.go:131] /etc/hosts guard-block begin seen while in guard block; will ignore W0313 08:50:38.587467 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.587483 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.587494 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.587504 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.587514 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.587522 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.587530 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.587536 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.587541 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.587547 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.587552 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.587558 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.587564 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.587569 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.587575 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.587580 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.607039 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.607074 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.607195 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.607212 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.607303 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.607324 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.607420 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.607437 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.607572 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.607589 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.607691 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.607708 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.607799 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.607816 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.607906 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.607922 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.608015 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.608030 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.608117 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.608132 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.608216 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.608238 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.608329 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.608345 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.608456 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.608472 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.608559 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.608574 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.608679 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.608697 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.608786 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.608802 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.608903 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.608919 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.609004 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.609020 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.609104 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.609119 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.609243 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.609260 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.609345 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.609361 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.609449 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.609465 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.609548 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.609563 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.609669 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.609685 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.609801 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.609818 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.609937 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.609953 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610065 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610091 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610162 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610173 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610244 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610254 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610302 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610311 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610360 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610369 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610423 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610432 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610479 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610488 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610534 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610543 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610589 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610597 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610650 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610659 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610706 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610715 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610784 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610794 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610853 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610870 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610922 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610931 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.610978 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.610987 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611033 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611042 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611099 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611107 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611161 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611170 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611232 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611241 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611290 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611299 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611346 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611354 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611427 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611443 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611500 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611510 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611557 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611569 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611635 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611645 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611704 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611721 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611770 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611779 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611846 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611855 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611903 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.611911 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.611998 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612010 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612058 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612067 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612118 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612127 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612183 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612192 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612243 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612252 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612301 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612310 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612363 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612376 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612442 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612452 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612521 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612530 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612579 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612587 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612646 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612656 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612703 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612711 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612763 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612772 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612834 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612844 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612892 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612901 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.612951 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.612962 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613020 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613029 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613077 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613086 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613144 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613153 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613217 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613227 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613282 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613291 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613355 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613364 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613441 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613451 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613498 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613507 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613567 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613576 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613630 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613639 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613687 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613696 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613746 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613756 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613812 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613826 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613896 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613907 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.613956 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.613965 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614024 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614034 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614085 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614093 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614151 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614161 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614224 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614233 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614282 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614290 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614350 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614359 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614408 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614417 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614464 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614472 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614518 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614527 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614579 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614588 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614635 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614644 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614690 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614708 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" W0313 08:50:38.614765 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# Begin host entries managed by kops - do not edit" W0313 08:50:38.614774 25767 hosts.go:57] ignoring extra guard line in /etc/hosts: "# End host entries managed by kops" --- PASS: TestRecoversFromBadNesting (0.03s) PASS ok k8s.io/kops/protokube/pkg/gossip/dns/hosts 0.063s === RUN TestSerializeEmptyCluster --- PASS: TestSerializeEmptyCluster (0.01s) PASS ok k8s.io/kops/tests/codecs 0.043s === RUN TestKopsUpgrades --- PASS: TestKopsUpgrades (0.01s) === RUN TestKubernetesUpgrades --- PASS: TestKubernetesUpgrades (0.00s) === RUN TestFindImage --- PASS: TestFindImage (0.00s) === RUN TestRecommendedKubernetesVersion --- PASS: TestRecommendedKubernetesVersion (0.00s) === RUN TestOrdering --- PASS: TestOrdering (0.00s) === RUN TestChannelsSelfConsistent --- PASS: TestChannelsSelfConsistent (0.02s) === RUN TestChannelImages === RUN TestChannelImages/stable-channel === RUN TestChannelImages/alpha-channel --- PASS: TestChannelImages (0.00s) --- PASS: TestChannelImages/stable-channel (0.00s) --- PASS: TestChannelImages/alpha-channel (0.00s) PASS ok k8s.io/kops/tests/integration/channel 0.069s === RUN TestConversionMinimal === RUN TestConversionMinimal/legacy-v1alpha2-v1alpha2 --- PASS: TestConversionMinimal (0.02s) --- PASS: TestConversionMinimal/legacy-v1alpha2-v1alpha2 (0.02s) PASS ok k8s.io/kops/tests/integration/conversion 0.060s === RUN Test_tryResourceAsString --- PASS: Test_tryResourceAsString (0.00s) === RUN Test_DryrunTarget_PrintReport --- PASS: Test_DryrunTarget_PrintReport (0.00s) === RUN TestWriteFile I0313 08:50:38.583108 25771 files.go:57] Writing file "/tmp/TestWriteFile911383640/001/SubDir/test1.tmp" I0313 08:50:38.583236 25771 files.go:113] Changing file mode for "/tmp/TestWriteFile911383640/001/SubDir/test1.tmp" to -rw-r--r-- --- PASS: TestWriteFile (0.00s) === RUN TestBigInt_Format --- PASS: TestBigInt_Format (0.00s) === RUN TestVFSCAStoreRoundTrip --- PASS: TestVFSCAStoreRoundTrip (0.01s) === RUN TestAddItem === RUN TestAddItem/first_primary === RUN TestAddItem/first_secondary === RUN TestAddItem/firstBigSerial_primary === RUN TestAddItem/firstBigSerial_secondary === RUN TestAddItem/after_primary === RUN TestAddItem/after_secondary === RUN TestAddItem/bigSerialAfter_primary === RUN TestAddItem/bigSerialAfter_secondary === RUN TestAddItem/before_primary === RUN TestAddItem/before_secondary === RUN TestAddItem/first_certonly_primary === RUN TestAddItem/first_certonly_secondary === RUN TestAddItem/after_certonly_primary === RUN TestAddItem/after_certonly_secondary === RUN TestAddItem/before_certonly_primary === RUN TestAddItem/before_certonly_secondary --- PASS: TestAddItem (0.00s) --- PASS: TestAddItem/first_primary (0.00s) --- PASS: TestAddItem/first_secondary (0.00s) --- PASS: TestAddItem/firstBigSerial_primary (0.00s) --- PASS: TestAddItem/firstBigSerial_secondary (0.00s) --- PASS: TestAddItem/after_primary (0.00s) --- PASS: TestAddItem/after_secondary (0.00s) --- PASS: TestAddItem/bigSerialAfter_primary (0.00s) --- PASS: TestAddItem/bigSerialAfter_secondary (0.00s) --- PASS: TestAddItem/before_primary (0.00s) --- PASS: TestAddItem/before_secondary (0.00s) --- PASS: TestAddItem/first_certonly_primary (0.00s) --- PASS: TestAddItem/first_certonly_secondary (0.00s) --- PASS: TestAddItem/after_certonly_primary (0.00s) --- PASS: TestAddItem/after_certonly_secondary (0.00s) --- PASS: TestAddItem/before_certonly_primary (0.00s) --- PASS: TestAddItem/before_certonly_secondary (0.00s) PASS ok k8s.io/kops/upup/pkg/fi 0.040s === RUN TestBootstrapChannelBuilder_BuildTasks I0313 08:50:43.750960 26669 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:43.751216 26669 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:43.751316 26669 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:43.751416 26669 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:43.751509 26669 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:43.751628 26669 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:43.751728 26669 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:43.751795 26669 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:43.751881 26669 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:43.751971 26669 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:43.766083 26669 zones.go:93] ListHostedZonesPages { } I0313 08:50:43.920094 26669 zones.go:93] ListHostedZonesPages { } I0313 08:50:44.078396 26669 zones.go:93] ListHostedZonesPages { } I0313 08:50:44.211356 26669 zones.go:93] ListHostedZonesPages { } I0313 08:50:44.365881 26669 zones.go:93] ListHostedZonesPages { } I0313 08:50:44.520349 26669 zones.go:93] ListHostedZonesPages { } I0313 08:50:44.641436 26669 zones.go:93] ListHostedZonesPages { } I0313 08:50:44.795530 26669 zones.go:93] ListHostedZonesPages { } I0313 08:50:45.350506 26669 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_BuildTasks (1.70s) === RUN TestBootstrapChannelBuilder_ServiceAccountIAM I0313 08:50:45.448723 26669 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:45.448815 26669 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:45.448902 26669 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:45.448950 26669 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:45.448978 26669 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:45.449025 26669 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:45.449066 26669 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:45.449092 26669 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:45.449129 26669 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:45.449150 26669 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:45.449173 26669 featureflag.go:167] Unknown FeatureFlag "+UseServiceAccountExternalPermissions" I0313 08:50:45.450719 26669 zones.go:93] ListHostedZonesPages { } I0313 08:50:45.594111 26669 featureflag.go:167] Unknown FeatureFlag "-UseServiceAccountExternalPermissions" --- PASS: TestBootstrapChannelBuilder_ServiceAccountIAM (0.15s) === RUN TestBootstrapChannelBuilder_AWSCloudController I0313 08:50:45.594282 26669 featureflag.go:164] FeatureFlag "ImageDigest"=false I0313 08:50:45.594383 26669 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:45.594444 26669 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { VpcId: "vpc-12345678" } I0313 08:50:45.594492 26669 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-12345678" } I0313 08:50:45.594535 26669 subnets.go:185] AuthorizeSecurityGroupIngress: { RouteTableId: "rtb-12345678", SubnetId: "subnet-abcdef" } I0313 08:50:45.594586 26669 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-1" } I0313 08:50:45.594626 26669 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-2" } I0313 08:50:45.594656 26669 targetgroups.go:94] CreateTargetGroup { Name: "my-external-tg-3" } I0313 08:50:45.594693 26669 iaminstanceprofile.go:56] CreateInstanceProfile: { InstanceProfileName: "kops-custom-node-role" } I0313 08:50:45.594721 26669 iaminstanceprofile.go:128] AddRoleToInstanceProfile: { InstanceProfileName: "kops-custom-node-role", RoleName: "kops-custom-node-role" } I0313 08:50:45.596432 26669 zones.go:93] ListHostedZonesPages { } --- PASS: TestBootstrapChannelBuilder_AWSCloudController (0.12s) === RUN TestContainerdVersionUrl === RUN TestContainerdVersionUrl/1.4.1- === RUN TestContainerdVersionUrl/1.4.1-arm === RUN TestContainerdVersionUrl/-amd64 === RUN TestContainerdVersionUrl/-arm64 === RUN TestContainerdVersionUrl/1.1.1-amd64 === RUN TestContainerdVersionUrl/1.1.1-arm64 === RUN TestContainerdVersionUrl/1.6.5-amd64 === RUN TestContainerdVersionUrl/1.5.5-arm64 --- PASS: TestContainerdVersionUrl (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1- (0.00s) --- PASS: TestContainerdVersionUrl/1.4.1-arm (0.00s) --- PASS: TestContainerdVersionUrl/-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.1.1-arm64 (0.00s) --- PASS: TestContainerdVersionUrl/1.6.5-amd64 (0.00s) --- PASS: TestContainerdVersionUrl/1.5.5-arm64 (0.00s) === RUN TestDeepValidate_OK --- PASS: TestDeepValidate_OK (0.00s) === RUN TestDeepValidate_NoNodeZones --- PASS: TestDeepValidate_NoNodeZones (0.00s) === RUN TestDeepValidate_NoMasterZones --- PASS: TestDeepValidate_NoMasterZones (0.00s) === RUN TestDeepValidate_BadZone deepvalidate_test.go:58: Zone validation not checked by DeepValidate --- SKIP: TestDeepValidate_BadZone (0.00s) === RUN TestDeepValidate_MixedRegion deepvalidate_test.go:70: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_MixedRegion (0.00s) === RUN TestDeepValidate_RegionAsZone deepvalidate_test.go:84: Region validation not checked by DeepValidate --- SKIP: TestDeepValidate_RegionAsZone (0.00s) === RUN TestDeepValidate_NotIncludedZone --- PASS: TestDeepValidate_NotIncludedZone (0.00s) === RUN TestDeepValidate_DuplicateZones --- PASS: TestDeepValidate_DuplicateZones (0.00s) === RUN TestDeepValidate_ExtraMasterZone --- PASS: TestDeepValidate_ExtraMasterZone (0.00s) === RUN TestDeepValidate_EvenEtcdClusterSize --- PASS: TestDeepValidate_EvenEtcdClusterSize (0.00s) === RUN TestDeepValidate_MissingEtcdMember --- PASS: TestDeepValidate_MissingEtcdMember (0.00s) === RUN TestPopulateClusterSpec_Proxy --- PASS: TestPopulateClusterSpec_Proxy (0.00s) === RUN TestPrecreateDNSNames --- PASS: TestPrecreateDNSNames (0.00s) === RUN TestDockerVersionUrlHash === RUN TestDockerVersionUrlHash/19.03.13-amd64 === RUN TestDockerVersionUrlHash/19.03.13-arm64 === RUN TestDockerVersionUrlHash/18.06.3-amd64 === RUN TestDockerVersionUrlHash/18.06.3-arm64 === RUN TestDockerVersionUrlHash/17.03.1-amd64 === RUN TestDockerVersionUrlHash/17.03.1-arm64 --- PASS: TestDockerVersionUrlHash (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/19.03.13-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-amd64 (0.00s) --- PASS: TestDockerVersionUrlHash/17.03.1-arm64 (0.00s) === RUN TestDockerVersionUrl === RUN TestDockerVersionUrl/19.03.13- === RUN TestDockerVersionUrl/19.03.13-arm === RUN TestDockerVersionUrl/-amd64 === RUN TestDockerVersionUrl/-arm64 === RUN TestDockerVersionUrl/18.06.3-amd64 === RUN TestDockerVersionUrl/18.06.3-arm64 === RUN TestDockerVersionUrl/19.03.13-amd64 === RUN TestDockerVersionUrl/19.03.13-arm64 --- PASS: TestDockerVersionUrl (0.00s) --- PASS: TestDockerVersionUrl/19.03.13- (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm (0.00s) --- PASS: TestDockerVersionUrl/-amd64 (0.00s) --- PASS: TestDockerVersionUrl/-arm64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-amd64 (0.00s) --- PASS: TestDockerVersionUrl/18.06.3-arm64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionUrl/19.03.13-arm64 (0.00s) === RUN TestDockerVersionHash === RUN TestDockerVersionHash/19.03.13- === RUN TestDockerVersionHash/19.03.13-arm === RUN TestDockerVersionHash/-amd64 === RUN TestDockerVersionHash/-arm64 === RUN TestDockerVersionHash/1.1.1-amd64 === RUN TestDockerVersionHash/1.1.1-arm64 === RUN TestDockerVersionHash/19.03.13-amd64 === RUN TestDockerVersionHash/19.03.13-arm64 --- PASS: TestDockerVersionHash (0.00s) --- PASS: TestDockerVersionHash/19.03.13- (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm (0.00s) --- PASS: TestDockerVersionHash/-amd64 (0.00s) --- PASS: TestDockerVersionHash/-arm64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-amd64 (0.00s) --- PASS: TestDockerVersionHash/1.1.1-arm64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-amd64 (0.00s) --- PASS: TestDockerVersionHash/19.03.13-arm64 (0.00s) === RUN TestDockerVersionsHashesAmd64 docker_test.go:245: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesAmd64 (0.00s) === RUN TestDockerVersionsHashesArm64 docker_test.go:260: VERIFY_HASHES not set, won't download & verify docker hashes --- SKIP: TestDockerVersionsHashesArm64 (0.00s) === RUN Test_FindCNIAssetFromEnvironmentVariable --- PASS: Test_FindCNIAssetFromEnvironmentVariable (0.00s) === RUN Test_FindCNIAssetFromDefaults122 --- PASS: Test_FindCNIAssetFromDefaults122 (0.09s) === RUN TestRemoveSharedPrefix --- PASS: TestRemoveSharedPrefix (0.00s) === RUN TestCreateEtcdCluster --- PASS: TestCreateEtcdCluster (0.00s) === RUN TestSetupNetworking W0313 08:50:45.820950 26669 new_cluster.go:1152] flannel UDP mode is not recommended; consider flannel-vxlan instead --- PASS: TestSetupNetworking (0.00s) === RUN TestDefaultImage --- PASS: TestDefaultImage (0.00s) === RUN TestPopulateCluster_Default_NoError --- PASS: TestPopulateCluster_Default_NoError (0.00s) === RUN TestPopulateCluster_Subnets === RUN TestPopulateCluster_Subnets/100.64.0.0/10 === RUN TestPopulateCluster_Subnets/10.0.0.0/9 === RUN TestPopulateCluster_Subnets/10.0.0.0/8 === RUN TestPopulateCluster_Subnets/::/0 --- PASS: TestPopulateCluster_Subnets (0.01s) --- PASS: TestPopulateCluster_Subnets/100.64.0.0/10 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/9 (0.00s) --- PASS: TestPopulateCluster_Subnets/10.0.0.0/8 (0.00s) --- PASS: TestPopulateCluster_Subnets/::/0 (0.00s) === RUN TestPopulateCluster_Docker_Spec --- PASS: TestPopulateCluster_Docker_Spec (0.00s) === RUN TestPopulateCluster_StorageDefault --- PASS: TestPopulateCluster_StorageDefault (0.00s) === RUN TestPopulateCluster_EvictionHard --- PASS: TestPopulateCluster_EvictionHard (0.00s) === RUN TestPopulateCluster_Custom_CIDR --- PASS: TestPopulateCluster_Custom_CIDR (0.00s) === RUN TestPopulateCluster_IsolateMasters --- PASS: TestPopulateCluster_IsolateMasters (0.00s) === RUN TestPopulateCluster_IsolateMastersFalse --- PASS: TestPopulateCluster_IsolateMastersFalse (0.00s) === RUN TestPopulateCluster_Name_Required --- PASS: TestPopulateCluster_Name_Required (0.00s) === RUN TestPopulateCluster_Zone_Required --- PASS: TestPopulateCluster_Zone_Required (0.00s) === RUN TestPopulateCluster_NetworkCIDR_Required --- PASS: TestPopulateCluster_NetworkCIDR_Required (0.00s) === RUN TestPopulateCluster_NonMasqueradeCIDR_Required --- PASS: TestPopulateCluster_NonMasqueradeCIDR_Required (0.00s) === RUN TestPopulateCluster_CloudProvider_Required --- PASS: TestPopulateCluster_CloudProvider_Required (0.00s) === RUN TestPopulateCluster_APIServerCount --- PASS: TestPopulateCluster_APIServerCount (0.00s) === RUN TestPopulateCluster_AnonymousAuth --- PASS: TestPopulateCluster_AnonymousAuth (0.00s) === RUN TestPopulateCluster_DockerVersion --- PASS: TestPopulateCluster_DockerVersion (0.00s) === RUN TestPopulateCluster_KubeController_High_Enough_Version --- PASS: TestPopulateCluster_KubeController_High_Enough_Version (0.00s) === RUN TestPopulateInstanceGroup_Name_Required --- PASS: TestPopulateInstanceGroup_Name_Required (0.00s) === RUN TestPopulateInstanceGroup_Role_Required --- PASS: TestPopulateInstanceGroup_Role_Required (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision --- PASS: TestPopulateInstanceGroup_AddTaintsCollision (0.00s) === RUN TestPopulateInstanceGroup_AddTaintsCollision3 --- PASS: TestPopulateInstanceGroup_AddTaintsCollision3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard --- PASS: TestPopulateInstanceGroup_EvictionHard (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard3 --- PASS: TestPopulateInstanceGroup_EvictionHard3 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard4 --- PASS: TestPopulateInstanceGroup_EvictionHard4 (0.00s) === RUN TestPopulateInstanceGroup_EvictionHard2 --- PASS: TestPopulateInstanceGroup_EvictionHard2 (0.00s) === RUN TestPopulateInstanceGroup_AddTaints --- PASS: TestPopulateInstanceGroup_AddTaints (0.00s) === RUN TestMachineArchitecture === RUN TestMachineArchitecture/t2.micro-amd64 === RUN TestMachineArchitecture/t3.micro-amd64 === RUN TestMachineArchitecture/a1.large-arm64 --- PASS: TestMachineArchitecture (0.00s) --- PASS: TestMachineArchitecture/t2.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/t3.micro-amd64 (0.00s) --- PASS: TestMachineArchitecture/a1.large-arm64 (0.00s) === RUN TestRuncVersionUrlHash === RUN TestRuncVersionUrlHash/1.100.0-amd64 === RUN TestRuncVersionUrlHash/1.100.0-arm64 === RUN TestRuncVersionUrlHash/1.1.0-amd64 === RUN TestRuncVersionUrlHash/1.1.0-arm64 --- PASS: TestRuncVersionUrlHash (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrlHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionUrl === RUN TestRuncVersionUrl/1.1.0- === RUN TestRuncVersionUrl/1.1.0-arm === RUN TestRuncVersionUrl/-amd64 === RUN TestRuncVersionUrl/-arm64 === RUN TestRuncVersionUrl/1.0.0-amd64 === RUN TestRuncVersionUrl/1.0.0-arm64 === RUN TestRuncVersionUrl/1.1.0-amd64 === RUN TestRuncVersionUrl/1.1.0-arm64 --- PASS: TestRuncVersionUrl (0.00s) --- PASS: TestRuncVersionUrl/1.1.0- (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm (0.00s) --- PASS: TestRuncVersionUrl/-amd64 (0.00s) --- PASS: TestRuncVersionUrl/-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionUrl/1.1.0-arm64 (0.00s) === RUN TestRuncVersionHash === RUN TestRuncVersionHash/1.1.0- === RUN TestRuncVersionHash/1.1.0-arm === RUN TestRuncVersionHash/-amd64 === RUN TestRuncVersionHash/-arm64 === RUN TestRuncVersionHash/1.0.0-amd64 === RUN TestRuncVersionHash/1.0.0-arm64 === RUN TestRuncVersionHash/1.100.0-amd64 === RUN TestRuncVersionHash/1.100.0-arm64 === RUN TestRuncVersionHash/1.1.0-amd64 === RUN TestRuncVersionHash/1.1.0-arm64 --- PASS: TestRuncVersionHash (0.00s) --- PASS: TestRuncVersionHash/1.1.0- (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm (0.00s) --- PASS: TestRuncVersionHash/-amd64 (0.00s) --- PASS: TestRuncVersionHash/-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.0.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.100.0-arm64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-amd64 (0.00s) --- PASS: TestRuncVersionHash/1.1.0-arm64 (0.00s) === RUN TestRuncVersionsHashesAmd64 runc_test.go:240: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesAmd64 (0.00s) === RUN TestRuncVersionsHashesArm64 runc_test.go:255: VERIFY_HASHES not set, won't download & verify runc hashes --- SKIP: TestRuncVersionsHashesArm64 (0.00s) === RUN Test_AssignSubnets === RUN Test_AssignSubnets/test-1 === RUN Test_AssignSubnets/test-2 I0313 08:50:45.875980 26669 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-3 I0313 08:50:45.876087 26669 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet a I0313 08:50:45.876106 26669 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-4 I0313 08:50:45.876209 26669 subnets.go:224] Assigned CIDR 10.0.0.0/9 to subnet b I0313 08:50:45.876229 26669 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-5 I0313 08:50:45.876332 26669 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-6 I0313 08:50:45.876434 26669 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet b === RUN Test_AssignSubnets/test-7 I0313 08:50:45.876540 26669 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0313 08:50:45.876567 26669 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-8 I0313 08:50:45.876674 26669 subnets.go:205] Assigned CIDR 10.0.0.0/12 to subnet a I0313 08:50:45.876702 26669 subnets.go:224] Assigned CIDR 10.128.0.0/9 to subnet a === RUN Test_AssignSubnets/test-9 === RUN Test_AssignSubnets/test-10 I0313 08:50:45.876877 26669 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-11 === RUN Test_AssignSubnets/test-12 I0313 08:50:45.877045 26669 subnets.go:224] Assigned CIDR 10.0.0.0/8 to subnet a === RUN Test_AssignSubnets/test-13 I0313 08:50:45.877157 26669 subnets.go:205] Assigned CIDR 10.0.0.0/14 to subnet a I0313 08:50:45.877181 26669 subnets.go:205] Assigned CIDR 10.4.0.0/14 to subnet b I0313 08:50:45.877200 26669 subnets.go:205] Assigned CIDR 10.8.0.0/14 to subnet c I0313 08:50:45.877240 26669 subnets.go:224] Assigned CIDR 10.32.0.0/11 to subnet a I0313 08:50:45.877257 26669 subnets.go:224] Assigned CIDR 10.64.0.0/11 to subnet b I0313 08:50:45.877274 26669 subnets.go:224] Assigned CIDR 10.96.0.0/11 to subnet b I0313 08:50:45.877294 26669 subnets.go:224] Assigned CIDR 10.128.0.0/11 to subnet c I0313 08:50:45.877313 26669 subnets.go:224] Assigned CIDR 10.160.0.0/11 to subnet c --- PASS: Test_AssignSubnets (0.00s) --- PASS: Test_AssignSubnets/test-1 (0.00s) --- PASS: Test_AssignSubnets/test-2 (0.00s) --- PASS: Test_AssignSubnets/test-3 (0.00s) --- PASS: Test_AssignSubnets/test-4 (0.00s) --- PASS: Test_AssignSubnets/test-5 (0.00s) --- PASS: Test_AssignSubnets/test-6 (0.00s) --- PASS: Test_AssignSubnets/test-7 (0.00s) --- PASS: Test_AssignSubnets/test-8 (0.00s) --- PASS: Test_AssignSubnets/test-9 (0.00s) --- PASS: Test_AssignSubnets/test-10 (0.00s) --- PASS: Test_AssignSubnets/test-11 (0.00s) --- PASS: Test_AssignSubnets/test-12 (0.00s) --- PASS: Test_AssignSubnets/test-13 (0.00s) === RUN Test_TemplateFunctions_CloudControllerConfigArgv === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration === RUN Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Log_Level_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ExternalCloudControllerManager_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/No_CloudProvider_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/k8s_cluster_name (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Default_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Cluster-cidr_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/AllocateNodeCIDRs_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/ConfigureCloudRoutes_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/CIDRAllocatorType_Configuration#01 (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Election (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Leader_Migration (0.00s) --- PASS: Test_TemplateFunctions_CloudControllerConfigArgv/Disable_Controller (0.00s) === RUN Test_KarpenterInstanceTypes I0313 08:50:45.879726 26669 images.go:53] DescribeImagesPages: { ImageIds: ["ami-073c8c0760395aab8"] } --- PASS: Test_KarpenterInstanceTypes (0.00s) === RUN TestKopsFeatureEnabled === RUN TestKopsFeatureEnabled/Missing_feature === RUN TestKopsFeatureEnabled/Existing_feature I0313 08:50:45.880078 26669 featureflag.go:164] FeatureFlag "Scaleway"=true --- PASS: TestKopsFeatureEnabled (0.00s) --- PASS: TestKopsFeatureEnabled/Missing_feature (0.00s) --- PASS: TestKopsFeatureEnabled/Existing_feature (0.00s) === RUN Test_BuildMirroredAsset === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup === RUN Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup --- PASS: Test_BuildMirroredAsset (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/amd64/nodeup (0.00s) --- PASS: Test_BuildMirroredAsset/https://artifacts.k8s.io/binaries/kops/%s/linux/arm64/nodeup (0.00s) === RUN TestValidateFull_Default_Validates --- PASS: TestValidateFull_Default_Validates (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_NoDot --- PASS: TestValidateFull_ClusterName_InvalidDNS_NoDot (0.00s) === RUN TestValidateFull_ClusterName_InvalidDNS_Invalid --- PASS: TestValidateFull_ClusterName_InvalidDNS_Invalid (0.00s) === RUN TestValidateFull_ClusterName_Required --- PASS: TestValidateFull_ClusterName_Required (0.00s) === RUN TestValidateFull_UpdatePolicy_Valid === RUN TestValidateFull_UpdatePolicy_Valid/missing === RUN TestValidateFull_UpdatePolicy_Valid/automatic === RUN TestValidateFull_UpdatePolicy_Valid/external --- PASS: TestValidateFull_UpdatePolicy_Valid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/missing (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/automatic (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Valid/external (0.00s) === RUN TestValidateFull_UpdatePolicy_Invalid === RUN TestValidateFull_UpdatePolicy_Invalid/empty === RUN TestValidateFull_UpdatePolicy_Invalid/populated --- PASS: TestValidateFull_UpdatePolicy_Invalid (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/empty (0.00s) --- PASS: TestValidateFull_UpdatePolicy_Invalid/populated (0.00s) === RUN Test_Validate_Kubenet_With_14 --- PASS: Test_Validate_Kubenet_With_14 (0.00s) === RUN TestValidate_ClusterName_Import --- PASS: TestValidate_ClusterName_Import (0.00s) === RUN TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity --- PASS: TestValidate_ContainerRegistry_and_ContainerProxy_exclusivity (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup 2.260s === RUN TestGetASGTagsToDelete --- PASS: TestGetASGTagsToDelete (0.00s) === RUN TestProcessCompare --- PASS: TestProcessCompare (0.00s) === RUN TestAutoscalingGroupTerraformRender I0313 08:50:43.715331 26670 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender3370902159/001 I0313 08:50:43.715756 26670 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender3370902159/001 I0313 08:50:43.716107 26670 target.go:111] Terraform output is in /tmp/TestAutoscalingGroupTerraformRender3370902159/001 --- PASS: TestAutoscalingGroupTerraformRender (0.00s) === RUN TestTGsARNsChunks --- PASS: TestTGsARNsChunks (0.01s) === RUN TestGetEBSVolumeTagsToDelete --- PASS: TestGetEBSVolumeTagsToDelete (0.00s) === RUN TestSharedEgressOnlyInternetGatewayDoesNotRename I0313 08:50:43.723854 26670 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0313 08:50:43.723986 26670 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0313 08:50:43.724043 26670 egressonlyinternetgateways.go:66] CreateEgressOnlyInternetGateway: { TagSpecifications: [{ ResourceType: "egress-only-internet-gateway", Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] }], VpcId: "vpc-1" } I0313 08:50:43.724244 26670 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0313 08:50:43.724432 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.724545 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.724572 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.724926 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:50:43.724990 26670 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0313 08:50:43.725054 26670 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0313 08:50:43.725149 26670 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0313 08:50:43.725296 26670 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0313 08:50:43.725401 26670 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0313 08:50:43.725501 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.725561 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.725585 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.725650 26670 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0313 08:50:43.725723 26670 egressonlyinternetgateways.go:106] DescribeEgressOnlyInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0313 08:50:43.725822 26670 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedEgressOnlyInternetGatewayDoesNotRename (0.00s) === RUN TestElasticIPCreate I0313 08:50:43.726107 26670 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0313 08:50:43.726209 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0313 08:50:43.726357 26670 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0313 08:50:43.726422 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:50:43.726464 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.726522 26670 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0313 08:50:43.726642 26670 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0313 08:50:43.726914 26670 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0313 08:50:43.726997 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:50:43.727040 26670 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:50:43.727097 26670 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0313 08:50:43.727201 26670 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:50:43.727437 26670 address.go:79] AllocateAddress: { Domain: "vpc", TagSpecifications: [{ ResourceType: "elastic-ip", Tags: [{ Key: "Name", Value: "eip1" }] }] } I0313 08:50:43.727515 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:50:43.727557 26670 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "AssociatedElasticIp", Value: "192.0.2.1" },{ Key: "AssociatedElasticIpAllocationId", Value: "eipalloc-1" }] } I0313 08:50:43.727641 26670 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0313 08:50:43.727762 26670 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0313 08:50:43.727885 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0313 08:50:43.727959 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.727994 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.728060 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.728120 26670 executor.go:111] Tasks: 1 done / 3 total; 1 can run I0313 08:50:43.728205 26670 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0313 08:50:43.728300 26670 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:50:43.728360 26670 executor.go:111] Tasks: 2 done / 3 total; 1 can run I0313 08:50:43.728450 26670 tags.go:165] DescribeTags { Filters: [{ Name: "key", Values: ["AssociatedElasticIp"] },{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:50:43.728541 26670 address.go:120] DescribeAddresses: { Filters: [{ Name: "public-ip", Values: ["192.0.2.1"] }] } I0313 08:50:43.728609 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["eipalloc-1"] }] } I0313 08:50:43.728717 26670 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestElasticIPCreate (0.00s) === RUN TestSharedInternetGatewayDoesNotRename I0313 08:50:43.728880 26670 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16" } I0313 08:50:43.728940 26670 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "Name", Value: "ExistingVPC" }] } I0313 08:50:43.728983 26670 internetgateways.go:66] CreateInternetGateway: { } I0313 08:50:43.729034 26670 tags.go:42] CreateTags { Resources: ["igw-1"], Tags: [{ Key: "Name", Value: "ExistingInternetGateway" }] } I0313 08:50:43.729122 26670 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0313 08:50:43.729224 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.729296 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.729323 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.729462 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:50:43.729520 26670 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0313 08:50:43.729595 26670 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0313 08:50:43.729722 26670 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0313 08:50:43.729853 26670 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0313 08:50:43.729955 26670 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0313 08:50:43.730033 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.730115 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.730143 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.730213 26670 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0313 08:50:43.730291 26670 internetgateways.go:101] DescribeInternetGateways: { Filters: [{ Name: "attachment.vpc-id", Values: ["vpc-1"] }] } I0313 08:50:43.730402 26670 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedInternetGatewayDoesNotRename (0.00s) === RUN TestLaunchTemplateTerraformRender I0313 08:50:43.731113 26670 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender2831915379/001 I0313 08:50:43.731527 26670 target.go:111] Terraform output is in /tmp/TestLaunchTemplateTerraformRender2831915379/001 --- PASS: TestLaunchTemplateTerraformRender (0.00s) === RUN TestParseRemovalRule --- PASS: TestParseRemovalRule (0.00s) === RUN TestPortRemovalRule --- PASS: TestPortRemovalRule (0.00s) === RUN TestPortRemovalRule_Zero --- PASS: TestPortRemovalRule_Zero (0.00s) === RUN TestSecurityGroupCreate I0313 08:50:43.732327 26670 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0313 08:50:43.732442 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0313 08:50:43.732609 26670 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0313 08:50:43.732683 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:50:43.732729 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.732786 26670 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0313 08:50:43.732903 26670 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0313 08:50:43.733234 26670 securitygroups.go:40] CreateSecurityGroup: { Description: "Description", GroupName: "sg1", TagSpecifications: [{ ResourceType: "security-group", Tags: [{ Key: "Name", Value: "sg1" }] }], VpcId: "vpc-1" } I0313 08:50:43.733317 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["sg-1"] }] } I0313 08:50:43.733390 26670 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0313 08:50:43.733526 26670 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0313 08:50:43.733629 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0313 08:50:43.733702 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.733740 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.733788 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.733842 26670 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0313 08:50:43.733924 26670 securitygroups.go:115] DescribeSecurityGroups: { Filters: [{ Name: "tag:Name", Values: ["sg1"] },{ Name: "vpc-id", Values: ["vpc-1"] },{ Name: "group-name", Values: ["sg1"] }] } I0313 08:50:43.734063 26670 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSecurityGroupCreate (0.00s) === RUN Test_Subnet_ValidateRequired --- PASS: Test_Subnet_ValidateRequired (0.00s) === RUN Test_Subnet_CannotChangeSubnet --- PASS: Test_Subnet_CannotChangeSubnet (0.00s) === RUN TestSubnetCreate I0313 08:50:43.734545 26670 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0313 08:50:43.734626 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0313 08:50:43.734777 26670 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0313 08:50:43.734836 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:50:43.734880 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.734938 26670 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0313 08:50:43.735037 26670 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0313 08:50:43.735194 26670 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0313 08:50:43.735271 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:50:43.735316 26670 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:50:43.735360 26670 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0313 08:50:43.735465 26670 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0313 08:50:43.735535 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0313 08:50:43.735606 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.735636 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.735692 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.735735 26670 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0313 08:50:43.735799 26670 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0313 08:50:43.735894 26670 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:50:43.735934 26670 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSubnetCreate (0.00s) === RUN TestSubnetCreateIPv6 I0313 08:50:43.736137 26670 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0313 08:50:43.736204 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0313 08:50:43.736365 26670 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0313 08:50:43.736425 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:50:43.736464 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.736502 26670 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0313 08:50:43.736623 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.736883 26670 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0313 08:50:43.736946 26670 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0313 08:50:43.737081 26670 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0313 08:50:43.737171 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:50:43.737209 26670 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:50:43.737243 26670 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0313 08:50:43.737356 26670 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0313 08:50:43.737415 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0313 08:50:43.737486 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.737514 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.737556 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.737591 26670 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0313 08:50:43.737643 26670 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0313 08:50:43.737711 26670 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:50:43.737779 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.737851 26670 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6 (0.00s) === RUN TestSubnetCreateIPv6NetNum I0313 08:50:43.738044 26670 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0313 08:50:43.738102 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0313 08:50:43.738224 26670 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0313 08:50:43.738282 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:50:43.738318 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.738352 26670 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0313 08:50:43.738408 26670 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0313 08:50:43.738651 26670 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", Ipv6CidrBlock: "2001:db8:0:1::/64", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "subnet1" }] }], VpcId: "vpc-1" } I0313 08:50:43.738729 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:50:43.738766 26670 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:50:43.738831 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.738948 26670 vpcs.go:246] AssociateVpcCidrBlock: { AmazonProvidedIpv6CidrBlock: true, VpcId: "vpc-1" } I0313 08:50:43.738992 26670 executor.go:111] Tasks: 3 done / 3 total; 0 can run I0313 08:50:43.739119 26670 executor.go:111] Tasks: 0 done / 3 total; 1 can run I0313 08:50:43.739178 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0313 08:50:43.739245 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.739270 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.739311 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.739344 26670 executor.go:111] Tasks: 1 done / 3 total; 2 can run I0313 08:50:43.739417 26670 subnets.go:128] DescribeSubnets: { Filters: [{ Name: "tag:Name", Values: ["subnet1"] }] } I0313 08:50:43.739573 26670 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:50:43.739643 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.739718 26670 executor.go:111] Tasks: 3 done / 3 total; 0 can run --- PASS: TestSubnetCreateIPv6NetNum (0.00s) === RUN TestSharedSubnetCreateDoesNotCreateNew I0313 08:50:43.739793 26670 vpcs.go:89] CreateVpc: { CidrBlock: "172.20.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "ExistingVPC" }] }] } I0313 08:50:43.739888 26670 subnets.go:110] CreateSubnet: { CidrBlock: "172.20.1.0/24", TagSpecifications: [{ ResourceType: "subnet", Tags: [{ Key: "Name", Value: "ExistingSubnet" }] }], VpcId: "vpc-1" } I0313 08:50:43.740008 26670 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0313 08:50:43.740062 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.740125 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.740151 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.740275 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:50:43.740318 26670 tags.go:42] CreateTags { Resources: ["vpc-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0313 08:50:43.740362 26670 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0313 08:50:43.740412 26670 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:50:43.740578 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["subnet-1"] }] } I0313 08:50:43.740619 26670 tags.go:42] CreateTags { Resources: ["subnet-1"], Tags: [{ Key: "kubernetes.io/cluster/cluster.example.com", Value: "shared" }] } I0313 08:50:43.740663 26670 executor.go:111] Tasks: 2 done / 2 total; 0 can run I0313 08:50:43.740766 26670 executor.go:111] Tasks: 0 done / 2 total; 1 can run I0313 08:50:43.740820 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.740879 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.740917 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.740962 26670 executor.go:111] Tasks: 1 done / 2 total; 1 can run I0313 08:50:43.741014 26670 subnets.go:128] DescribeSubnets: { SubnetIds: ["subnet-1"] } I0313 08:50:43.741097 26670 executor.go:111] Tasks: 2 done / 2 total; 0 can run --- PASS: TestSharedSubnetCreateDoesNotCreateNew (0.00s) === RUN TestVPCCreate I0313 08:50:43.741206 26670 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0313 08:50:43.741264 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0313 08:50:43.741407 26670 vpcs.go:89] CreateVpc: { CidrBlock: "172.21.0.0/16", TagSpecifications: [{ ResourceType: "vpc", Tags: [{ Key: "Name", Value: "vpc1" }] }] } I0313 08:50:43.741463 26670 tags.go:165] DescribeTags { Filters: [{ Name: "resource-id", Values: ["vpc-1"] }] } I0313 08:50:43.741506 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.741538 26670 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0313 08:50:43.741611 26670 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0313 08:50:43.741667 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc1"] }] } I0313 08:50:43.741734 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.741759 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.741800 26670 vpcs.go:112] DescribeVpcs: { VpcIds: ["vpc-1"] } I0313 08:50:43.741833 26670 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestVPCCreate (0.00s) === RUN Test4758 --- PASS: Test4758 (0.00s) === RUN TestSharedVPCAdditionalCIDR I0313 08:50:43.741992 26670 vpcs.go:246] AssociateVpcCidrBlock: { CidrBlock: "172.22.0.0/16", VpcId: "vpc-1" } I0313 08:50:43.742068 26670 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0313 08:50:43.742122 26670 vpcs.go:112] DescribeVpcs: { Filters: [{ Name: "tag:Name", Values: ["vpc-1"] }] } I0313 08:50:43.742187 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsSupport", VpcId: "vpc-1" } I0313 08:50:43.742211 26670 vpcs.go:169] DescribeVpcAttribute: { Attribute: "enableDnsHostnames", VpcId: "vpc-1" } I0313 08:50:43.742256 26670 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestSharedVPCAdditionalCIDR (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awstasks 0.114s === RUN TestValidateRegion --- PASS: TestValidateRegion (0.00s) === RUN TestFindRegion --- PASS: TestFindRegion (0.00s) === RUN TestEC2TagSpecification === RUN TestEC2TagSpecification/No_tags === RUN TestEC2TagSpecification/simple_tag --- PASS: TestEC2TagSpecification (0.00s) --- PASS: TestEC2TagSpecification/No_tags (0.00s) --- PASS: TestEC2TagSpecification/simple_tag (0.00s) === RUN Test_GetResourceName32 --- PASS: Test_GetResourceName32 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/awsup 0.062s === RUN TestZoneToLocation === RUN TestZoneToLocation/test_case_0 === RUN TestZoneToLocation/test_case_1 === RUN TestZoneToLocation/test_case_2 --- PASS: TestZoneToLocation (0.00s) --- PASS: TestZoneToLocation/test_case_0 (0.00s) --- PASS: TestZoneToLocation/test_case_1 (0.00s) --- PASS: TestZoneToLocation/test_case_2 (0.00s) === RUN TestZoneToAvailabilityZoneNumber === RUN TestZoneToAvailabilityZoneNumber/test_case_0 === RUN TestZoneToAvailabilityZoneNumber/test_case_1 === RUN TestZoneToAvailabilityZoneNumber/test_case_2 --- PASS: TestZoneToAvailabilityZoneNumber (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_0 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_1 (0.00s) --- PASS: TestZoneToAvailabilityZoneNumber/test_case_2 (0.00s) === RUN TestFindEtcdStatus --- PASS: TestFindEtcdStatus (0.00s) === RUN TestGetCloudGroups --- PASS: TestGetCloudGroups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azure 0.032s === RUN TestDiskRenderAzure I0313 08:50:43.683627 26673 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRenderAzure (0.00s) === RUN TestDiskFind --- PASS: TestDiskFind (0.00s) === RUN TestDiskRun I0313 08:50:43.684188 26673 disk.go:112] Creating a new Disk with name: disk --- PASS: TestDiskRun (0.00s) === RUN TestDiskCheckChanges === RUN TestDiskCheckChanges/test_case_0 === RUN TestDiskCheckChanges/test_case_1 === RUN TestDiskCheckChanges/test_case_2 === RUN TestDiskCheckChanges/test_case_3 --- PASS: TestDiskCheckChanges (0.00s) --- PASS: TestDiskCheckChanges/test_case_0 (0.00s) --- PASS: TestDiskCheckChanges/test_case_1 (0.00s) --- PASS: TestDiskCheckChanges/test_case_2 (0.00s) --- PASS: TestDiskCheckChanges/test_case_3 (0.00s) === RUN TestLoadBalancerRenderAzure I0313 08:50:43.684558 26673 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRenderAzure (0.00s) === RUN TestLoadBalancerFind loadbalancer_test.go:124: *azuretasks.LoadBalancer {"Name":"loadbalancer","Lifecycle":"","ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Subnet":{"Name":"subnet","Lifecycle":"","ID":null,"ResourceGroup":null,"VirtualNetwork":null,"NatGateway":null,"NetworkSecurityGroup":null,"CIDR":null,"Shared":null},"External":true,"Tags":null,"ForAPIServer":false} --- PASS: TestLoadBalancerFind (0.00s) === RUN TestLoadBalancerRun I0313 08:50:43.685297 26673 loadbalancer.go:162] Creating a new Loadbalancer with name: loadbalancer --- PASS: TestLoadBalancerRun (0.00s) === RUN TestLoadBalancerCheckChanges === RUN TestLoadBalancerCheckChanges/test_case_0 === RUN TestLoadBalancerCheckChanges/test_case_1 === RUN TestLoadBalancerCheckChanges/test_case_2 === RUN TestLoadBalancerCheckChanges/test_case_3 --- PASS: TestLoadBalancerCheckChanges (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_0 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_1 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_2 (0.00s) --- PASS: TestLoadBalancerCheckChanges/test_case_3 (0.00s) === RUN TestPublicIPAddressRenderAzure I0313 08:50:43.685564 26673 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRenderAzure (0.00s) === RUN TestPublicIPAddressFind publicipaddress_test.go:102: *azuretasks.PublicIPAddress {"Name":"publicIPAddress","Lifecycle":"","ID":null,"ResourceGroup":{"Name":"rg","Lifecycle":"","Tags":null,"Shared":null},"Tags":null} --- PASS: TestPublicIPAddressFind (0.00s) === RUN TestPublicIPAddressRun I0313 08:50:43.685871 26673 publicipaddress.go:113] Creating a new Public IP Address with name: publicIPAddress --- PASS: TestPublicIPAddressRun (0.00s) === RUN TestPublicIPAddressCheckChanges === RUN TestPublicIPAddressCheckChanges/test_case_0 === RUN TestPublicIPAddressCheckChanges/test_case_1 === RUN TestPublicIPAddressCheckChanges/test_case_2 === RUN TestPublicIPAddressCheckChanges/test_case_3 --- PASS: TestPublicIPAddressCheckChanges (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_0 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_1 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_2 (0.00s) --- PASS: TestPublicIPAddressCheckChanges/test_case_3 (0.00s) === RUN TestResourceGroupRenderAzure I0313 08:50:43.686099 26673 resourcegroup.go:108] Creating a new Resource Group with name: rg I0313 08:50:43.686112 26673 resourcegroup.go:110] Updating a Resource Group with name: rg --- PASS: TestResourceGroupRenderAzure (0.00s) === RUN TestResourceGroupFind --- PASS: TestResourceGroupFind (0.00s) === RUN TestResourceGroupRun I0313 08:50:43.686328 26673 resourcegroup.go:108] Creating a new Resource Group with name: rg --- PASS: TestResourceGroupRun (0.00s) === RUN TestResourceGroupCheckChanges === RUN TestResourceGroupCheckChanges/test_case_0 === RUN TestResourceGroupCheckChanges/test_case_1 === RUN TestResourceGroupCheckChanges/test_case_2 === RUN TestResourceGroupCheckChanges/test_case_3 --- PASS: TestResourceGroupCheckChanges (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_0 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_1 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_2 (0.00s) --- PASS: TestResourceGroupCheckChanges/test_case_3 (0.00s) === RUN TestRoleAssignmentRenderAzure --- PASS: TestRoleAssignmentRenderAzure (0.00s) === RUN TestRoleAssignmentFind --- PASS: TestRoleAssignmentFind (0.00s) === RUN TestRoleAssignmentFind_NoPrincipalID --- PASS: TestRoleAssignmentFind_NoPrincipalID (0.00s) === RUN TestRoleAssignmentCheckChanges === RUN TestRoleAssignmentCheckChanges/test_case_0 === RUN TestRoleAssignmentCheckChanges/test_case_1 === RUN TestRoleAssignmentCheckChanges/test_case_2 === RUN TestRoleAssignmentCheckChanges/test_case_3 --- PASS: TestRoleAssignmentCheckChanges (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_0 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_1 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_2 (0.00s) --- PASS: TestRoleAssignmentCheckChanges/test_case_3 (0.00s) === RUN TestSubnetRenderAzure I0313 08:50:43.686847 26673 subnet.go:126] Creating a new Subnet with name: vnet --- PASS: TestSubnetRenderAzure (0.00s) === RUN TestSubnetFind --- PASS: TestSubnetFind (0.00s) === RUN TestSubnetCheckChanges === RUN TestSubnetCheckChanges/test_case_0 === RUN TestSubnetCheckChanges/test_case_1 === RUN TestSubnetCheckChanges/test_case_2 === RUN TestSubnetCheckChanges/test_case_3 --- PASS: TestSubnetCheckChanges (0.00s) --- PASS: TestSubnetCheckChanges/test_case_0 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_1 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_2 (0.00s) --- PASS: TestSubnetCheckChanges/test_case_3 (0.00s) === RUN TestVirtualNetworkRenderAzure I0313 08:50:43.687087 26673 virtualnetwork.go:122] Creating a new Virtual Network with name: vnet --- PASS: TestVirtualNetworkRenderAzure (0.00s) === RUN TestVirtualNetworkFind --- PASS: TestVirtualNetworkFind (0.00s) === RUN TestVirtualNetworkRun I0313 08:50:43.687284 26673 virtualnetwork.go:122] Creating a new Virtual Network with name: rg --- PASS: TestVirtualNetworkRun (0.00s) === RUN TestVirtualNetworkCheckChanges === RUN TestVirtualNetworkCheckChanges/test_case_0 === RUN TestVirtualNetworkCheckChanges/test_case_1 === RUN TestVirtualNetworkCheckChanges/test_case_2 === RUN TestVirtualNetworkCheckChanges/test_case_3 --- PASS: TestVirtualNetworkCheckChanges (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_0 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_1 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_2 (0.00s) --- PASS: TestVirtualNetworkCheckChanges/test_case_3 (0.00s) === RUN TestSubnetIDParse --- PASS: TestSubnetIDParse (0.00s) === RUN TestLoadBalancerIDParse --- PASS: TestLoadBalancerIDParse (0.00s) === RUN TestVMScaleSetRenderAzure I0313 08:50:43.687551 26673 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRenderAzure (0.00s) === RUN TestVMScaleSetFind --- PASS: TestVMScaleSetFind (0.00s) === RUN TestVMScaleSetRun I0313 08:50:43.688744 26673 vmscaleset.go:220] Creating a new VM Scale Set with name: vmss --- PASS: TestVMScaleSetRun (0.00s) === RUN TestVMScaleSetCheckChanges === RUN TestVMScaleSetCheckChanges/test_case_0 === RUN TestVMScaleSetCheckChanges/test_case_1 === RUN TestVMScaleSetCheckChanges/test_case_2 === RUN TestVMScaleSetCheckChanges/test_case_3 --- PASS: TestVMScaleSetCheckChanges (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_0 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_1 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_2 (0.00s) --- PASS: TestVMScaleSetCheckChanges/test_case_3 (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/azuretasks 0.041s === RUN Test_Find === RUN Test_Find/successfully_found_volume === RUN Test_Find/no_volume_found === RUN Test_Find/error_from_server --- PASS: Test_Find (0.00s) --- PASS: Test_Find/successfully_found_volume (0.00s) --- PASS: Test_Find/no_volume_found (0.00s) --- PASS: Test_Find/error_from_server (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/dotasks 0.032s === RUN TestProjectIAMBinding I0313 08:50:45.172251 27527 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0313 08:50:45.173056 27527 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0313 08:50:45.173092 27527 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0313 08:50:45.173884 27527 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0313 08:50:45.173944 27527 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0313 08:50:45.174203 27527 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestProjectIAMBinding (0.00s) === RUN TestServiceAccount I0313 08:50:45.174414 27527 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0313 08:50:45.174558 27527 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0313 08:50:45.174588 27527 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0313 08:50:45.174775 27527 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0313 08:50:45.174809 27527 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0313 08:50:45.174876 27527 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestServiceAccount (0.00s) === RUN TestStorageBucketIAM I0313 08:50:45.175007 27527 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0313 08:50:45.175382 27527 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0313 08:50:45.175413 27527 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0313 08:50:45.175960 27527 executor.go:111] Tasks: 1 done / 1 total; 0 can run I0313 08:50:45.175994 27527 executor.go:111] Tasks: 0 done / 1 total; 1 can run I0313 08:50:45.176173 27527 executor.go:111] Tasks: 1 done / 1 total; 0 can run --- PASS: TestStorageBucketIAM (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/gcetasks 0.082s === RUN Test_OpenstackCloud_MakeCloud === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured === RUN Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value --- PASS: Test_OpenstackCloud_MakeCloud (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_false_when_not_configured (0.00s) --- PASS: Test_OpenstackCloud_MakeCloud/Ignore_volume_microversion_is_set_to_configured_value (0.00s) === RUN Test_OpenstackCloud_GetApiIngressStatus === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match === RUN Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled === RUN Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled --- PASS: Test_OpenstackCloud_GetApiIngressStatus (0.02s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_set_multiple_IPs_match (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/Loadbalancer_configured_master_public_name_not_set (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_no_floating_enabled (0.00s) --- PASS: Test_OpenstackCloud_GetApiIngressStatus/No_Loadbalancer_configured_with_floating_enabled (0.01s) === RUN Test_BuildClients === RUN Test_BuildClients/Empty_openstack_spec_means_no_load_balancer === RUN Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned === RUN Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned === RUN Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned === RUN Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled --- PASS: Test_BuildClients (0.00s) --- PASS: Test_BuildClients/Empty_openstack_spec_means_no_load_balancer (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_but_no_router,_an_error_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_set,_and_there_is_a_router,_a_load-balancer_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_octavia_is_not_set,_network_should_be_returned (0.00s) --- PASS: Test_BuildClients/When_router_is_set,_but_no_LB,_FIP_support_should_be_enabled (0.00s) === RUN Test_WaitForStatusActiveIsSuccessful --- PASS: Test_WaitForStatusActiveIsSuccessful (1.00s) === RUN Test_WaitForStatusActiveResultsInInstanceNotFound --- PASS: Test_WaitForStatusActiveResultsInInstanceNotFound (1.00s) === RUN Test_WaitForStatusActiveResultsInUnableToCreateServer --- PASS: Test_WaitForStatusActiveResultsInUnableToCreateServer (1.00s) === RUN Test_WaitForStatusActiveResultsInTimeout --- PASS: Test_WaitForStatusActiveResultsInTimeout (1.00s) === RUN TestGetMetadataFromMetadataServiceReturnsNotFoundError --- PASS: TestGetMetadataFromMetadataServiceReturnsNotFoundError (0.00s) === RUN TestGetMetadataFromMetadataService --- PASS: TestGetMetadataFromMetadataService (0.00s) === RUN TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound --- PASS: TestGetMetadataFromConfigDriveReturnsErrorWhenNoDeviceIsFound (0.00s) === RUN TestGetMetadataFromConfigDrive --- PASS: TestGetMetadataFromConfigDrive (0.00s) === RUN TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound --- PASS: TestGetMetadataReturnsLastErrorWhenNoMetadataWasFound (0.00s) === RUN TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromConfigDriveWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenConfigDriveFails --- PASS: TestGetMetadataFromServiceEndpointWhenConfigDriveFails (0.00s) === RUN TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder --- PASS: TestGetMetadataFromServiceEndpointWhenItIsFirstInSearchOrder (0.00s) === RUN TestGetMetadataFromConfigDriveWhenServiceEndpointFails --- PASS: TestGetMetadataFromConfigDriveWhenServiceEndpointFails (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstack 4.072s === RUN TestFilterPortsReturnsAllPorts --- PASS: TestFilterPortsReturnsAllPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPort --- PASS: TestFilterPortsReturnsOnlyTaggedPort (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPorts --- PASS: TestFilterPortsReturnsOnlyTaggedPorts (0.00s) === RUN TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername --- PASS: TestFilterPortsReturnsOnlyTaggedPortsWithLongClustername (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsPortAddressPairsWhenFindIsNil (0.00s) === RUN Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges --- PASS: Test_Port_GetAllowedAddressPairs_ReturnsModifiedPortAddressPairsWhenNoChanges (0.00s) === RUN Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges --- PASS: Test_Port_GetActualAllowedAddressPairs_ReturnsModifiedPortAddressPairsOnChanges (0.00s) === RUN Test_Port_GetDependencies --- PASS: Test_Port_GetDependencies (0.00s) === RUN Test_NewPortTaskFromCloud === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName === RUN Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups === RUN Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs --- PASS: Test_NewPortTaskFromCloud (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/empty_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_not_nil_populates_the_InstanceGroupName (0.00s) --- PASS: Test_NewPortTaskFromCloud/fully_populated_cloud_port_found_port_nil_populates_the_InstanceGroupName_if_found (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_additional_security_groups (0.00s) --- PASS: Test_NewPortTaskFromCloud/cloud_port_found_port_not_nil_honors_allowed_address_pairs (0.00s) === RUN Test_Port_Find === RUN Test_Port_Find/nothing_found === RUN Test_Port_Find/port_found_no_tags === RUN Test_Port_Find/port_found_with_tags === RUN Test_Port_Find/multiple_ports_found === RUN Test_Port_Find/error_listing_ports === RUN Test_Port_Find/port_found_with_allowed_address_pairs --- PASS: Test_Port_Find (0.00s) --- PASS: Test_Port_Find/nothing_found (0.00s) --- PASS: Test_Port_Find/port_found_no_tags (0.00s) --- PASS: Test_Port_Find/port_found_with_tags (0.00s) --- PASS: Test_Port_Find/multiple_ports_found (0.00s) --- PASS: Test_Port_Find/error_listing_ports (0.00s) --- PASS: Test_Port_Find/port_found_with_allowed_address_pairs (0.00s) === RUN Test_Port_CheckChanges === RUN Test_Port_CheckChanges/actual_nil_all_required_fields_set === RUN Test_Port_CheckChanges/actual_nil_required_field_Name_nil === RUN Test_Port_CheckChanges/actual_nil_required_field_Network_nil === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set === RUN Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set === RUN Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set --- PASS: Test_Port_CheckChanges (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_all_required_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Name_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_nil_required_field_Network_nil (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_all_changeable_fields_set#01 (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Name_set (0.00s) --- PASS: Test_Port_CheckChanges/actual_not_nil_unchangeable_field_Network_set (0.00s) === RUN Test_Port_RenderOpenstack === RUN Test_Port_RenderOpenstack/actual_not_nil === RUN Test_Port_RenderOpenstack/actual_nil_success === RUN Test_Port_RenderOpenstack/actual_nil_cloud_error === RUN Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success --- PASS: Test_Port_RenderOpenstack (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_not_nil (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_success (0.00s) --- PASS: Test_Port_RenderOpenstack/actual_nil_cloud_error (0.00s) --- PASS: Test_Port_RenderOpenstack/changes_in_allowed_address_pairs_success (0.00s) === RUN Test_Port_createOptsFromPortTask === RUN Test_Port_createOptsFromPortTask/all_fields_set === RUN Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups --- PASS: Test_Port_createOptsFromPortTask (0.00s) --- PASS: Test_Port_createOptsFromPortTask/all_fields_set (0.00s) --- PASS: Test_Port_createOptsFromPortTask/nonexisting_additional_security_groups (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/openstacktasks 0.051s === RUN TestCreateValidScalewayProfile === RUN TestCreateValidScalewayProfile/Only_environment_set === RUN TestCreateValidScalewayProfile/Only_profile_set === RUN TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID === RUN TestCreateValidScalewayProfile/Environment_should_override_whole_profile === RUN TestCreateValidScalewayProfile/Empty_profile_for_integration_tests --- PASS: TestCreateValidScalewayProfile (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_environment_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Only_profile_set (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_profile's_default_project_ID (0.00s) --- PASS: TestCreateValidScalewayProfile/Environment_should_override_whole_profile (0.00s) --- PASS: TestCreateValidScalewayProfile/Empty_profile_for_integration_tests (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/scaleway 0.037s === RUN TestWriteLocalsOutputs === RUN TestWriteLocalsOutputs/empty_map === RUN TestWriteLocalsOutputs/single_output === RUN TestWriteLocalsOutputs/list_output --- PASS: TestWriteLocalsOutputs (0.00s) --- PASS: TestWriteLocalsOutputs/empty_map (0.00s) --- PASS: TestWriteLocalsOutputs/single_output (0.00s) --- PASS: TestWriteLocalsOutputs/list_output (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraform 0.031s === RUN TestGetOutputs === RUN TestGetOutputs/empty_map === RUN TestGetOutputs/single_output === RUN TestGetOutputs/list_output === RUN TestGetOutputs/duplicate_names === RUN TestGetOutputs/duplicate_values --- PASS: TestGetOutputs (0.00s) --- PASS: TestGetOutputs/empty_map (0.00s) --- PASS: TestGetOutputs/single_output (0.00s) --- PASS: TestGetOutputs/list_output (0.00s) --- PASS: TestGetOutputs/duplicate_names (0.00s) --- PASS: TestGetOutputs/duplicate_values (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/cloudup/terraformWriter 0.005s === RUN TestKeypairDeps --- PASS: TestKeypairDeps (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/fitasks 0.037s === RUN TestArchiveDependencies --- PASS: TestArchiveDependencies (0.00s) === RUN TestBindMountCommands I0313 08:50:48.091996 27947 bindmount.go:223] running mount command [mount --bind /containerized_mounter /containerized_mounter] I0313 08:50:48.092081 27947 bindmount.go:232] running mount command [mount -o remount,exec /containerized_mounter] I0313 08:50:48.092094 27947 bindmount.go:223] running mount command [mount --rbind /var/lib/kubelet/ /containerized_mounter/rootfs/var/lib/kubelet] I0313 08:50:48.092107 27947 bindmount.go:243] running mount command [mount --make-rshared /containerized_mounter/rootfs/var/lib/kubelet] I0313 08:50:48.092118 27947 bindmount.go:223] running mount command [mount --bind -o ro /proc /containerized_mounter/rootfs/proc] I0313 08:50:48.092129 27947 bindmount.go:223] running mount command [mount --bind -o ro /dev /containerized_mounter/rootfs/dev] I0313 08:50:48.092140 27947 bindmount.go:223] running mount command [mount --bind -o ro /etc/resolv.conf /containerized_mounter/rootfs/etc/resolv.conf] --- PASS: TestBindMountCommands (0.00s) === RUN TestBindMountDependencies --- PASS: TestBindMountDependencies (0.00s) === RUN TestFileDependencies === RUN TestFileDependencies/user === RUN TestFileDependencies/parentDir === RUN TestFileDependencies/afterFiles --- PASS: TestFileDependencies (0.00s) --- PASS: TestFileDependencies/user (0.00s) --- PASS: TestFileDependencies/parentDir (0.00s) --- PASS: TestFileDependencies/afterFiles (0.00s) === RUN TestIssueCertFileDependencies --- PASS: TestIssueCertFileDependencies (0.00s) === RUN TestLoadImageTask_Deps --- PASS: TestLoadImageTask_Deps (0.00s) === RUN TestServiceTask_Deps --- PASS: TestServiceTask_Deps (0.00s) === RUN TestServiceTask_UnknownTypes W0313 08:50:48.092637 27947 service.go:110] Unhandled type *nodetasks.FakeTask in Service::GetDependencies: &{} --- PASS: TestServiceTask_UnknownTypes (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/nodeup/nodetasks 0.064s === RUN TestStringSlicesEqual --- PASS: TestStringSlicesEqual (0.00s) === RUN TestStringSlicesEqualIgnoreOrder --- PASS: TestStringSlicesEqualIgnoreOrder (0.00s) === RUN TestHashString --- PASS: TestHashString (0.00s) === RUN TestSanitizeString --- PASS: TestSanitizeString (0.00s) PASS ok k8s.io/kops/upup/pkg/fi/utils 0.003s === RUN TestFindDistribution --- PASS: TestFindDistribution (0.00s) PASS ok k8s.io/kops/util/pkg/distributions 0.005s === RUN TestWithTee --- PASS: TestWithTee (0.00s) PASS ok k8s.io/kops/util/pkg/exec 0.003s === RUN TestNewHasher === RUN TestNewHasher/sha256 === RUN TestNewHasher/sha1 === RUN TestNewHasher/md5 --- PASS: TestNewHasher (0.00s) --- PASS: TestNewHasher/sha256 (0.00s) --- PASS: TestNewHasher/sha1 (0.00s) --- PASS: TestNewHasher/md5 (0.00s) === RUN TestMemberFromString === RUN TestMemberFromString/sha256_1 === RUN TestMemberFromString/sha256_2 === RUN TestMemberFromString/sha256_3 === RUN TestMemberFromString/sha1_1 === RUN TestMemberFromString/sha1_2 === RUN TestMemberFromString/sha1_3 === RUN TestMemberFromString/md5_1 === RUN TestMemberFromString/md5_2 === RUN TestMemberFromString/md5_3 --- PASS: TestMemberFromString (0.00s) --- PASS: TestMemberFromString/sha256_1 (0.00s) --- PASS: TestMemberFromString/sha256_2 (0.00s) --- PASS: TestMemberFromString/sha256_3 (0.00s) --- PASS: TestMemberFromString/sha1_1 (0.00s) --- PASS: TestMemberFromString/sha1_2 (0.00s) --- PASS: TestMemberFromString/sha1_3 (0.00s) --- PASS: TestMemberFromString/md5_1 (0.00s) --- PASS: TestMemberFromString/md5_2 (0.00s) --- PASS: TestMemberFromString/md5_3 (0.00s) === RUN TestFromString === RUN TestFromString/sha256 === RUN TestFromString/sha1 === RUN TestFromString/md5 === RUN TestFromString/unknown --- PASS: TestFromString (0.00s) --- PASS: TestFromString/sha256 (0.00s) --- PASS: TestFromString/sha1 (0.00s) --- PASS: TestFromString/md5 (0.00s) --- PASS: TestFromString/unknown (0.00s) PASS ok k8s.io/kops/util/pkg/hashing 0.004s === RUN TestKeys --- PASS: TestKeys (0.00s) === RUN TestSortedKeys --- PASS: TestSortedKeys (0.00s) PASS ok k8s.io/kops/util/pkg/maps 0.004s === RUN TestGetProxyEnvVars W0313 08:50:48.058192 27952 proxy.go:34] EgressProxy set but no proxy host provided --- PASS: TestGetProxyEnvVars (0.00s) PASS ok k8s.io/kops/util/pkg/proxy 0.028s === RUN TestSet === RUN TestSet/simple_setting === RUN TestSet/setting_with_wildcard === RUN TestSet/creating_missing_objects === RUN TestSet/set_int === RUN TestSet/set_int32 === RUN TestSet/set_int64 === RUN TestSet/set_int_pointer === RUN TestSet/set_int32_pointer === RUN TestSet/set_int64_pointer === RUN TestSet/set_enum === RUN TestSet/set_enum_slice === RUN TestSet/append_enum_slice === RUN TestSet/set_env_var === RUN TestSet/set_env_var_with_val === RUN TestSet/set_duration --- PASS: TestSet (0.00s) --- PASS: TestSet/simple_setting (0.00s) --- PASS: TestSet/setting_with_wildcard (0.00s) --- PASS: TestSet/creating_missing_objects (0.00s) --- PASS: TestSet/set_int (0.00s) --- PASS: TestSet/set_int32 (0.00s) --- PASS: TestSet/set_int64 (0.00s) --- PASS: TestSet/set_int_pointer (0.00s) --- PASS: TestSet/set_int32_pointer (0.00s) --- PASS: TestSet/set_int64_pointer (0.00s) --- PASS: TestSet/set_enum (0.00s) --- PASS: TestSet/set_enum_slice (0.00s) --- PASS: TestSet/append_enum_slice (0.00s) --- PASS: TestSet/set_env_var (0.00s) --- PASS: TestSet/set_env_var_with_val (0.00s) --- PASS: TestSet/set_duration (0.00s) === RUN TestSetInvalidPath === RUN TestSetInvalidPath/setting_with_wildcard === RUN TestSetInvalidPath/creating_missing_objects === RUN TestSetInvalidPath/set_int === RUN TestSetInvalidPath/set_int32 === RUN TestSetInvalidPath/set_int64 --- PASS: TestSetInvalidPath (0.00s) --- PASS: TestSetInvalidPath/setting_with_wildcard (0.00s) --- PASS: TestSetInvalidPath/creating_missing_objects (0.00s) --- PASS: TestSetInvalidPath/set_int (0.00s) --- PASS: TestSetInvalidPath/set_int32 (0.00s) --- PASS: TestSetInvalidPath/set_int64 (0.00s) === RUN TestUnset === RUN TestUnset/simple_unsetting === RUN TestUnset/unsetting_with_wildcard === RUN TestUnset/uset_int === RUN TestUnset/unset_int32 === RUN TestUnset/unset_int64 === RUN TestUnset/unset_int_pointer === RUN TestUnset/unset_int32_pointer === RUN TestUnset/unset_int64_pointer === RUN TestUnset/unset_enum === RUN TestUnset/unset_enum_slice --- PASS: TestUnset (0.00s) --- PASS: TestUnset/simple_unsetting (0.00s) --- PASS: TestUnset/unsetting_with_wildcard (0.00s) --- PASS: TestUnset/uset_int (0.00s) --- PASS: TestUnset/unset_int32 (0.00s) --- PASS: TestUnset/unset_int64 (0.00s) --- PASS: TestUnset/unset_int_pointer (0.00s) --- PASS: TestUnset/unset_int32_pointer (0.00s) --- PASS: TestUnset/unset_int64_pointer (0.00s) --- PASS: TestUnset/unset_enum (0.00s) --- PASS: TestUnset/unset_enum_slice (0.00s) === RUN TestUnsetInvalidPath === RUN TestUnsetInvalidPath/usetting_with_wildcard === RUN TestUnsetInvalidPath/missing_objects --- PASS: TestUnsetInvalidPath (0.00s) --- PASS: TestUnsetInvalidPath/usetting_with_wildcard (0.00s) --- PASS: TestUnsetInvalidPath/missing_objects (0.00s) === RUN TestParseFieldPath === RUN TestParseFieldPath/test_Spec.Containers.Image === RUN TestParseFieldPath/test_Spec.Containers[0].Image === RUN TestParseFieldPath/test_Spec.Containers[*].Image --- PASS: TestParseFieldPath (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers.Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[0].Image (0.00s) --- PASS: TestParseFieldPath/test_Spec.Containers[*].Image (0.00s) === RUN Test_Merge --- PASS: Test_Merge (0.00s) PASS ok k8s.io/kops/util/pkg/reflectutils 0.030s === RUN TestGetUniqueStrings --- PASS: TestGetUniqueStrings (0.00s) === RUN TestContains --- PASS: TestContains (0.00s) PASS ok k8s.io/kops/util/pkg/slice 0.004s === RUN TestSplitToSections --- PASS: TestSplitToSections (0.00s) PASS ok k8s.io/kops/util/pkg/text 0.003s === RUN TestAzureBlobPathBase === RUN TestAzureBlobPathBase/Test_case_0 === RUN TestAzureBlobPathBase/Test_case_1 === RUN TestAzureBlobPathBase/Test_case_2 --- PASS: TestAzureBlobPathBase (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathBase/Test_case_2 (0.00s) === RUN TestAzureBlobPathPath === RUN TestAzureBlobPathPath/Test_case_0 === RUN TestAzureBlobPathPath/Test_case_1 === RUN TestAzureBlobPathPath/Test_case_2 --- PASS: TestAzureBlobPathPath (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_0 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_1 (0.00s) --- PASS: TestAzureBlobPathPath/Test_case_2 (0.00s) === RUN TestAzureBlobPathJoin --- PASS: TestAzureBlobPathJoin (0.00s) === RUN TestCreateFile --- PASS: TestCreateFile (0.00s) === RUN TestWriteTo --- PASS: TestWriteTo (0.00s) === RUN TestMemFsCreateFile --- PASS: TestMemFsCreateFile (0.00s) === RUN TestMemFsReadDir --- PASS: TestMemFsReadDir (0.00s) === RUN TestMemFsReadTree --- PASS: TestMemFsReadTree (0.00s) === RUN Test_VFSPath --- PASS: Test_VFSPath (0.00s) === RUN Test_S3Path_Parse --- PASS: Test_S3Path_Parse (0.00s) PASS ok k8s.io/kops/util/pkg/vfs 0.021s === RUN TestGSRenderTerraform === RUN TestGSRenderTerraform/gs://foo/bar --- PASS: TestGSRenderTerraform (0.00s) --- PASS: TestGSRenderTerraform/gs://foo/bar (0.00s) === RUN TestS3RenderTerraform === RUN TestS3RenderTerraform/s3://foo/bar W0313 08:50:51.387594 28057 s3context.go:235] Unable to read bucket encryption policy for "foo" in region "us-east-1": will encrypt using AES256 --- PASS: TestS3RenderTerraform (0.00s) --- PASS: TestS3RenderTerraform/s3://foo/bar (0.00s) PASS ok k8s.io/kops/util/pkg/vfs/tests 0.066s >>> kops: Entering fakeroot... >>> kops*: Running postcheck for kops >>> kops*: Preparing package kops... >>> kops*: Stripping binaries >>> kops*: Scanning shared objects >>> kops*: Tracing dependencies... >>> kops*: Package size: 147.7 MB >>> kops*: Compressing data... >>> kops*: Create checksum... >>> kops*: Create kops-1.28.4-r1.apk >>> kops: Build complete at Wed, 13 Mar 2024 08:53:25 +0000 elapsed time 0h 6m 14s >>> kops: Cleaning up srcdir >>> kops: Cleaning up pkgdir >>> kops: Uninstalling dependencies... (1/5) Purging .makedepends-kops (20240313.084713) (2/5) Purging kubernetes (1.29.2-r0) (3/5) Purging go (1.22.1-r0) (4/5) Purging bash (5.2.26-r0) Executing bash-5.2.26-r0.pre-deinstall (5/5) Purging readline (8.2.10-r0) Executing busybox-1.36.1-r21.trigger OK: 378 MiB in 106 packages >>> kops: Updating the testing/x86_64 repository index... >>> kops: Signing the index...