ResultFAILURE
Tests 0 failed / 1787 succeeded
Started2019-05-16 08:01
Elapsed12m9s
Versionunknown
Buildergke-prow-pubsub-scope-06721acc-x669
podcd927881-77b0-11e9-a8d6-0a580a3c3403
infra-commit822b6386f
podcd927881-77b0-11e9-a8d6-0a580a3c3403
repogithub.com/knative/serving
repo-commit2297b69327bbc457563cefc7d36a848159a4c7c0
repos{u'github.com/knative/serving': u'master'}

No Test Failures!


Show 1787 Passed Tests

Show 1 Skipped Tests

Error lines from build-log.txt

... skipping 998 lines ...
I0516 08:08:35.491] --- PASS: TestUpdateRequestLogFromConfigMap (0.01s)
I0516 08:08:35.491]     --- PASS: TestUpdateRequestLogFromConfigMap/empty_template (0.00s)
I0516 08:08:35.491]         logger.go:130: 2019-05-16T08:08:34.450Z	INFO	TestUpdateRequestLogFromConfigMap/empty_template	activator/request_log.go:36	Updated the request log template.	{"template": ""}
I0516 08:08:35.491]     --- PASS: TestUpdateRequestLogFromConfigMap/template_with_new_line (0.00s)
I0516 08:08:35.492]         logger.go:130: 2019-05-16T08:08:34.452Z	INFO	TestUpdateRequestLogFromConfigMap/template_with_new_line	activator/request_log.go:36	Updated the request log template.	{"template": "{{.Request.URL}}\n"}
I0516 08:08:35.492]     --- PASS: TestUpdateRequestLogFromConfigMap/invalid_template (0.00s)
I0516 08:08:35.492]         logger.go:130: 2019-05-16T08:08:34.453Z	ERROR	TestUpdateRequestLogFromConfigMap/invalid_template	activator/request_log.go:34	Failed to update the request log template.	{"error": "template: requestLog:1: missing value for command", "template": "{{}}"}
I0516 08:08:35.493]     --- PASS: TestUpdateRequestLogFromConfigMap/revision_info (0.00s)
I0516 08:08:35.493]         logger.go:130: 2019-05-16T08:08:34.454Z	INFO	TestUpdateRequestLogFromConfigMap/revision_info	activator/request_log.go:36	Updated the request log template.	{"template": "{{.Revision.Name}}, {{.Revision.Namespace}}, {{.Revision.Service}}, {{.Revision.Configuration}}, {{.Revision.PodName}}, {{.Revision.PodIP}}"}
I0516 08:08:35.493]     --- PASS: TestUpdateRequestLogFromConfigMap/empty_template_2 (0.00s)
I0516 08:08:35.494]         logger.go:130: 2019-05-16T08:08:34.455Z	INFO	TestUpdateRequestLogFromConfigMap/empty_template_2	activator/request_log.go:36	Updated the request log template.	{"template": ""}
I0516 08:08:35.494] === RUN   TestRequestLogTemplateInputGetter
I0516 08:08:35.494] === RUN   TestRequestLogTemplateInputGetter/success
... skipping 92 lines ...
I0516 08:08:59.642] === RUN   TestActivationHandler/slowly_active_endpoint
I0516 08:08:59.643] === RUN   TestActivationHandler/active_endpoint_with_missing_count_header
I0516 08:08:59.643] === RUN   TestActivationHandler/no_active_endpoint
I0516 08:08:59.643] === RUN   TestActivationHandler/active_endpoint_(probe_failure)
I0516 08:08:59.643] === RUN   TestActivationHandler/active_endpoint_(probe_500)
I0516 08:08:59.644] === RUN   TestActivationHandler/request_error
I0516 08:08:59.644] 2019/05/16 08:08:58 http: proxy error: request error
I0516 08:08:59.644] === RUN   TestActivationHandler/broken_get_SKS
I0516 08:08:59.644] === RUN   TestActivationHandler/k8s_svc_incorrectly_spec'd
I0516 08:08:59.645] === RUN   TestActivationHandler/broken_get_k8s_svc
I0516 08:08:59.645] === RUN   TestActivationHandler/broken_get_endpoints
I0516 08:08:59.645] --- PASS: TestActivationHandler (0.20s)
I0516 08:08:59.645]     --- PASS: TestActivationHandler/active_endpoint (0.00s)
I0516 08:08:59.646]         logger.go:130: 2019-05-16T08:08:58.416Z	DEBUG	TestActivationHandler/active_endpoint	handler/handler.go:108	Probing http://real-name.real-namespace.svc.cluster.local:8080 took 1 attempts and 105.62µs time
I0516 08:08:59.646]     --- PASS: TestActivationHandler/slowly_active_endpoint (0.10s)
I0516 08:08:59.646]         logger.go:130: 2019-05-16T08:08:58.418Z	WARN	TestActivationHandler/slowly_active_endpoint	handler/handler.go:119	Pod probe unsuccessful	{"knative.dev/key": "real-namespace/real-name"}
I0516 08:08:59.647]         logger.go:130: 2019-05-16T08:08:58.519Z	DEBUG	TestActivationHandler/slowly_active_endpoint	handler/handler.go:108	Probing http://real-name.real-namespace.svc.cluster.local:8080 took 2 attempts and 100.679069ms time
I0516 08:08:59.647]     --- PASS: TestActivationHandler/active_endpoint_with_missing_count_header (0.00s)
I0516 08:08:59.647]         logger.go:130: 2019-05-16T08:08:58.522Z	DEBUG	TestActivationHandler/active_endpoint_with_missing_count_header	handler/handler.go:108	Probing http://real-name.real-namespace.svc.cluster.local:8080 took 1 attempts and 79.71µs time
I0516 08:08:59.648]     --- PASS: TestActivationHandler/no_active_endpoint (0.00s)
I0516 08:08:59.648]         logger.go:130: 2019-05-16T08:08:58.524Z	ERROR	TestActivationHandler/no_active_endpoint	handler/handler.go:137	Error while getting revision	{"knative.dev/key": "fake-namespace/fake-name", "error": "revision.serving.knative.dev \"fake-name\" not found"}
I0516 08:08:59.648]     --- PASS: TestActivationHandler/active_endpoint_(probe_failure) (0.00s)
I0516 08:08:59.650]         logger.go:130: 2019-05-16T08:08:58.526Z	WARN	TestActivationHandler/active_endpoint_(probe_failure)	handler/handler.go:115	Pod probe failed	{"knative.dev/key": "real-namespace/real-name", "error": "error roundtripping http://real-name.real-namespace.svc.cluster.local:8080: probe error", "errorVerbose": "probe error\nerror roundtripping http://real-name.real-namespace.svc.cluster.local:8080\ngithub.com/knative/serving/pkg/network/prober.Do\n\t/go/src/github.com/knative/serving/pkg/network/prober/prober.go:55\ngithub.com/knative/serving/pkg/activator/handler.(*activationHandler).probeEndpoint.func2\n\t/go/src/github.com/knative/serving/pkg/activator/handler/handler.go:113\ngithub.com/knative/serving/vendor/k8s.io/apimachinery/pkg/util/wait.pollImmediateInternal\n\t/go/src/github.com/knative/serving/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:245\ngithub.com/knative/serving/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate\n\t/go/src/github.com/knative/serving/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:241\ngithub.com/knative/serving/pkg/activator/handler.(*activationHandler).probeEndpoint\n\t/go/src/github.com/knative/serving/pkg/activator/handler/handler.go:111\ngithub.com/knative/serving/pkg/activator/handler.(*activationHandler).ServeHTTP.func1\n\t/go/src/github.com/knative/serving/pkg/activator/handler/handler.go:166\ngithub.com/knative/serving/pkg/queue.(*Breaker).Maybe\n\t/go/src/github.com/knative/serving/pkg/queue/breaker.go:89\ngithub.com/knative/serving/pkg/activator.(*Throttler).Try\n\t/go/src/github.com/knative/serving/pkg/activator/throttler.go:129\ngithub.com/knative/serving/pkg/activator/handler.(*activationHandler).ServeHTTP\n\t/go/src/github.com/knative/serving/pkg/activator/handler/handler.go:161\ngithub.com/knative/serving/pkg/activator/handler.TestActivationHandler.func1\n\t/go/src/github.com/knative/serving/pkg/activator/handler/handler_test.go:324\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1337"}
I0516 08:08:59.654]         logger.go:130: 2019-05-16T08:08:58.528Z	WARN	TestActivationHandler/active_endpoint_(probe_failure)	handler/handler.go:115	Pod probe failed	{"knative.dev/key": "real-namespace/real-name", "error": "error roundtripping http://real-name.real-namespace.svc.cluster.local:8080: probe error", "errorVerbose": "probe error\nerror roundtripping http://real-name.real-namespace.svc.cluster.local:8080\ngithub.com/knative/serving/pkg/network/prober.Do\n\t/go/src/github.com/knative/serving/pkg/network/prober/prober.go:55\ngithub.com/knative/serving/pkg/activator/handler.(*activationHandler).probeEndpoint.func2\n\t/go/src/github.com/knative/serving/pkg/activator/handler/handler.go:113\ngithub.com/knative/serving/vendor/k8s.io/apimachinery/pkg/util/wait.WaitFor\n\t/go/src/github.com/knative/serving/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:331\ngithub.com/knative/serving/vendor/k8s.io/apimachinery/pkg/util/wait.pollInternal\n\t/go/src/github.com/knative/serving/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:227\ngithub.com/knative/serving/vendor/k8s.io/apimachinery/pkg/util/wait.pollImmediateInternal\n\t/go/src/github.com/knative/serving/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:252\ngithub.com/knative/serving/vendor/k8s.io/apimachinery/pkg/util/wait.PollImmediate\n\t/go/src/github.com/knative/serving/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:241\ngithub.com/knative/serving/pkg/activator/handler.(*activationHandler).probeEndpoint\n\t/go/src/github.com/knative/serving/pkg/activator/handler/handler.go:111\ngithub.com/knative/serving/pkg/activator/handler.(*activationHandler).ServeHTTP.func1\n\t/go/src/github.com/knative/serving/pkg/activator/handler/handler.go:166\ngithub.com/knative/serving/pkg/queue.(*Breaker).Maybe\n\t/go/src/github.com/knative/serving/pkg/queue/breaker.go:89\ngithub.com/knative/serving/pkg/activator.(*Throttler).Try\n\t/go/src/github.com/knative/serving/pkg/activator/throttler.go:129\ngithub.com/knative/serving/pkg/activator/handler.(*activationHandler).ServeHTTP\n\t/go/src/github.com/knative/serving/pkg/activator/handler/handler.go:161\ngithub.com/knative/serving/pkg/activator/handler.TestActivationHandler.func1\n\t/go/src/github.com/knative/serving/pkg/activator/handler/handler_test.go:324\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1337"}
I0516 08:08:59.655]         logger.go:130: 2019-05-16T08:08:58.529Z	DEBUG	TestActivationHandler/active_endpoint_(probe_failure)	handler/handler.go:108	Probing http://real-name.real-namespace.svc.cluster.local:8080 took 2 attempts and 2.941578ms time
I0516 08:08:59.656]     --- PASS: TestActivationHandler/active_endpoint_(probe_500) (0.01s)
I0516 08:08:59.657]         logger.go:130: 2019-05-16T08:08:58.530Z	WARN	TestActivationHandler/active_endpoint_(probe_500)	handler/handler.go:119	Pod probe unsuccessful	{"knative.dev/key": "real-namespace/real-name"}
I0516 08:08:59.658]         logger.go:130: 2019-05-16T08:08:58.541Z	WARN	TestActivationHandler/active_endpoint_(probe_500)	handler/handler.go:119	Pod probe unsuccessful	{"knative.dev/key": "real-namespace/real-name"}
I0516 08:08:59.659]         logger.go:130: 2019-05-16T08:08:58.541Z	DEBUG	TestActivationHandler/active_endpoint_(probe_500)	handler/handler.go:108	Probing http://real-name.real-namespace.svc.cluster.local:8080 took 2 attempts and 10.774387ms time
I0516 08:08:59.659]     --- PASS: TestActivationHandler/request_error (0.00s)
I0516 08:08:59.659]         logger.go:130: 2019-05-16T08:08:58.544Z	DEBUG	TestActivationHandler/request_error	handler/handler.go:108	Probing http://real-name.real-namespace.svc.cluster.local:8080 took 1 attempts and 130.23µs time
I0516 08:08:59.660]     --- PASS: TestActivationHandler/broken_get_SKS (0.00s)
I0516 08:08:59.661]         logger.go:130: 2019-05-16T08:08:58.546Z	ERROR	TestActivationHandler/broken_get_SKS	handler/handler.go:145	Error while getting SKS	{"knative.dev/key": "real-namespace/real-name", "error": "serverlessservice.networking.internal.knative.dev \"real-name\" not found"}
I0516 08:08:59.661]     --- PASS: TestActivationHandler/k8s_svc_incorrectly_spec'd (0.00s)
I0516 08:08:59.662]         logger.go:130: 2019-05-16T08:08:58.547Z	ERROR	TestActivationHandler/k8s_svc_incorrectly_spec'd	handler/handler.go:151	Error while getting hostname	{"knative.dev/key": "real-namespace/real-name", "error": "revision needs external HTTP port"}
I0516 08:08:59.663]     --- PASS: TestActivationHandler/broken_get_k8s_svc (0.00s)
I0516 08:08:59.663]         logger.go:130: 2019-05-16T08:08:58.548Z	ERROR	TestActivationHandler/broken_get_k8s_svc	handler/handler.go:151	Error while getting hostname	{"knative.dev/key": "real-namespace/real-name", "error": "service \"real-name\" not found"}
I0516 08:08:59.663]     --- PASS: TestActivationHandler/broken_get_endpoints (0.00s)
I0516 08:08:59.664]         logger.go:130: 2019-05-16T08:08:58.549Z	ERROR	TestActivationHandler/broken_get_endpoints	handler/handler.go:196	Error processing request in the activator	{"knative.dev/key": "real-namespace/real-name", "error": "endpoints \"real-name\" not found"}
I0516 08:08:59.664] === RUN   TestActivationHandler_Overflow
I0516 08:08:59.664] --- PASS: TestActivationHandler_Overflow (0.02s)
I0516 08:08:59.665]     logger.go:130: 2019-05-16T08:08:58.552Z	DEBUG	TestActivationHandler_Overflow	handler/handler.go:108	Probing http://real-name.real-namespace.svc.cluster.local:8080 took 1 attempts and 89.992µs time
I0516 08:08:59.666]     logger.go:130: 2019-05-16T08:08:58.552Z	DEBUG	TestActivationHandler_Overflow	handler/handler.go:108	Probing http://real-name.real-namespace.svc.cluster.local:8080 took 1 attempts and 146.275µs time
I0516 08:08:59.666]     logger.go:130: 2019-05-16T08:08:58.552Z	DEBUG	TestActivationHandler_Overflow	handler/handler.go:108	Probing http://real-name.real-namespace.svc.cluster.local:8080 took 1 attempts and 163.466µs time
I0516 08:08:59.667]     logger.go:130: 2019-05-16T08:08:58.553Z	DEBUG	TestActivationHandler_Overflow	handler/handler.go:108	Probing http://real-name.real-namespace.svc.cluster.local:8080 took 1 attempts and 201.047µs time
... skipping 905 lines ...
I0516 08:09:11.712] --- PASS: TestRevisionBuildRefFromName (0.00s)
I0516 08:09:11.712] === RUN   TestRevisionBuildRef
I0516 08:09:11.712] --- PASS: TestRevisionBuildRef (0.00s)
I0516 08:09:11.712] === RUN   TestRevisionBuildRefNil
I0516 08:09:11.712] --- PASS: TestRevisionBuildRefNil (0.00s)
I0516 08:09:11.713] === RUN   TestRevisionGetProtocol
I0516 08:09:11.713] === RUN   TestRevisionGetProtocol/undefined
I0516 08:09:11.713] === RUN   TestRevisionGetProtocol/http1
I0516 08:09:11.713] === RUN   TestRevisionGetProtocol/h2c
I0516 08:09:11.713] === RUN   TestRevisionGetProtocol/unknown
I0516 08:09:11.714] === RUN   TestRevisionGetProtocol/empty
I0516 08:09:11.714] --- PASS: TestRevisionGetProtocol (0.00s)
I0516 08:09:11.714]     --- PASS: TestRevisionGetProtocol/undefined (0.00s)
I0516 08:09:11.714]     --- PASS: TestRevisionGetProtocol/http1 (0.00s)
I0516 08:09:11.714]     --- PASS: TestRevisionGetProtocol/h2c (0.00s)
I0516 08:09:11.715]     --- PASS: TestRevisionGetProtocol/unknown (0.00s)
I0516 08:09:11.715]     --- PASS: TestRevisionGetProtocol/empty (0.00s)
I0516 08:09:11.715] === RUN   TestRevisionGetLastPinned
I0516 08:09:11.715] === RUN   TestRevisionGetLastPinned/Nil_annotations
... skipping 98 lines ...
I0516 08:09:11.737]     --- PASS: TestRouteConversion/revision_name (0.00s)
I0516 08:09:11.737]     --- PASS: TestRouteConversion/revision_name_(deprecated) (0.00s)
I0516 08:09:11.737]     --- PASS: TestRouteConversion/release (0.00s)
I0516 08:09:11.737]     --- PASS: TestRouteConversion/release_(deprecated) (0.00s)
I0516 08:09:11.737]     --- PASS: TestRouteConversion/name_and_tag (0.00s)
I0516 08:09:11.738]     --- SKIP: TestRouteConversion/name_and_tag_(deprecated) (0.00s)
I0516 08:09:11.738]         route_conversion_test.go:268: skipping error rows
I0516 08:09:11.738] === RUN   TestRouteDefaulting
I0516 08:09:11.738] === RUN   TestRouteDefaulting/simple
I0516 08:09:11.738] === RUN   TestRouteDefaulting/lemonade
I0516 08:09:11.739] === RUN   TestRouteDefaulting/lemonade_(conflict)
I0516 08:09:11.739] === RUN   TestRouteDefaulting/lemonade_(collision)
I0516 08:09:11.739] --- PASS: TestRouteDefaulting (0.01s)
... skipping 585 lines ...
I0516 08:09:13.779] === RUN   TestNew_ErrorWhenGivenNilInterface
I0516 08:09:13.779] --- PASS: TestNew_ErrorWhenGivenNilInterface (0.00s)
I0516 08:09:13.779] === RUN   TestNew_ErrorWhenGivenNilStatsReporter
I0516 08:09:13.779] --- PASS: TestNew_ErrorWhenGivenNilStatsReporter (0.00s)
I0516 08:09:13.780] === RUN   TestAutoscaler_NoData_NoAutoscale
I0516 08:09:13.780] --- PASS: TestAutoscaler_NoData_NoAutoscale (0.00s)
I0516 08:09:13.780]     logger.go:130: 2019-05-16T08:09:11.414Z	ERROR	TestAutoscaler_NoData_NoAutoscale	autoscaler/autoscaler.go:114	Failed to obtain metrics	{"error": "no metrics"}
I0516 08:09:13.780] === RUN   TestAutoscaler_NoDataAtZero_NoAutoscale
I0516 08:09:13.780] --- PASS: TestAutoscaler_NoDataAtZero_NoAutoscale (0.00s)
I0516 08:09:13.781]     logger.go:130: 2019-05-16T08:09:11.415Z	DEBUG	TestAutoscaler_NoDataAtZero_NoAutoscale	autoscaler/autoscaler.go:126	STABLE: Observed average 0.000 concurrency, targeting 10.
I0516 08:09:13.781]     logger.go:130: 2019-05-16T08:09:11.415Z	DEBUG	TestAutoscaler_NoDataAtZero_NoAutoscale	autoscaler/autoscaler.go:127	PANIC: Observed average 0.000 concurrency, targeting 10.
I0516 08:09:13.781]     logger.go:130: 2019-05-16T08:09:11.415Z	DEBUG	TestAutoscaler_NoDataAtZero_NoAutoscale	autoscaler/autoscaler.go:156	Operating in stable mode.
I0516 08:09:13.781] === RUN   TestAutoscaler_StableMode_NoChange
... skipping 143 lines ...
I0516 08:09:13.834]     --- PASS: TestNewHTTPScrapeClient_ErrorCases/Empty_HTTP_client (0.00s)
I0516 08:09:13.834] === RUN   TestHTTPScrapeClient_Scrape_HappyCase
I0516 08:09:13.834] --- PASS: TestHTTPScrapeClient_Scrape_HappyCase (0.00s)
I0516 08:09:13.834] === RUN   TestHTTPScrapeClient_Scrape_ErrorCases
I0516 08:09:13.835] === RUN   TestHTTPScrapeClient_Scrape_ErrorCases/Non_200_return_code
I0516 08:09:13.835] === RUN   TestHTTPScrapeClient_Scrape_ErrorCases/Error_got_when_sending_request
I0516 08:09:13.835] 2019/05/16 08:09:12 RoundTripper returned a response & error; ignoring response
I0516 08:09:13.835] === RUN   TestHTTPScrapeClient_Scrape_ErrorCases/Bad_response_context_format
I0516 08:09:13.835] === RUN   TestHTTPScrapeClient_Scrape_ErrorCases/Missing_average_concurrency
I0516 08:09:13.836] === RUN   TestHTTPScrapeClient_Scrape_ErrorCases/Missing_QPS
I0516 08:09:13.836] === RUN   TestHTTPScrapeClient_Scrape_ErrorCases/Missing_average_proxied_concurrency
I0516 08:09:13.836] === RUN   TestHTTPScrapeClient_Scrape_ErrorCases/Missing_proxied_QPS
I0516 08:09:13.836] --- PASS: TestHTTPScrapeClient_Scrape_ErrorCases (0.01s)
... skipping 8 lines ...
I0516 08:09:13.838] --- PASS: TestMultiScalerScaling (0.11s)
I0516 08:09:13.838] === RUN   TestMultiScalerScaleToZero
I0516 08:09:13.839] --- PASS: TestMultiScalerScaleToZero (0.06s)
I0516 08:09:13.839] === RUN   TestMultiScalerScaleFromZero
I0516 08:09:13.839] --- PASS: TestMultiScalerScaleFromZero (0.00s)
I0516 08:09:13.839] === RUN   TestMultiScalerIgnoreNegativeScale
I0516 08:09:13.840] {"level":"error","ts":1557994152.6520798,"logger":"fallback","caller":"autoscaler/multiscaler.go:265","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:265\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:245"}
I0516 08:09:13.840] {"level":"error","ts":1557994152.6571293,"logger":"fallback","caller":"autoscaler/multiscaler.go:265","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:265\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:245"}
I0516 08:09:13.841] {"level":"error","ts":1557994152.6620812,"logger":"fallback","caller":"autoscaler/multiscaler.go:265","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:265\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:245"}
I0516 08:09:13.841] {"level":"error","ts":1557994152.6670966,"logger":"fallback","caller":"autoscaler/multiscaler.go:265","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:265\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:245"}
I0516 08:09:13.842] {"level":"error","ts":1557994152.6721041,"logger":"fallback","caller":"autoscaler/multiscaler.go:265","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:265\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:245"}
I0516 08:09:13.842] {"level":"error","ts":1557994152.6771054,"logger":"fallback","caller":"autoscaler/multiscaler.go:265","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:265\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:245"}
I0516 08:09:13.843] {"level":"error","ts":1557994152.68205,"logger":"fallback","caller":"autoscaler/multiscaler.go:265","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:265\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:245"}
I0516 08:09:13.843] {"level":"error","ts":1557994152.687073,"logger":"fallback","caller":"autoscaler/multiscaler.go:265","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:265\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:245"}
I0516 08:09:13.844] {"level":"error","ts":1557994152.6920724,"logger":"fallback","caller":"autoscaler/multiscaler.go:265","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:265\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:245"}
I0516 08:09:13.844] {"level":"error","ts":1557994152.697072,"logger":"fallback","caller":"autoscaler/multiscaler.go:265","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:265\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:245"}
I0516 08:09:13.845] --- PASS: TestMultiScalerIgnoreNegativeScale (0.10s)
I0516 08:09:13.845] === RUN   TestMultiScalerUpdate
I0516 08:09:13.845] --- PASS: TestMultiScalerUpdate (0.00s)
I0516 08:09:13.845] === RUN   TestPopulationMeanSampleSize
I0516 08:09:13.845] --- PASS: TestPopulationMeanSampleSize (0.00s)
I0516 08:09:13.846] === RUN   TestNewStatsReporterErrors
... skipping 165 lines ...
I0516 08:09:15.692] --- PASS: TestResponseRecorder (0.00s)
I0516 08:09:15.692]     --- PASS: TestResponseRecorder/no_hijack (0.00s)
I0516 08:09:15.693]     --- PASS: TestResponseRecorder/hijack (0.00s)
I0516 08:09:15.693] PASS
I0516 08:09:15.693] ok  	github.com/knative/serving/pkg/http	1.043s
I0516 08:09:16.970] === RUN   TestNewLogger
I0516 08:09:16.971] {"level":"warn","ts":1557994155.9122055,"logger":"fallback-logger","caller":"logging/config.go:65","msg":"Fetch GitHub commit ID from kodata failed: \"KO_DATA_PATH\" does not exist or is empty"}
I0516 08:09:16.971] {"level":"warn","ts":1557994155.9191701,"logger":"fallback-logger","caller":"logging/config.go:65","msg":"Fetch GitHub commit ID from kodata failed: \"KO_DATA_PATH\" does not exist or is empty"}
I0516 08:09:16.971] {"level":"warn","ts":1557994155.9271777,"logger":"fallback-logger","caller":"logging/config.go:65","msg":"Fetch GitHub commit ID from kodata failed: \"KO_DATA_PATH\" does not exist or is empty"}
I0516 08:09:16.972] {"knative.dev/jsonconfig":"{\"level\": \"info\", \"outputPaths\": [\"stdout\"],\"errorOutputPaths\": [\"stderr\"],\"encoding\": \"json\"}"}
I0516 08:09:16.972] {}
I0516 08:09:16.972] {}
I0516 08:09:16.973] {"knative.dev/jsonconfig":"{\"level\": \"error\", \"outputPaths\": [\"stdout\"],\"errorOutputPaths\": [\"stderr\"],\"encoding\": \"json\"}"}
I0516 08:09:16.973] {}
I0516 08:09:16.973] {}
I0516 08:09:16.973] --- PASS: TestNewLogger (0.03s)
I0516 08:09:16.973] === RUN   TestNewConfigNoEntry
I0516 08:09:16.974] --- PASS: TestNewConfigNoEntry (0.00s)
I0516 08:09:16.974] === RUN   TestNewConfig
I0516 08:09:16.974] --- PASS: TestNewConfig (0.00s)
I0516 08:09:16.974] === RUN   TestOurConfig
I0516 08:09:16.975] --- PASS: TestOurConfig (0.01s)
I0516 08:09:16.975] === RUN   TestNewLoggerFromConfig
I0516 08:09:16.975] {"knative.dev/jsonconfig":"{\"level\": \"error\",\n\"outputPaths\": [\"stdout\"],\n\"errorOutputPaths\": [\"stderr\"],\n\"encoding\": \"json\"}"}
I0516 08:09:16.975] {}
I0516 08:09:16.975] {}
I0516 08:09:16.976] --- PASS: TestNewLoggerFromConfig (0.00s)
I0516 08:09:16.976] === RUN   TestEmptyLevel
I0516 08:09:16.976] --- PASS: TestEmptyLevel (0.00s)
I0516 08:09:16.976] === RUN   TestInvalidLevel
I0516 08:09:16.976] --- PASS: TestInvalidLevel (0.00s)
I0516 08:09:16.976] === RUN   TestUpdateLevelFromConfigMap
I0516 08:09:16.977] {"level":"warn","ts":1557994155.947096,"logger":"fallback-logger","caller":"logging/config.go:65","msg":"Fetch GitHub commit ID from kodata failed: \"KO_DATA_PATH\" does not exist or is empty"}
I0516 08:09:16.977] {"level":"info","ts":1557994155.9472663,"logger":"fallback-logger","caller":"logging/config.go:182","msg":"Updating logging level for controller from debug to info."}
I0516 08:09:16.977] {"level":"info","ts":1557994155.9473662,"logger":"fallback-logger","caller":"logging/config.go:182","msg":"Updating logging level for controller from info to error."}
I0516 08:09:16.978] {"level":"error","ts":1557994155.9474704,"logger":"fallback-logger","caller":"logging/config.go:176","msg":"Failed to parse the logging configmap. Previous config map will be used.","error":"invalid logging level: invalid","stacktrace":"github.com/knative/serving/vendor/github.com/knative/pkg/logging.UpdateLevelFromConfigMap.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/logging/config.go:176\ngithub.com/knative/serving/pkg/logging.TestUpdateLevelFromConfigMap\n\t/go/src/github.com/knative/serving/pkg/logging/config_test.go:269\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:16.978] --- PASS: TestUpdateLevelFromConfigMap (0.01s)
I0516 08:09:16.978] === RUN   TestWrite
I0516 08:09:16.978] --- PASS: TestWrite (0.00s)
I0516 08:09:16.979] PASS
I0516 08:09:16.979] ok  	github.com/knative/serving/pkg/logging	1.108s
I0516 08:09:18.309] === RUN   TestOurObservability
... skipping 89 lines ...
I0516 08:09:23.504]     --- PASS: TestDoServing/wrong_system (0.00s)
I0516 08:09:23.504]     --- PASS: TestDoServing/no_header (0.00s)
I0516 08:09:23.505] === RUN   TestBlackHole
I0516 08:09:23.505] --- PASS: TestBlackHole (0.01s)
I0516 08:09:23.505] === RUN   TestBadURL
I0516 08:09:23.505] --- PASS: TestBadURL (0.00s)
I0516 08:09:23.505]     prober_test.go:99: For the curious the error was: :foo is not a valid URL: parse :foo: missing protocol scheme
I0516 08:09:23.506] === RUN   TestDoAsync
I0516 08:09:23.506] === RUN   TestDoAsync/ok
I0516 08:09:23.506] === RUN   TestDoAsync/wrong_system
I0516 08:09:23.506] === RUN   TestDoAsync/no_header
I0516 08:09:23.507] --- PASS: TestDoAsync (4.04s)
I0516 08:09:23.507]     --- PASS: TestDoAsync/ok (0.00s)
... skipping 285 lines ...
I0516 08:09:34.959] {"level":"warn","ts":1557994173.423579,"logger":"fallback","caller":"hpa/hpa.go:119","msg":"Ignoring non-hpa-class PA"}
I0516 08:09:34.959] === RUN   TestReconcile/nop_deletion_reconcile
I0516 08:09:34.959] === RUN   TestReconcile/delete_hpa_when_pa_does_not_exist
I0516 08:09:34.959] {"level":"info","ts":1557994173.5326707,"logger":"fallback","caller":"hpa/hpa.go:256","msg":"Deleted HPA \"test-revision\""}
I0516 08:09:34.960] === RUN   TestReconcile/attempt_to_delete_non-existent_hpa_when_pa_does_not_exist
I0516 08:09:34.960] === RUN   TestReconcile/failure_to_delete_hpa
I0516 08:09:34.961] {"level":"error","ts":1557994173.6305926,"logger":"fallback","caller":"hpa/hpa.go:253","msg":"Error deleting HPA \"test-revision\": inducing failure for delete horizontalpodautoscalers","stacktrace":"github.com/knative/serving/pkg/reconciler/autoscaling/hpa.(*Reconciler).deleteHPA\n\t/go/src/github.com/knative/serving/pkg/reconciler/autoscaling/hpa/hpa.go:253\ngithub.com/knative/serving/pkg/reconciler/autoscaling/hpa.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/autoscaling/hpa/hpa.go:113\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:34.961] === RUN   TestReconcile/update_pa_fails
I0516 08:09:34.962] {"level":"warn","ts":1557994173.6806688,"logger":"fallback","caller":"hpa/hpa.go:134","msg":"Failed to update pa status","error":"inducing failure for update podautoscalers"}
I0516 08:09:34.962] === RUN   TestReconcile/update_hpa_fails
I0516 08:09:34.962] {"level":"info","ts":1557994173.748141,"logger":"fallback","caller":"hpa/hpa.go:183","msg":"Updating HPA \"test-revision\""}
I0516 08:09:34.963] {"level":"error","ts":1557994173.7484577,"logger":"fallback","caller":"hpa/hpa.go:185","msg":"Error updating HPA \"test-revision\": inducing failure for update horizontalpodautoscalers","stacktrace":"github.com/knative/serving/pkg/reconciler/autoscaling/hpa.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/autoscaling/hpa/hpa.go:185\ngithub.com/knative/serving/pkg/reconciler/autoscaling/hpa.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/autoscaling/hpa/hpa.go:127\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:34.963] === RUN   TestReconcile/update_hpa_with_target_usage
I0516 08:09:34.964] {"level":"info","ts":1557994173.8039489,"logger":"fallback","caller":"hpa/hpa.go:183","msg":"Updating HPA \"test-revision\""}
I0516 08:09:34.964] === RUN   TestReconcile/invalid_key
I0516 08:09:34.964] E0516 08:09:33.855045   22220 hpa.go:104] invalid resource key sandwich///: unexpected key format: "sandwich///"
I0516 08:09:34.965] === RUN   TestReconcile/failure_to_create_hpa
I0516 08:09:34.965] {"level":"info","ts":1557994173.9052877,"logger":"fallback","caller":"hpa/hpa.go:168","msg":"Creating HPA \"test-revision\""}
I0516 08:09:34.966] {"level":"error","ts":1557994173.905511,"logger":"fallback","caller":"hpa/hpa.go:170","msg":"Error creating HPA \"test-revision\": inducing failure for create horizontalpodautoscalers","stacktrace":"github.com/knative/serving/pkg/reconciler/autoscaling/hpa.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/autoscaling/hpa/hpa.go:170\ngithub.com/knative/serving/pkg/reconciler/autoscaling/hpa.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/autoscaling/hpa/hpa.go:127\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:34.966] --- PASS: TestReconcile (1.24s)
I0516 08:09:34.966]     --- PASS: TestReconcile/no_op (0.05s)
I0516 08:09:34.967]     --- PASS: TestReconcile/create_hpa_&_sks (0.05s)
I0516 08:09:34.967]     --- PASS: TestReconcile/reconcile_sks_is_still_not_ready (0.05s)
I0516 08:09:34.967]     --- PASS: TestReconcile/reconcile_sks_becomes_ready (0.05s)
I0516 08:09:34.967]     --- PASS: TestReconcile/reconcile_sks (0.07s)
... skipping 53 lines ...
I0516 08:09:42.769] {"level":"info","ts":1557994176.0584338,"logger":"fallback","caller":"kpa/kpa.go:373","msg":"K8s service test-namespace/test-revision-metrics does not exist; creating."}
I0516 08:09:42.769] === RUN   TestReconcile/scale_up_deployment
I0516 08:09:42.769] {"level":"info","ts":1557994176.2345073,"logger":"fallback","caller":"kpa/scaler.go:284","msg":"Scaling from 1 to 11"}
I0516 08:09:42.770] {"level":"info","ts":1557994176.2353508,"logger":"fallback","caller":"kpa/kpa.go:281","msg":"PA scale got=1, want=11"}
I0516 08:09:42.771] === RUN   TestReconcile/scale_up_deployment_failure
I0516 08:09:42.771] {"level":"info","ts":1557994176.3891606,"logger":"fallback","caller":"kpa/scaler.go:284","msg":"Scaling from 1 to 11"}
I0516 08:09:42.774] {"level":"error","ts":1557994176.3902645,"logger":"fallback","caller":"kpa/scaler.go:241","msg":"Error scaling target reference test-revision-deployment","error":"inducing failure for patch deployments","stacktrace":"github.com/knative/serving/pkg/reconciler/autoscaling/kpa.(*scaler).applyScale\n\t/go/src/github.com/knative/serving/pkg/reconciler/autoscaling/kpa/scaler.go:241\ngithub.com/knative/serving/pkg/reconciler/autoscaling/kpa.(*scaler).Scale\n\t/go/src/github.com/knative/serving/pkg/reconciler/autoscaling/kpa/scaler.go:285\ngithub.com/knative/serving/pkg/reconciler/autoscaling/kpa.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/autoscaling/kpa/kpa.go:264\ngithub.com/knative/serving/pkg/reconciler/autoscaling/kpa.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/autoscaling/kpa/kpa.go:206\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:42.774] === RUN   TestReconcile/update_metrics_service
I0516 08:09:42.775] {"level":"info","ts":1557994176.5690422,"logger":"fallback","caller":"kpa/kpa.go:392","msg":"Metrics K8s Service changed; reconciling:test-revision-metrics"}
I0516 08:09:42.776] {"level":"info","ts":1557994176.5695715,"logger":"fallback","caller":"kpa/kpa.go:281","msg":"PA scale got=1, want=11"}
I0516 08:09:42.777] === RUN   TestReconcile/update_metrics_service_fails
I0516 08:09:42.778] {"level":"info","ts":1557994176.7538495,"logger":"fallback","caller":"kpa/kpa.go:392","msg":"Metrics K8s Service changed; reconciling:test-revision-metrics"}
I0516 08:09:42.779] === RUN   TestReconcile/metrics_service_isn't_owned
... skipping 132 lines ...
I0516 08:09:42.836]     logger.go:130: 2019-05-16T08:09:39.711Z	INFO	TestEmptyEndpoints.kpa-class-podautoscaler-controller.config-store	configmap/store.go:166	autoscaler config "config-autoscaler" config was added or updated: &{true 0.5 10 1 5m0s 10 200 10s 2s 1m0s}	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.836] === RUN   TestControllerCreateError
I0516 08:09:42.837] {"level":"info","ts":1557994179.9308496,"logger":"fallback","caller":"kpa/kpa.go:373","msg":"K8s service test-namespace/test-revision-metrics does not exist; creating."}
I0516 08:09:42.837] {"level":"info","ts":1557994179.9312086,"logger":"fallback","caller":"kpa/kpa.go:379","msg":"Created K8s service:test-revision-metrics"}
I0516 08:09:42.837] {"level":"info","ts":1557994179.9313526,"logger":"fallback","caller":"kpa/kpa.go:333","msg":"SKS test-namespace/test-revision does not exist; creating."}
I0516 08:09:42.837] {"level":"info","ts":1557994179.9316006,"logger":"fallback","caller":"kpa/kpa.go:339","msg":"Created SKS:test-revision"}
I0516 08:09:42.839] E0516 08:09:39.931942   22241 event.go:259] Could not construct reference to: '&v1alpha1.PodAutoscaler{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-revision", GenerateName:"", Namespace:"test-namespace", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"test-revision", "serving.knative.dev/revision":"test-revision", "serving.knative.dev/revisionUID":""}, Annotations:map[string]string{"autoscaling.knative.dev/class":"kpa.autoscaling.knative.dev", "autoscaling.knative.dev/metric":"concurrency"}, OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"serving.knative.dev/v1alpha1", Kind:"Revision", Name:"test-revision", UID:"", Controller:(*bool)(0xc000dcdf98), BlockOwnerDeletion:(*bool)(0xc000dcdf99)}}, Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Spec:v1alpha1.PodAutoscalerSpec{DeprecatedGeneration:0, DeprecatedConcurrencyModel:"", ContainerConcurrency:0, ScaleTargetRef:v1.ObjectReference{Kind:"Deployment", Namespace:"", Name:"test-revision-deployment", UID:"", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}, DeprecatedServiceName:"", ProtocolType:"http1"}, Status:v1alpha1.PodAutoscalerStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:"Active", Status:"Unknown", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f6490f12b9a86, ext:5278012574, loc:(*time.Location)(0x3351de0)}}}, Reason:"", Message:""}, apis.Condition{Type:"Ready", Status:"Unknown", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f6490f12b6f64, ext:5278001541, loc:(*time.Location)(0x3351de0)}}}, Reason:"", Message:""}}}, ServiceName:""}}' due to: 'selfLink was empty, can't make reference'. Will not report event: 'Warning' 'InternalError' 'error reconciling decider: error creating decider: asdf'
I0516 08:09:42.840] --- PASS: TestControllerCreateError (0.11s)
I0516 08:09:42.840]     logger.go:130: 2019-05-16T08:09:39.820Z	DEBUG	TestControllerCreateError.kpa-class-podautoscaler-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.840]     logger.go:130: 2019-05-16T08:09:39.822Z	DEBUG	TestControllerCreateError.kpa-class-podautoscaler-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.841]     logger.go:130: 2019-05-16T08:09:39.822Z	INFO	TestControllerCreateError.kpa-class-podautoscaler-controller	kpa/kpa.go:136	Setting up KPA-Class event handlers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.841]     logger.go:130: 2019-05-16T08:09:39.823Z	INFO	TestControllerCreateError.kpa-class-podautoscaler-controller	kpa/kpa.go:161	Setting up ConfigMap receivers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.842]     logger.go:130: 2019-05-16T08:09:39.823Z	INFO	TestControllerCreateError.kpa-class-podautoscaler-controller.config-store	configmap/store.go:166	autoscaler config "config-autoscaler" config was added or updated: &{true 0.5 10 1 5m0s 10 200 10s 2s 1m0s}	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.842] === RUN   TestControllerUpdateError
I0516 08:09:42.842] {"level":"info","ts":1557994180.0399055,"logger":"fallback","caller":"kpa/kpa.go:373","msg":"K8s service test-namespace/test-revision-metrics does not exist; creating."}
I0516 08:09:42.843] {"level":"info","ts":1557994180.0402646,"logger":"fallback","caller":"kpa/kpa.go:379","msg":"Created K8s service:test-revision-metrics"}
I0516 08:09:42.843] {"level":"info","ts":1557994180.0403984,"logger":"fallback","caller":"kpa/kpa.go:333","msg":"SKS test-namespace/test-revision does not exist; creating."}
I0516 08:09:42.843] {"level":"info","ts":1557994180.0406919,"logger":"fallback","caller":"kpa/kpa.go:339","msg":"Created SKS:test-revision"}
I0516 08:09:42.845] E0516 08:09:40.041160   22241 event.go:259] Could not construct reference to: '&v1alpha1.PodAutoscaler{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-revision", GenerateName:"", Namespace:"test-namespace", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"test-revision", "serving.knative.dev/revision":"test-revision", "serving.knative.dev/revisionUID":""}, Annotations:map[string]string{"autoscaling.knative.dev/class":"kpa.autoscaling.knative.dev", "autoscaling.knative.dev/metric":"concurrency"}, OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"serving.knative.dev/v1alpha1", Kind:"Revision", Name:"test-revision", UID:"", Controller:(*bool)(0xc000b1aad4), BlockOwnerDeletion:(*bool)(0xc000b1aad5)}}, Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Spec:v1alpha1.PodAutoscalerSpec{DeprecatedGeneration:0, DeprecatedConcurrencyModel:"", ContainerConcurrency:0, ScaleTargetRef:v1.ObjectReference{Kind:"Deployment", Namespace:"", Name:"test-revision-deployment", UID:"", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}, DeprecatedServiceName:"", ProtocolType:"http1"}, Status:v1alpha1.PodAutoscalerStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:"Active", Status:"Unknown", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f6490f7f496c1, ext:5391847640, loc:(*time.Location)(0x3351de0)}}}, Reason:"", Message:""}, apis.Condition{Type:"Ready", Status:"Unknown", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f6490f7f4734d, ext:5391838576, loc:(*time.Location)(0x3351de0)}}}, Reason:"", Message:""}}}, ServiceName:""}}' due to: 'selfLink was empty, can't make reference'. Will not report event: 'Warning' 'InternalError' 'error reconciling decider: error creating decider: asdf'
I0516 08:09:42.846] --- PASS: TestControllerUpdateError (0.11s)
I0516 08:09:42.846]     logger.go:130: 2019-05-16T08:09:39.933Z	DEBUG	TestControllerUpdateError.kpa-class-podautoscaler-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.846]     logger.go:130: 2019-05-16T08:09:39.936Z	DEBUG	TestControllerUpdateError.kpa-class-podautoscaler-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.847]     logger.go:130: 2019-05-16T08:09:39.936Z	INFO	TestControllerUpdateError.kpa-class-podautoscaler-controller	kpa/kpa.go:136	Setting up KPA-Class event handlers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.847]     logger.go:130: 2019-05-16T08:09:39.937Z	INFO	TestControllerUpdateError.kpa-class-podautoscaler-controller	kpa/kpa.go:161	Setting up ConfigMap receivers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.848]     logger.go:130: 2019-05-16T08:09:39.937Z	INFO	TestControllerUpdateError.kpa-class-podautoscaler-controller.config-store	configmap/store.go:166	autoscaler config "config-autoscaler" config was added or updated: &{true 0.5 10 1 5m0s 10 200 10s 2s 1m0s}	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.848] === RUN   TestControllerGetError
I0516 08:09:42.848] {"level":"info","ts":1557994180.1521895,"logger":"fallback","caller":"kpa/kpa.go:373","msg":"K8s service test-namespace/test-revision-metrics does not exist; creating."}
I0516 08:09:42.849] {"level":"info","ts":1557994180.1525896,"logger":"fallback","caller":"kpa/kpa.go:379","msg":"Created K8s service:test-revision-metrics"}
I0516 08:09:42.849] {"level":"info","ts":1557994180.1527941,"logger":"fallback","caller":"kpa/kpa.go:333","msg":"SKS test-namespace/test-revision does not exist; creating."}
I0516 08:09:42.849] {"level":"info","ts":1557994180.1529984,"logger":"fallback","caller":"kpa/kpa.go:339","msg":"Created SKS:test-revision"}
I0516 08:09:42.851] E0516 08:09:40.153243   22241 event.go:259] Could not construct reference to: '&v1alpha1.PodAutoscaler{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-revision", GenerateName:"", Namespace:"test-namespace", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"test-revision", "serving.knative.dev/revision":"test-revision", "serving.knative.dev/revisionUID":""}, Annotations:map[string]string{"autoscaling.knative.dev/class":"kpa.autoscaling.knative.dev", "autoscaling.knative.dev/metric":"concurrency"}, OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"serving.knative.dev/v1alpha1", Kind:"Revision", Name:"test-revision", UID:"", Controller:(*bool)(0xc0005518a8), BlockOwnerDeletion:(*bool)(0xc0005518a9)}}, Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Spec:v1alpha1.PodAutoscalerSpec{DeprecatedGeneration:0, DeprecatedConcurrencyModel:"", ContainerConcurrency:0, ScaleTargetRef:v1.ObjectReference{Kind:"Deployment", Namespace:"", Name:"test-revision-deployment", UID:"", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}, DeprecatedServiceName:"", ProtocolType:"http1"}, Status:v1alpha1.PodAutoscalerStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:"Active", Status:"Unknown", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649102cb136e, ext:5499934628, loc:(*time.Location)(0x3351de0)}}}, Reason:"", Message:""}, apis.Condition{Type:"Ready", Status:"Unknown", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649102cae34a, ext:5499922284, loc:(*time.Location)(0x3351de0)}}}, Reason:"", Message:""}}}, ServiceName:""}}' due to: 'selfLink was empty, can't make reference'. Will not report event: 'Warning' 'InternalError' 'error reconciling decider: error fetching decider: asdf'
I0516 08:09:42.852] --- PASS: TestControllerGetError (0.11s)
I0516 08:09:42.852]     logger.go:130: 2019-05-16T08:09:40.042Z	DEBUG	TestControllerGetError.kpa-class-podautoscaler-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.852]     logger.go:130: 2019-05-16T08:09:40.044Z	DEBUG	TestControllerGetError.kpa-class-podautoscaler-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.853]     logger.go:130: 2019-05-16T08:09:40.044Z	INFO	TestControllerGetError.kpa-class-podautoscaler-controller	kpa/kpa.go:136	Setting up KPA-Class event handlers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.853]     logger.go:130: 2019-05-16T08:09:40.045Z	INFO	TestControllerGetError.kpa-class-podautoscaler-controller	kpa/kpa.go:161	Setting up ConfigMap receivers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.854]     logger.go:130: 2019-05-16T08:09:40.045Z	INFO	TestControllerGetError.kpa-class-podautoscaler-controller.config-store	configmap/store.go:166	autoscaler config "config-autoscaler" config was added or updated: &{true 0.5 10 1 5m0s 10 200 10s 2s 1m0s}	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.854] === RUN   TestScaleFailure
I0516 08:09:42.854] {"level":"info","ts":1557994180.2649007,"logger":"fallback","caller":"kpa/kpa.go:373","msg":"K8s service test-namespace/test-revision-metrics does not exist; creating."}
I0516 08:09:42.855] {"level":"info","ts":1557994180.2652688,"logger":"fallback","caller":"kpa/kpa.go:379","msg":"Created K8s service:test-revision-metrics"}
I0516 08:09:42.855] {"level":"info","ts":1557994180.265476,"logger":"fallback","caller":"kpa/kpa.go:333","msg":"SKS test-namespace/test-revision does not exist; creating."}
I0516 08:09:42.855] {"level":"info","ts":1557994180.2657058,"logger":"fallback","caller":"kpa/kpa.go:339","msg":"Created SKS:test-revision"}
I0516 08:09:42.856] {"level":"info","ts":1557994180.2659175,"logger":"fallback","caller":"kpa/kpa.go:281","msg":"PA scale got=0, want=-1"}
I0516 08:09:42.856] {"level":"warn","ts":1557994180.2662497,"logger":"fallback","caller":"kpa/kpa.go:213","msg":"Failed to update kpa status","error":"podautoscalers.autoscaling.internal.knative.dev \"test-revision\" not found"}
I0516 08:09:42.858] E0516 08:09:40.266404   22241 event.go:259] Could not construct reference to: '&v1alpha1.PodAutoscaler{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-revision", GenerateName:"", Namespace:"test-namespace", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"test-revision", "serving.knative.dev/revision":"test-revision", "serving.knative.dev/revisionUID":""}, Annotations:map[string]string{"autoscaling.knative.dev/class":"kpa.autoscaling.knative.dev", "autoscaling.knative.dev/metric":"concurrency"}, OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"serving.knative.dev/v1alpha1", Kind:"Revision", Name:"test-revision", UID:"", Controller:(*bool)(0xc000551e24), BlockOwnerDeletion:(*bool)(0xc000551e25)}}, Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Spec:v1alpha1.PodAutoscalerSpec{DeprecatedGeneration:0, DeprecatedConcurrencyModel:"", ContainerConcurrency:0, ScaleTargetRef:v1.ObjectReference{Kind:"Deployment", Namespace:"", Name:"test-revision-deployment", UID:"", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}, DeprecatedServiceName:"", ProtocolType:"http1"}, Status:v1alpha1.PodAutoscalerStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:"Active", Status:"Unknown", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649109872359, ext:5612922744, loc:(*time.Location)(0x3351de0)}}}, Reason:"", Message:""}, apis.Condition{Type:"Ready", Status:"Unknown", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f64910987013a, ext:5612914084, loc:(*time.Location)(0x3351de0)}}}, Reason:"", Message:""}}}, ServiceName:""}}' due to: 'selfLink was empty, can't make reference'. Will not report event: 'Warning' 'UpdateFailed' 'Failed to update status for PA "test-revision": podautoscalers.autoscaling.internal.knative.dev "test-revision" not found'
I0516 08:09:42.858] --- PASS: TestScaleFailure (0.11s)
I0516 08:09:42.859]     logger.go:130: 2019-05-16T08:09:40.155Z	DEBUG	TestScaleFailure.kpa-class-podautoscaler-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.859]     logger.go:130: 2019-05-16T08:09:40.156Z	DEBUG	TestScaleFailure.kpa-class-podautoscaler-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.860]     logger.go:130: 2019-05-16T08:09:40.157Z	INFO	TestScaleFailure.kpa-class-podautoscaler-controller	kpa/kpa.go:136	Setting up KPA-Class event handlers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.860]     logger.go:130: 2019-05-16T08:09:40.158Z	INFO	TestScaleFailure.kpa-class-podautoscaler-controller	kpa/kpa.go:161	Setting up ConfigMap receivers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I0516 08:09:42.860]     logger.go:130: 2019-05-16T08:09:40.158Z	INFO	TestScaleFailure.kpa-class-podautoscaler-controller.config-store	configmap/store.go:166	autoscaler config "config-autoscaler" config was added or updated: &{true 0.5 10 1 5m0s 10 200 10s 2s 1m0s}	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
... skipping 143 lines ...
I0516 08:09:43.140]     logger.go:130: 2019-05-16T08:09:41.848Z	INFO	TestNewController.certificate-controller	certificate/certificate.go:85	Setting up event handlers	{"knative.dev/controller": "certificate-controller"}
I0516 08:09:43.140]     logger.go:130: 2019-05-16T08:09:41.848Z	INFO	TestNewController.certificate-controller	certificate/certificate.go:98	Setting up ConfigMap receivers	{"knative.dev/controller": "certificate-controller"}
I0516 08:09:43.140]     logger.go:130: 2019-05-16T08:09:41.849Z	INFO	TestNewController.certificate-controller.config-store	configmap/store.go:166	certificate config "config-certmanager" config was added or updated: &{0xc00043f6e0 0xc0000d1200}	{"knative.dev/controller": "certificate-controller"}
I0516 08:09:43.140] === RUN   TestReconcile
I0516 08:09:43.141] === RUN   TestReconcile/bad_workqueue_key
I0516 08:09:43.141] === RUN   TestReconcile/key_not_found
I0516 08:09:43.141] {"level":"error","ts":1557994181.912415,"logger":"fallback","caller":"certificate/certificate.go:126","msg":"Knative Certificate foo/not-found in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/certificate.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/certificate/certificate.go:126\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:43.142] === RUN   TestReconcile/create_CM_certificate_matching_Knative_Certificate
I0516 08:09:43.142] {"level":"info","ts":1557994181.9423938,"logger":"fallback","caller":"certificate/certificate.go:161","msg":"Reconciling Cert-Manager certificate for Knative cert %s/%s.fooknCert"}
I0516 08:09:43.142] === RUN   TestReconcile/reconcile_CM_certificate_to_match_desired_one
I0516 08:09:43.142] {"level":"info","ts":1557994181.9894183,"logger":"fallback","caller":"certificate/certificate.go:161","msg":"Reconciling Cert-Manager certificate for Knative cert %s/%s.fooknCert"}
I0516 08:09:43.143] === RUN   TestReconcile/set_Knative_Certificate_ready_status_with_CM_Certificate_ready_status
I0516 08:09:43.143] {"level":"info","ts":1557994182.0308692,"logger":"fallback","caller":"certificate/certificate.go:161","msg":"Reconciling Cert-Manager certificate for Knative cert %s/%s.fooknCert"}
I0516 08:09:43.143] === RUN   TestReconcile/set_Knative_Certificate_unknown_status_with_CM_Certificate_unknown_status
I0516 08:09:43.143] {"level":"info","ts":1557994182.0668054,"logger":"fallback","caller":"certificate/certificate.go:161","msg":"Reconciling Cert-Manager certificate for Knative cert %s/%s.fooknCert"}
I0516 08:09:43.144] === RUN   TestReconcile/set_Knative_Certificate_not_ready_status_with_CM_Certificate_not_ready_status
I0516 08:09:43.144] {"level":"info","ts":1557994182.100559,"logger":"fallback","caller":"certificate/certificate.go:161","msg":"Reconciling Cert-Manager certificate for Knative cert %s/%s.fooknCert"}
I0516 08:09:43.144] --- PASS: TestReconcile (0.26s)
I0516 08:09:43.144]     --- PASS: TestReconcile/bad_workqueue_key (0.04s)
I0516 08:09:43.144]         logger.go:130: 2019-05-16T08:09:41.887Z	ERROR	TestReconcile/bad_workqueue_key.certificate-controller	certificate/certificate.go:118	invalid resource key: too/many/parts	{"knative.dev/controller": "certificate-controller"}
I0516 08:09:43.145]     --- PASS: TestReconcile/key_not_found (0.02s)
I0516 08:09:43.145]     --- PASS: TestReconcile/create_CM_certificate_matching_Knative_Certificate (0.04s)
I0516 08:09:43.145]     --- PASS: TestReconcile/reconcile_CM_certificate_to_match_desired_one (0.05s)
I0516 08:09:43.145]     --- PASS: TestReconcile/set_Knative_Certificate_ready_status_with_CM_Certificate_ready_status (0.03s)
I0516 08:09:43.145]     --- PASS: TestReconcile/set_Knative_Certificate_unknown_status_with_CM_Certificate_unknown_status (0.03s)
I0516 08:09:43.145]     --- PASS: TestReconcile/set_Knative_Certificate_not_ready_status_with_CM_Certificate_not_ready_status (0.03s)
... skipping 40 lines ...
I0516 08:09:51.742] {"level":"info","ts":1557994189.4659367,"logger":"fallback","caller":"clusteringress/clusteringress.go:222","msg":"Reconciling clusterIngress: &v1alpha1.ClusterIngress{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"reconciling-clusteringress\", GenerateName:\"\", Namespace:\"\", SelfLink:\"\", UID:\"\", ResourceVersion:\"v1\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{\"serving.knative.dev/route\":\"test-route\", \"serving.knative.dev/routeNamespace\":\"test-ns\"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.IngressSpec{DeprecatedGeneration:1234, TLS:[]v1alpha1.ClusterIngressTLS{v1alpha1.ClusterIngressTLS{Hosts:[]string{\"host-tls.example.com\"}, SecretName:\"secret0\", SecretNamespace:\"istio-system\", ServerCertificate:\"tls.crt\", PrivateKey:\"tls.key\"}}, Rules:[]v1alpha1.ClusterIngressRule{v1alpha1.ClusterIngressRule{Hosts:[]string{\"domain.com\", \"test-route.test-ns.svc.cluster.local\", \"test-route.test-ns.svc\", \"test-route.test-ns\"}, HTTP:(*v1alpha1.HTTPClusterIngressRuleValue)(0xc00065b9a0)}}, Visibility:\"ExternalIP\"}, Status:v1alpha1.IngressStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"LoadBalancerReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f64935bba8fbb, ext:136613364, loc:(*time.Location)(0x3280760)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"NetworkConfigured\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f64935bba523e, ext:136597606, loc:(*time.Location)(0x3280760)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f64935bba31c9, ext:136589342, loc:(*time.Location)(0x3280760)}}}, Reason:\"\", Message:\"\"}}}, LoadBalancer:(*v1alpha1.LoadBalancerStatus)(nil)}}"}
I0516 08:09:51.743] {"level":"info","ts":1557994189.4664307,"logger":"fallback","caller":"clusteringress/clusteringress.go:223","msg":"Creating/Updating VirtualService"}
I0516 08:09:51.743] {"level":"info","ts":1557994189.468956,"logger":"fallback","caller":"clusteringress/clusteringress.go:274","msg":"ClusterIngress successfully synced"}
I0516 08:09:51.743] === RUN   TestReconcile_EnableAutoTLS/No_preinstalled_Gateways
I0516 08:09:51.745] {"level":"info","ts":1557994189.57144,"logger":"fallback","caller":"clusteringress/clusteringress.go:222","msg":"Reconciling clusterIngress: &v1alpha1.ClusterIngress{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"reconciling-clusteringress\", GenerateName:\"\", Namespace:\"\", SelfLink:\"\", UID:\"\", ResourceVersion:\"v1\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{\"serving.knative.dev/route\":\"test-route\", \"serving.knative.dev/routeNamespace\":\"test-ns\"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.IngressSpec{DeprecatedGeneration:1234, TLS:[]v1alpha1.ClusterIngressTLS{v1alpha1.ClusterIngressTLS{Hosts:[]string{\"host-tls.example.com\"}, SecretName:\"secret0\", SecretNamespace:\"istio-system\", ServerCertificate:\"tls.crt\", PrivateKey:\"tls.key\"}}, Rules:[]v1alpha1.ClusterIngressRule{v1alpha1.ClusterIngressRule{Hosts:[]string{\"domain.com\", \"test-route.test-ns.svc.cluster.local\", \"test-route.test-ns.svc\", \"test-route.test-ns\"}, HTTP:(*v1alpha1.HTTPClusterIngressRuleValue)(0xc00062f3a0)}}, Visibility:\"ExternalIP\"}, Status:v1alpha1.IngressStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"LoadBalancerReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f64936206941d, ext:242258516, loc:(*time.Location)(0x3280760)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"NetworkConfigured\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649362066365, ext:242246037, loc:(*time.Location)(0x3280760)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f6493620642c2, ext:242237724, loc:(*time.Location)(0x3280760)}}}, Reason:\"\", Message:\"\"}}}, LoadBalancer:(*v1alpha1.LoadBalancerStatus)(nil)}}"}
I0516 08:09:51.746] {"level":"info","ts":1557994189.571893,"logger":"fallback","caller":"clusteringress/clusteringress.go:223","msg":"Creating/Updating VirtualService"}
I0516 08:09:51.747] {"level":"error","ts":1557994189.574024,"logger":"fallback","caller":"clusteringress/clusteringress.go:430","msg":"Failed to get Gateway.","error":"gateway.networking.istio.io \"knative-ingress-gateway\" not found","stacktrace":"github.com/knative/serving/pkg/reconciler/clusteringress.(*Reconciler).reconcileGateway\n\t/go/src/github.com/knative/serving/pkg/reconciler/clusteringress/clusteringress.go:430\ngithub.com/knative/serving/pkg/reconciler/clusteringress.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/clusteringress/clusteringress.go:267\ngithub.com/knative/serving/pkg/reconciler/clusteringress.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/clusteringress/clusteringress.go:171\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:51.747] === RUN   TestReconcile_EnableAutoTLS/delete_ClusterIngress
I0516 08:09:51.747] {"level":"info","ts":1557994189.657259,"logger":"fallback","caller":"clusteringress/clusteringress.go:407","msg":"Cleaning up Gateway Servers for ClusterIngress reconciling-clusteringress"}
I0516 08:09:51.748] {"level":"info","ts":1557994189.6575773,"logger":"fallback","caller":"clusteringress/clusteringress.go:416","msg":"Removing Finalizer"}
I0516 08:09:51.748] === RUN   TestReconcile_EnableAutoTLS/TLS_Secret_is_not_in_the_namespace_of_Istio_gateway_service
I0516 08:09:51.750] {"level":"info","ts":1557994189.744865,"logger":"fallback","caller":"clusteringress/clusteringress.go:222","msg":"Reconciling clusterIngress: &v1alpha1.ClusterIngress{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"reconciling-clusteringress\", GenerateName:\"\", Namespace:\"\", SelfLink:\"\", UID:\"\", ResourceVersion:\"v1\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{\"serving.knative.dev/route\":\"test-route\", \"serving.knative.dev/routeNamespace\":\"test-ns\"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.IngressSpec{DeprecatedGeneration:1234, TLS:[]v1alpha1.ClusterIngressTLS{v1alpha1.ClusterIngressTLS{Hosts:[]string{\"host-tls.example.com\"}, SecretName:\"secret0\", SecretNamespace:\"knative-serving\", ServerCertificate:\"tls.crt\", PrivateKey:\"tls.key\"}}, Rules:[]v1alpha1.ClusterIngressRule{v1alpha1.ClusterIngressRule{Hosts:[]string{\"domain.com\", \"test-route.test-ns.svc.cluster.local\", \"test-route.test-ns.svc\", \"test-route.test-ns\"}, HTTP:(*v1alpha1.HTTPClusterIngressRuleValue)(0xc0005a9780)}}, Visibility:\"ExternalIP\"}, Status:v1alpha1.IngressStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"LoadBalancerReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f64936c5d97bf, ext:415733214, loc:(*time.Location)(0x3280760)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"NetworkConfigured\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f64936c5d6de5, ext:415722503, loc:(*time.Location)(0x3280760)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f64936c5d5207, ext:415715416, loc:(*time.Location)(0x3280760)}}}, Reason:\"\", Message:\"\"}}}, LoadBalancer:(*v1alpha1.LoadBalancerStatus)(nil)}}"}
I0516 08:09:51.750] {"level":"info","ts":1557994189.7453146,"logger":"fallback","caller":"clusteringress/clusteringress.go:223","msg":"Creating/Updating VirtualService"}
... skipping 155 lines ...
I0516 08:09:51.809]     --- PASS: TestNamer/VirtualService (0.00s)
I0516 08:09:51.809] PASS
I0516 08:09:51.809] ok  	github.com/knative/serving/pkg/reconciler/clusteringress/resources/names	1.148s
I0516 08:09:58.216] === RUN   TestReconcile
I0516 08:09:58.217] === RUN   TestReconcile/bad_workqueue_key
I0516 08:09:58.217] === RUN   TestReconcile/key_not_found
I0516 08:09:58.218] {"level":"error","ts":1557994195.2001426,"logger":"fallback","caller":"configuration/configuration.go:116","msg":"configuration \"foo/not-found\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/configuration.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/configuration/configuration.go:116\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:58.218] === RUN   TestReconcile/nop_deletion_reconcile
I0516 08:09:58.219] {"level":"error","ts":1557994195.2608254,"logger":"fallback","caller":"configuration/configuration.go:116","msg":"configuration \"foo/delete-pending\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/configuration.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/configuration/configuration.go:116\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:58.219] === RUN   TestReconcile/create_revision_matching_generation
I0516 08:09:58.221] {"level":"info","ts":1557994195.3144066,"logger":"fallback","caller":"configuration/configuration.go:341","msg":"Created Revision: &{TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:no-revisions-yet-00001 GenerateName:no-revisions-yet- Namespace:foo SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[serving.knative.dev/configuration:no-revisions-yet serving.knative.dev/configurationGeneration:1234 serving.knative.dev/service:] Annotations:map[] OwnerReferences:[{APIVersion:serving.knative.dev/v1alpha1 Kind:Configuration Name:no-revisions-yet UID: Controller:0xc000048b48 BlockOwnerDeletion:0xc000048b49}] Initializers:nil Finalizers:[] ClusterName:} Spec:{RevisionSpec:{PodSpec:{ServiceAccountName: Containers:[] Volumes:[]} ContainerConcurrency:0 TimeoutSeconds:0xc000048b50} DeprecatedGeneration:0 DeprecatedServingState: DeprecatedConcurrencyModel: DeprecatedBuildName: DeprecatedBuildRef:nil DeprecatedContainer:&Container{Name:,Image:busybox,Command:[],Args:[],WorkingDir:,Ports:[],Env:[],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[],LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:,ImagePullPolicy:,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[],TerminationMessagePolicy:,VolumeDevices:[],}} Status:{Status:{ObservedGeneration:0 Conditions:[]} ServiceName: LogURL: ImageDigest:}}"}
I0516 08:09:58.221] {"level":"info","ts":1557994195.314918,"logger":"fallback","caller":"configuration/configuration.go:204","msg":"Revision \"no-revisions-yet-00001\" of configuration \"no-revisions-yet\" is not ready"}
I0516 08:09:58.222] === RUN   TestReconcile/create_revision_byo_name
I0516 08:09:58.223] {"level":"info","ts":1557994195.3857405,"logger":"fallback","caller":"configuration/configuration.go:341","msg":"Created Revision: &{TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:byo-name-create-foo GenerateName: Namespace:foo SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[serving.knative.dev/configuration:byo-name-create serving.knative.dev/configurationGeneration:1234 serving.knative.dev/service:] Annotations:map[] OwnerReferences:[{APIVersion:serving.knative.dev/v1alpha1 Kind:Configuration Name:byo-name-create UID: Controller:0xc0005ae4b0 BlockOwnerDeletion:0xc0005ae4b1}] Initializers:nil Finalizers:[] ClusterName:} Spec:{RevisionSpec:{PodSpec:{ServiceAccountName: Containers:[] Volumes:[]} ContainerConcurrency:0 TimeoutSeconds:0xc0005ae4b8} DeprecatedGeneration:0 DeprecatedServingState: DeprecatedConcurrencyModel: DeprecatedBuildName: DeprecatedBuildRef:nil DeprecatedContainer:&Container{Name:,Image:busybox,Command:[],Args:[],WorkingDir:,Ports:[],Env:[],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[],LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:,ImagePullPolicy:,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[],TerminationMessagePolicy:,VolumeDevices:[],}} Status:{Status:{ObservedGeneration:0 Conditions:[]} ServiceName: LogURL: ImageDigest:}}"}
I0516 08:09:58.224] {"level":"info","ts":1557994195.3862216,"logger":"fallback","caller":"configuration/configuration.go:204","msg":"Revision \"byo-name-create-foo\" of configuration \"byo-name-create\" is not ready"}
I0516 08:09:58.224] === RUN   TestReconcile/create_revision_byo_name_(exists)
I0516 08:09:58.224] {"level":"info","ts":1557994195.4597895,"logger":"fallback","caller":"configuration/configuration.go:204","msg":"Revision \"byo-name-exists-foo\" of configuration \"byo-name-exists\" is not ready"}
I0516 08:09:58.225] === RUN   TestReconcile/create_revision_byo_name_(exists,_wrong_generation,_right_spec)
I0516 08:09:58.225] {"level":"info","ts":1557994195.5017674,"logger":"fallback","caller":"configuration/configuration.go:204","msg":"Revision \"byo-name-git-revert-foo\" of configuration \"byo-name-git-revert\" is not ready"}
I0516 08:09:58.225] === RUN   TestReconcile/create_revision_byo_name_(exists_@_wrong_generation_w/_wrong_spec)
I0516 08:09:58.226] === RUN   TestReconcile/create_revision_byo_name_(exists_not_owned)
I0516 08:09:58.226] === RUN   TestReconcile/webhook_validation_failure
I0516 08:09:58.227] {"level":"error","ts":1557994195.676709,"logger":"fallback","caller":"configuration/configuration.go:173","msg":"Failed to create Revision for Configuration \"validation-failure\": expected 0 <= -1 <= 1000: spec.containerConcurrency","stacktrace":"github.com/knative/serving/pkg/reconciler/configuration.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/configuration/configuration.go:173\ngithub.com/knative/serving/pkg/reconciler/configuration.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/configuration/configuration.go:127\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:58.246] {"level":"warn","ts":1557994195.6775577,"logger":"fallback","caller":"configuration/configuration.go:134","msg":"Failed to update configuration status","error":"expected 0 <= -1 <= 1000: spec.revisionTemplate.spec.containerConcurrency"}
I0516 08:09:58.254] === RUN   TestReconcile/elide_build_when_a_matching_one_already_exists
I0516 08:09:58.256] {"level":"info","ts":1557994195.7397711,"logger":"fallback","caller":"configuration/configuration.go:341","msg":"Created Revision: &{TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:need-rev-and-build-00001 GenerateName:need-rev-and-build- Namespace:foo SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[serving.knative.dev/configuration:need-rev-and-build serving.knative.dev/configurationGeneration:99998 serving.knative.dev/service:] Annotations:map[] OwnerReferences:[{APIVersion:serving.knative.dev/v1alpha1 Kind:Configuration Name:need-rev-and-build UID: Controller:0xc000048228 BlockOwnerDeletion:0xc000048229}] Initializers:nil Finalizers:[] ClusterName:} Spec:{RevisionSpec:{PodSpec:{ServiceAccountName: Containers:[] Volumes:[]} ContainerConcurrency:0 TimeoutSeconds:0xc000048230} DeprecatedGeneration:0 DeprecatedServingState: DeprecatedConcurrencyModel: DeprecatedBuildName: DeprecatedBuildRef:&ObjectReference{Kind:Build,Namespace:,Name:something-else-12345,UID:,APIVersion:testing.build.knative.dev/v1alpha1,ResourceVersion:,FieldPath:,} DeprecatedContainer:&Container{Name:,Image:busybox,Command:[],Args:[],WorkingDir:,Ports:[],Env:[],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[],LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:,ImagePullPolicy:,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[],TerminationMessagePolicy:,VolumeDevices:[],}} Status:{Status:{ObservedGeneration:0 Conditions:[]} ServiceName: LogURL: ImageDigest:}}"}
I0516 08:09:58.257] {"level":"info","ts":1557994195.7402604,"logger":"fallback","caller":"configuration/configuration.go:204","msg":"Revision \"need-rev-and-build-00001\" of configuration \"need-rev-and-build\" is not ready"}
I0516 08:09:58.257] === RUN   TestReconcile/create_revision_matching_generation_with_build
I0516 08:09:58.260] {"level":"info","ts":1557994195.8132918,"logger":"fallback","caller":"configuration/configuration.go:325","msg":"Created Build: &{Object:map[apiVersion:testing.build.knative.dev/v1alpha1 kind:Build metadata:map[generateName:need-rev-and-build- labels:map[serving.knative.dev/buildHash:dc901405de5b79cd477cef7752eb0c8455df45da24d1e789d379c826dbd1205] name:need-rev-and-build-00001 namespace:foo ownerReferences:[map[apiVersion:serving.knative.dev/v1alpha1 blockOwnerDeletion:true controller:true kind:Configuration name:need-rev-and-build uid:]]] spec:map[steps:[map[image:foo] map[image:bar]]]]}"}
I0516 08:09:58.267] {"level":"info","ts":1557994195.8147812,"logger":"fallback","caller":"configuration/configuration.go:341","msg":"Created Revision: &{TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:need-rev-and-build-00001 GenerateName:need-rev-and-build- Namespace:foo SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[serving.knative.dev/configuration:need-rev-and-build serving.knative.dev/configurationGeneration:99998 serving.knative.dev/service:] Annotations:map[] OwnerReferences:[{APIVersion:serving.knative.dev/v1alpha1 Kind:Configuration Name:need-rev-and-build UID: Controller:0xc0006085e8 BlockOwnerDeletion:0xc0006085e9}] Initializers:nil Finalizers:[] ClusterName:} Spec:{RevisionSpec:{PodSpec:{ServiceAccountName: Containers:[] Volumes:[]} ContainerConcurrency:0 TimeoutSeconds:0xc0006085f0} DeprecatedGeneration:0 DeprecatedServingState: DeprecatedConcurrencyModel: DeprecatedBuildName: DeprecatedBuildRef:&ObjectReference{Kind:Build,Namespace:,Name:need-rev-and-build-00001,UID:,APIVersion:testing.build.knative.dev/v1alpha1,ResourceVersion:,FieldPath:,} DeprecatedContainer:&Container{Name:,Image:busybox,Command:[],Args:[],WorkingDir:,Ports:[],Env:[],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[],LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:,ImagePullPolicy:,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[],TerminationMessagePolicy:,VolumeDevices:[],}} Status:{Status:{ObservedGeneration:0 Conditions:[]} ServiceName: LogURL: ImageDigest:}}"}
... skipping 2 lines ...
I0516 08:09:58.274] {"level":"info","ts":1557994195.8777719,"logger":"fallback","caller":"configuration/configuration.go:204","msg":"Revision \"matching-revision-not-done-00001\" of configuration \"matching-revision-not-done\" is not ready"}
I0516 08:09:58.277] === RUN   TestReconcile/reconcile_revision_matching_generation_(ready:_true)
I0516 08:09:58.279] {"level":"info","ts":1557994195.9701457,"logger":"fallback","caller":"configuration/configuration.go:207","msg":"Revision \"matching-revision-done-00001\" of configuration \"matching-revision-done\" is ready"}
I0516 08:09:58.280] === RUN   TestReconcile/reconcile_revision_matching_generation_(ready:_true,_idempotent)
I0516 08:09:58.281] {"level":"info","ts":1557994196.078573,"logger":"fallback","caller":"configuration/configuration.go:207","msg":"Revision \"matching-revision\" of configuration \"matching-revision-done-idempotent\" is ready"}
I0516 08:09:58.281] === RUN   TestReconcile/reconcile_revision_matching_generation_(ready:_false)
I0516 08:09:58.282] {"level":"info","ts":1557994196.1413484,"logger":"fallback","caller":"configuration/configuration.go:223","msg":"Revision \"matching-revision\" of configuration \"matching-revision-failed\" has failed"}
I0516 08:09:58.283] === RUN   TestReconcile/reconcile_revision_matching_generation_(ready:_bad)
I0516 08:09:58.289] {"level":"error","ts":1557994196.1999063,"logger":"fallback","caller":"configuration/configuration.go:232","msg":"Error reconciling Configuration \"bad-condition\": unrecognized condition status: Bad on revision \"bad-condition\"","stacktrace":"github.com/knative/serving/pkg/reconciler/configuration.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/configuration/configuration.go:232\ngithub.com/knative/serving/pkg/reconciler/configuration.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/configuration/configuration.go:127\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:58.293] === RUN   TestReconcile/failure_creating_build
I0516 08:09:58.296] {"level":"error","ts":1557994196.2621408,"logger":"fallback","caller":"configuration/configuration.go:173","msg":"Failed to create Revision for Configuration \"create-build-failure\": Failed to create Build for Configuration \"create-build-failure\": inducing failure for create builds","stacktrace":"github.com/knative/serving/pkg/reconciler/configuration.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/configuration/configuration.go:173\ngithub.com/knative/serving/pkg/reconciler/configuration.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/configuration/configuration.go:127\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:58.301] === RUN   TestReconcile/failure_creating_revision
I0516 08:09:58.302] {"level":"error","ts":1557994196.3301399,"logger":"fallback","caller":"configuration/configuration.go:173","msg":"Failed to create Revision for Configuration \"create-revision-failure\": inducing failure for create revisions","stacktrace":"github.com/knative/serving/pkg/reconciler/configuration.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/configuration/configuration.go:173\ngithub.com/knative/serving/pkg/reconciler/configuration.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/configuration/configuration.go:127\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:09:58.307] === RUN   TestReconcile/failure_updating_configuration_status
I0516 08:09:58.309] {"level":"info","ts":1557994196.3820362,"logger":"fallback","caller":"configuration/configuration.go:341","msg":"Created Revision: &{TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:update-config-failure-00001 GenerateName:update-config-failure- Namespace:foo SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[serving.knative.dev/configuration:update-config-failure serving.knative.dev/configurationGeneration:1234 serving.knative.dev/service:] Annotations:map[] OwnerReferences:[{APIVersion:serving.knative.dev/v1alpha1 Kind:Configuration Name:update-config-failure UID: Controller:0xc0007341d8 BlockOwnerDeletion:0xc0007341d9}] Initializers:nil Finalizers:[] ClusterName:} Spec:{RevisionSpec:{PodSpec:{ServiceAccountName: Containers:[] Volumes:[]} ContainerConcurrency:0 TimeoutSeconds:0xc0007341e0} DeprecatedGeneration:0 DeprecatedServingState: DeprecatedConcurrencyModel: DeprecatedBuildName: DeprecatedBuildRef:nil DeprecatedContainer:&Container{Name:,Image:busybox,Command:[],Args:[],WorkingDir:,Ports:[],Env:[],Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},},VolumeMounts:[],LivenessProbe:nil,ReadinessProbe:nil,Lifecycle:nil,TerminationMessagePath:,ImagePullPolicy:,SecurityContext:nil,Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[],TerminationMessagePolicy:,VolumeDevices:[],}} Status:{Status:{ObservedGeneration:0 Conditions:[]} ServiceName: LogURL: ImageDigest:}}"}
I0516 08:09:58.310] {"level":"info","ts":1557994196.3824012,"logger":"fallback","caller":"configuration/configuration.go:204","msg":"Revision \"update-config-failure-00001\" of configuration \"update-config-failure\" is not ready"}
I0516 08:09:58.311] {"level":"warn","ts":1557994196.3830051,"logger":"fallback","caller":"configuration/configuration.go:134","msg":"Failed to update configuration status","error":"inducing failure for update configurations"}
I0516 08:09:58.312] === RUN   TestReconcile/failed_revision_recovers
I0516 08:09:58.313] {"level":"info","ts":1557994196.4452918,"logger":"fallback","caller":"configuration/configuration.go:207","msg":"Revision \"revision-recovers-00001\" of configuration \"revision-recovers\" is ready"}
I0516 08:09:58.315] === RUN   TestReconcile/two_steady_state_configs_with_same_generation_should_be_a_noop
I0516 08:09:58.315] {"level":"info","ts":1557994196.5265915,"logger":"fallback","caller":"configuration/configuration.go:207","msg":"Revision \"double-trouble-00001\" of configuration \"double-trouble\" is ready"}
I0516 08:09:58.315] --- PASS: TestReconcile (1.44s)
I0516 08:09:58.316]     --- PASS: TestReconcile/bad_workqueue_key (0.05s)
I0516 08:09:58.317]         logger.go:130: 2019-05-16T08:09:55.167Z	ERROR	TestReconcile/bad_workqueue_key.configuration-controller	configuration/configuration.go:105	invalid resource key: too/many/parts	{"knative.dev/controller": "configuration-controller"}
I0516 08:09:58.317]     --- PASS: TestReconcile/key_not_found (0.03s)
I0516 08:09:58.318]     --- PASS: TestReconcile/nop_deletion_reconcile (0.06s)
I0516 08:09:58.318]     --- PASS: TestReconcile/create_revision_matching_generation (0.06s)
I0516 08:09:58.319]     --- PASS: TestReconcile/create_revision_byo_name (0.06s)
I0516 08:09:58.319]     --- PASS: TestReconcile/create_revision_byo_name_(exists) (0.05s)
I0516 08:09:58.320]     --- PASS: TestReconcile/create_revision_byo_name_(exists,_wrong_generation,_right_spec) (0.04s)
... skipping 104 lines ...
I0516 08:10:02.411] === RUN   TestReconcile/label_runLatest_configuration
I0516 08:10:02.412] {"level":"info","ts":1557994200.7764158,"logger":"fallback","caller":"labeler/labeler.go:96","msg":"Time to sync the labels: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"first-reconcile\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions(nil)}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"the-config-dbnfd\", ConfigurationName:\"\", LatestRevision:(*bool)(nil), Percent:100, URL:(*apis.URL)(nil)}}}}}}"}
I0516 08:10:02.413] === RUN   TestReconcile/steady_state
I0516 08:10:02.414] {"level":"info","ts":1557994200.838547,"logger":"fallback","caller":"labeler/labeler.go:96","msg":"Time to sync the labels: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"steady-state\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions(nil)}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"the-config-dbnfd\", ConfigurationName:\"\", LatestRevision:(*bool)(nil), Percent:100, URL:(*apis.URL)(nil)}}}}}}"}
I0516 08:10:02.414] === RUN   TestReconcile/failure_adding_label
I0516 08:10:02.416] {"level":"info","ts":1557994200.9227858,"logger":"fallback","caller":"labeler/labeler.go:96","msg":"Time to sync the labels: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"add-label-failure\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions(nil)}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"the-config-dbnfd\", ConfigurationName:\"\", LatestRevision:(*bool)(nil), Percent:100, URL:(*apis.URL)(nil)}}}}}}"}
I0516 08:10:02.417] {"level":"error","ts":1557994200.9237823,"logger":"fallback","caller":"labeler/labels.go:100","msg":"Failed to add route label to configuration \"the-config\": inducing failure for patch configurations","stacktrace":"github.com/knative/serving/pkg/reconciler/labeler.(*Reconciler).setLabelForGivenConfigurations\n\t/go/src/github.com/knative/serving/pkg/reconciler/labeler/labels.go:100\ngithub.com/knative/serving/pkg/reconciler/labeler.(*Reconciler).syncLabels\n\t/go/src/github.com/knative/serving/pkg/reconciler/labeler/labels.go:54\ngithub.com/knative/serving/pkg/reconciler/labeler.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/labeler/labeler.go:97\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:02.417] === RUN   TestReconcile/label_config_with_incorrect_label
I0516 08:10:02.418] {"level":"info","ts":1557994201.028699,"logger":"fallback","caller":"labeler/labeler.go:96","msg":"Time to sync the labels: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"the-route\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions(nil)}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"the-config-dbnfd\", ConfigurationName:\"\", LatestRevision:(*bool)(nil), Percent:100, URL:(*apis.URL)(nil)}}}}}}"}
I0516 08:10:02.419] === RUN   TestReconcile/change_configurations
I0516 08:10:02.420] {"level":"info","ts":1557994201.1107473,"logger":"fallback","caller":"labeler/labeler.go:96","msg":"Time to sync the labels: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"config-change\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions(nil)}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"new-config-dbnfd\", ConfigurationName:\"\", LatestRevision:(*bool)(nil), Percent:100, URL:(*apis.URL)(nil)}}}}}}"}
I0516 08:10:02.422] === RUN   TestReconcile/delete_route
I0516 08:10:02.422] {"level":"info","ts":1557994201.1894782,"logger":"fallback","caller":"labeler/labeler.go:88","msg":"Clearing labels for deleted Route: \"default/delete-route\""}
I0516 08:10:02.423] === RUN   TestReconcile/failure_while_removing_an_annotation_should_return_an_error
I0516 08:10:02.426] {"level":"info","ts":1557994201.3542845,"logger":"fallback","caller":"labeler/labeler.go:96","msg":"Time to sync the labels: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"delete-label-failure\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions(nil)}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"new-config-dbnfd\", ConfigurationName:\"\", LatestRevision:(*bool)(nil), Percent:100, URL:(*apis.URL)(nil)}}}}}}"}
I0516 08:10:02.431] {"level":"error","ts":1557994201.3580477,"logger":"fallback","caller":"labeler/labels.go:132","msg":"Failed to remove route label to configuration \"old-config\": inducing failure for patch configurations","stacktrace":"github.com/knative/serving/pkg/reconciler/labeler.(*Reconciler).deleteLabelForOutsideOfGivenConfigurations\n\t/go/src/github.com/knative/serving/pkg/reconciler/labeler/labels.go:132\ngithub.com/knative/serving/pkg/reconciler/labeler.(*Reconciler).syncLabels\n\t/go/src/github.com/knative/serving/pkg/reconciler/labeler/labels.go:51\ngithub.com/knative/serving/pkg/reconciler/labeler.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/labeler/labeler.go:97\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:02.432] --- PASS: TestReconcile (0.86s)
I0516 08:10:02.432]     --- PASS: TestReconcile/bad_workqueue_key (0.10s)
I0516 08:10:02.433]         logger.go:130: 2019-05-16T08:10:00.612Z	ERROR	TestReconcile/bad_workqueue_key.labeler-controller	labeler/labeler.go:80	invalid resource key: too/many/parts	{"knative.dev/controller": "labeler-controller"}
I0516 08:10:02.434]     --- PASS: TestReconcile/key_not_found (0.08s)
I0516 08:10:02.435]     --- PASS: TestReconcile/label_runLatest_configuration (0.08s)
I0516 08:10:02.435]     --- PASS: TestReconcile/steady_state (0.05s)
I0516 08:10:02.437]     --- PASS: TestReconcile/failure_adding_label (0.07s)
I0516 08:10:02.438]     --- PASS: TestReconcile/label_config_with_incorrect_label (0.06s)
I0516 08:10:02.438]     --- PASS: TestReconcile/change_configurations (0.07s)
... skipping 27 lines ...
I0516 08:10:26.770]     --- PASS: TestGetDeploymentProgressCondition/other_conditions (0.00s)
I0516 08:10:26.770]     --- PASS: TestGetDeploymentProgressCondition/progressing (0.00s)
I0516 08:10:26.771]     --- PASS: TestGetDeploymentProgressCondition/not_progressing_for_other_reasons (0.00s)
I0516 08:10:26.771]     --- PASS: TestGetDeploymentProgressCondition/progress_deadline_exceeded (0.00s)
I0516 08:10:26.771] === RUN   TestNewRevisionCallsSyncHandler
I0516 08:10:26.772] --- PASS: TestNewRevisionCallsSyncHandler (1.61s)
I0516 08:10:26.772]     logger.go:130: 2019-05-16T08:10:05.827Z	ERROR	TestNewRevisionCallsSyncHandler	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.773]     logger.go:130: 2019-05-16T08:10:05.827Z	DEBUG	TestNewRevisionCallsSyncHandler.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.773]     logger.go:130: 2019-05-16T08:10:05.828Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.773]     logger.go:130: 2019-05-16T08:10:05.828Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller.config-store	configmap/store.go:166	revision config "config-deployment" config was added or updated: &{queueImage map[dev.local:{} ko.local:{}]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.774]     logger.go:130: 2019-05-16T08:10:05.829Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.774]     logger.go:130: 2019-05-16T08:10:05.829Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.774]         "outputPaths": ["stdout"],
I0516 08:10:26.774]         "errorOutputPaths": ["stderr"],
I0516 08:10:26.775]         "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.775]     logger.go:130: 2019-05-16T08:10:05.830Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.775]         <match **>
I0516 08:10:26.775]           @type elasticsearch
... skipping 8 lines ...
I0516 08:10:26.779]     logger.go:130: 2019-05-16T08:10:06.559Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller	revision/reconcile_resources.go:215	Created fluentd configmap: "test-rev-fluentd"	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.779]     logger.go:130: 2019-05-16T08:10:06.559Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller	revision/reconcile_resources.go:134	Reconciling KPA:test-rev	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.779]     queueing_test.go:263: PA created: test-rev
I0516 08:10:26.780]     logger.go:130: 2019-05-16T08:10:06.560Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller	revision/reconcile_resources.go:144	Created KPA:test-rev	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.780]     logger.go:130: 2019-05-16T08:10:06.560Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller	controller/controller.go:305	Reconcile succeeded. Time taken: 3.372871ms.	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.780]     logger.go:130: 2019-05-16T08:10:06.561Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller	revision/revision.go:221	Running reconcile Revision	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.781]     logger.go:130: 2019-05-16T08:10:06.562Z	ERROR	TestNewRevisionCallsSyncHandler.revision-controller	revision/reconcile_resources.go:56	Error creating deployment "test-rev-deployment": deployments.apps "test-rev-deployment" already exists	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev", "knative.dev/deployment": "test-rev-deployment"}
I0516 08:10:26.781]     logger.go:130: 2019-05-16T08:10:06.562Z	ERROR	TestNewRevisionCallsSyncHandler.revision-controller	revision/revision.go:389	Failed to reconcile	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev", "phase": "user deployment", "error": "deployments.apps \"test-rev-deployment\" already exists"}
I0516 08:10:26.782]     logger.go:130: 2019-05-16T08:10:06.562Z	ERROR	TestNewRevisionCallsSyncHandler.revision-controller	controller/controller.go:311	Reconcile error	{"knative.dev/controller": "revision-controller", "error": "deployments.apps \"test-rev-deployment\" already exists"}
I0516 08:10:26.782]     logger.go:130: 2019-05-16T08:10:06.562Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller	controller/controller.go:298	Reconcile failed. Time taken: 1.633237ms.	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.783]     logger.go:130: 2019-05-16T08:10:06.563Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller	controller/controller.go:255	Shutting down workers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.783]     logger.go:130: 2019-05-16T08:10:06.564Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller	revision/revision.go:221	Running reconcile Revision	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.783]     logger.go:130: 2019-05-16T08:10:06.567Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller	revision/reconcile_resources.go:134	Reconciling KPA:test-rev	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.784]     logger.go:130: 2019-05-16T08:10:06.568Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller	controller/controller.go:305	Reconcile succeeded. Time taken: 3.871828ms.	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.784] === RUN   TestResolve
I0516 08:10:26.784] E0516 08:10:06.707876   22734 metadata.go:142] while reading 'google-dockercfg' metadata: http status code: 404 while fetching url http://metadata.google.internal./computeMetadata/v1/instance/attributes/google-dockercfg
... skipping 20 lines ...
I0516 08:10:26.788] --- PASS: TestNewResolverTransport (0.01s)
I0516 08:10:26.788]     --- PASS: TestNewResolverTransport/cases[0] (0.00s)
I0516 08:10:26.788]     --- PASS: TestNewResolverTransport/cases[1] (0.00s)
I0516 08:10:26.788]     --- PASS: TestNewResolverTransport/cases[2] (0.00s)
I0516 08:10:26.788] === RUN   TestResolutionFailed
I0516 08:10:26.789] {"level":"info","ts":1557994217.5769308,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:26.789] {"level":"error","ts":1557994217.5773559,"logger":"fallback","caller":"revision/revision.go:389","msg":"Failed to reconcile","phase":"image digest","error":"I am the expected error message, hear me ROAR!","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:389\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/pkg/reconciler/revision.createRevision\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision_test.go:228\ngithub.com/knative/serving/pkg/reconciler/revision.TestResolutionFailed\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision_test.go:338\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:26.790] --- PASS: TestResolutionFailed (0.02s)
I0516 08:10:26.790]     logger.go:130: 2019-05-16T08:10:17.566Z	ERROR	TestResolutionFailed	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.790]     logger.go:130: 2019-05-16T08:10:17.566Z	DEBUG	TestResolutionFailed.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.791]     logger.go:130: 2019-05-16T08:10:17.567Z	INFO	TestResolutionFailed.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.791]     logger.go:130: 2019-05-16T08:10:17.570Z	INFO	TestResolutionFailed.revision-controller.config-store	configmap/store.go:166	revision config "config-deployment" config was added or updated: &{queueImage map[dev.local:{} ko.local:{}]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.792]     logger.go:130: 2019-05-16T08:10:17.574Z	INFO	TestResolutionFailed.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.792]     logger.go:130: 2019-05-16T08:10:17.575Z	INFO	TestResolutionFailed.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.792]         "outputPaths": ["stdout"],
I0516 08:10:26.792]         "errorOutputPaths": ["stderr"],
I0516 08:10:26.793]         "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.793]     logger.go:130: 2019-05-16T08:10:17.575Z	INFO	TestResolutionFailed.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.793]         <match **>
I0516 08:10:26.793]           @type elasticsearch
... skipping 7 lines ...
I0516 08:10:26.796] {"level":"info","ts":1557994217.6014342,"logger":"fallback","caller":"revision/reconcile_resources.go:215","msg":"Created fluentd configmap: \"test-rev-fluentd\""}
I0516 08:10:26.796] {"level":"info","ts":1557994217.6015577,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:test-rev"}
I0516 08:10:26.796] {"level":"info","ts":1557994217.6018124,"logger":"fallback","caller":"revision/reconcile_resources.go:144","msg":"Created KPA:test-rev"}
I0516 08:10:26.797] {"level":"info","ts":1557994217.6048253,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:26.797] {"level":"info","ts":1557994217.6074812,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:test-rev"}
I0516 08:10:26.797] --- PASS: TestUpdateRevWithWithUpdatedLoggingURL (0.03s)
I0516 08:10:26.798]     logger.go:130: 2019-05-16T08:10:17.580Z	ERROR	TestUpdateRevWithWithUpdatedLoggingURL	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.798]     logger.go:130: 2019-05-16T08:10:17.581Z	DEBUG	TestUpdateRevWithWithUpdatedLoggingURL.revision-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.798]     logger.go:130: 2019-05-16T08:10:17.582Z	DEBUG	TestUpdateRevWithWithUpdatedLoggingURL.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.799]     logger.go:130: 2019-05-16T08:10:17.582Z	INFO	TestUpdateRevWithWithUpdatedLoggingURL.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.799]     logger.go:130: 2019-05-16T08:10:17.583Z	INFO	TestUpdateRevWithWithUpdatedLoggingURL.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.800]     logger.go:130: 2019-05-16T08:10:17.583Z	INFO	TestUpdateRevWithWithUpdatedLoggingURL.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.800]         "outputPaths": ["stdout"],
I0516 08:10:26.800]         "errorOutputPaths": ["stderr"],
I0516 08:10:26.800]         "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.801]     logger.go:130: 2019-05-16T08:10:17.584Z	INFO	TestUpdateRevWithWithUpdatedLoggingURL.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.801]         <match **>
I0516 08:10:26.801]           @type elasticsearch
... skipping 19 lines ...
I0516 08:10:26.806] {"level":"info","ts":1557994217.6146252,"logger":"fallback","caller":"revision/reconcile_resources.go:215","msg":"Created fluentd configmap: \"test-rev-fluentd\""}
I0516 08:10:26.806] {"level":"info","ts":1557994217.615411,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:test-rev"}
I0516 08:10:26.806] {"level":"info","ts":1557994217.6156244,"logger":"fallback","caller":"revision/reconcile_resources.go:144","msg":"Created KPA:test-rev"}
I0516 08:10:26.806] {"level":"info","ts":1557994217.6168766,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:26.806] {"level":"info","ts":1557994217.6186142,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:test-rev"}
I0516 08:10:26.807] --- PASS: TestMarkRevReadyUponEndpointBecomesReady (0.01s)
I0516 08:10:26.807]     logger.go:130: 2019-05-16T08:10:17.609Z	ERROR	TestMarkRevReadyUponEndpointBecomesReady	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.807]     logger.go:130: 2019-05-16T08:10:17.609Z	DEBUG	TestMarkRevReadyUponEndpointBecomesReady.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.808]     logger.go:130: 2019-05-16T08:10:17.609Z	INFO	TestMarkRevReadyUponEndpointBecomesReady.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.809]     logger.go:130: 2019-05-16T08:10:17.610Z	INFO	TestMarkRevReadyUponEndpointBecomesReady.revision-controller.config-store	configmap/store.go:166	revision config "config-deployment" config was added or updated: &{queueImage map[dev.local:{} ko.local:{}]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.809]     logger.go:130: 2019-05-16T08:10:17.610Z	INFO	TestMarkRevReadyUponEndpointBecomesReady.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.810]     logger.go:130: 2019-05-16T08:10:17.611Z	INFO	TestMarkRevReadyUponEndpointBecomesReady.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.810]         "outputPaths": ["stdout"],
I0516 08:10:26.810]         "errorOutputPaths": ["stderr"],
I0516 08:10:26.811]         "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.811]     logger.go:130: 2019-05-16T08:10:17.611Z	INFO	TestMarkRevReadyUponEndpointBecomesReady.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.811]         <match **>
I0516 08:10:26.811]           @type elasticsearch
... skipping 5 lines ...
I0516 08:10:26.822] {"level":"info","ts":1557994217.626171,"logger":"fallback","caller":"revision/reconcile_resources.go:59","msg":"Created deployment \"test-rev-deployment\"","knative.dev/deployment":"test-rev-deployment"}
I0516 08:10:26.823] {"level":"info","ts":1557994217.6271985,"logger":"fallback","caller":"revision/reconcile_resources.go:121","msg":"Created image cache \"test-rev-cache\""}
I0516 08:10:26.823] {"level":"info","ts":1557994217.6274097,"logger":"fallback","caller":"revision/reconcile_resources.go:215","msg":"Created fluentd configmap: \"test-rev-fluentd\""}
I0516 08:10:26.823] {"level":"info","ts":1557994217.627504,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:test-rev"}
I0516 08:10:26.823] {"level":"info","ts":1557994217.6276958,"logger":"fallback","caller":"revision/reconcile_resources.go:144","msg":"Created KPA:test-rev"}
I0516 08:10:26.823] --- PASS: TestNoQueueSidecarImageUpdateFail (0.01s)
I0516 08:10:26.824]     logger.go:130: 2019-05-16T08:10:17.621Z	ERROR	TestNoQueueSidecarImageUpdateFail	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.824]     logger.go:130: 2019-05-16T08:10:17.622Z	DEBUG	TestNoQueueSidecarImageUpdateFail.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.824]     logger.go:130: 2019-05-16T08:10:17.622Z	INFO	TestNoQueueSidecarImageUpdateFail.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.825]     logger.go:130: 2019-05-16T08:10:17.623Z	INFO	TestNoQueueSidecarImageUpdateFail.revision-controller.config-store	configmap/store.go:166	revision config "config-deployment" config was added or updated: &{queueImage map[dev.local:{} ko.local:{}]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.825]     logger.go:130: 2019-05-16T08:10:17.623Z	INFO	TestNoQueueSidecarImageUpdateFail.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.825]     logger.go:130: 2019-05-16T08:10:17.624Z	INFO	TestNoQueueSidecarImageUpdateFail.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.826]         "outputPaths": ["stdout"],
I0516 08:10:26.826]         "errorOutputPaths": ["stderr"],
I0516 08:10:26.826]         "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.826]     logger.go:130: 2019-05-16T08:10:17.624Z	INFO	TestNoQueueSidecarImageUpdateFail.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.826]         <match **>
I0516 08:10:26.827]           @type elasticsearch
... skipping 29 lines ...
I0516 08:10:26.835] {"level":"info","ts":1557994217.6830087,"logger":"fallback","caller":"revision/reconcile_resources.go:59","msg":"Created deployment \"test-rev-deployment\"","knative.dev/deployment":"test-rev-deployment"}
I0516 08:10:26.835] {"level":"info","ts":1557994217.6839516,"logger":"fallback","caller":"revision/reconcile_resources.go:121","msg":"Created image cache \"test-rev-cache\""}
I0516 08:10:26.835] {"level":"info","ts":1557994217.6841817,"logger":"fallback","caller":"revision/reconcile_resources.go:215","msg":"Created fluentd configmap: \"test-rev-fluentd\""}
I0516 08:10:26.835] {"level":"info","ts":1557994217.6842723,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:test-rev"}
I0516 08:10:26.835] {"level":"info","ts":1557994217.6844854,"logger":"fallback","caller":"revision/reconcile_resources.go:144","msg":"Created KPA:test-rev"}
I0516 08:10:26.836] --- PASS: TestIstioOutboundIPRangesInjection (0.06s)
I0516 08:10:26.836]     logger.go:130: 2019-05-16T08:10:17.629Z	ERROR	TestIstioOutboundIPRangesInjection	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.836]     logger.go:130: 2019-05-16T08:10:17.629Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.836]     logger.go:130: 2019-05-16T08:10:17.630Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.837]     logger.go:130: 2019-05-16T08:10:17.631Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.837]     logger.go:130: 2019-05-16T08:10:17.631Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.837]     logger.go:130: 2019-05-16T08:10:17.632Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.837]         "outputPaths": ["stdout"],
I0516 08:10:26.838]         "errorOutputPaths": ["stderr"],
I0516 08:10:26.838]         "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.838]     logger.go:130: 2019-05-16T08:10:17.632Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.838]         <match **>
I0516 08:10:26.838]           @type elasticsearch
I0516 08:10:26.838]         </match>
I0516 08:10:26.839]          http://localhost:8001/api/v1/namespaces/knative-monitoring/services/kibana-logging/proxy/app/kibana#/discover?_a=(query:(match:(kubernetes.labels.knative-dev%2FrevisionUID:(query:'${REVISION_UID}',type:phrase))))  }	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.839]     logger.go:130: 2019-05-16T08:10:17.633Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-autoscaler" config was added or updated: &{true 0.5 10 1 5m0s 10 200 10s 2s 30s}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.840]     logger.go:130: 2019-05-16T08:10:17.633Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-deployment" config was added or updated: &{queueImage map[dev.local:{} ko.local:{}]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.840]     logger.go:130: 2019-05-16T08:10:17.633Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{10.10.10.0/24 istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.840]     logger.go:130: 2019-05-16T08:10:17.638Z	ERROR	TestIstioOutboundIPRangesInjection	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.841]     logger.go:130: 2019-05-16T08:10:17.638Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.841]     logger.go:130: 2019-05-16T08:10:17.639Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.841]     logger.go:130: 2019-05-16T08:10:17.640Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.841]     logger.go:130: 2019-05-16T08:10:17.641Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.842]     logger.go:130: 2019-05-16T08:10:17.641Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.842]         "outputPaths": ["stdout"],
I0516 08:10:26.842]         "errorOutputPaths": ["stderr"],
I0516 08:10:26.842]         "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.843]     logger.go:130: 2019-05-16T08:10:17.642Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.843]         <match **>
I0516 08:10:26.843]           @type elasticsearch
I0516 08:10:26.843]         </match>
I0516 08:10:26.843]          http://localhost:8001/api/v1/namespaces/knative-monitoring/services/kibana-logging/proxy/app/kibana#/discover?_a=(query:(match:(kubernetes.labels.knative-dev%2FrevisionUID:(query:'${REVISION_UID}',type:phrase))))  }	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.844]     logger.go:130: 2019-05-16T08:10:17.642Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-autoscaler" config was added or updated: &{true 0.5 10 1 5m0s 10 200 10s 2s 30s}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.844]     logger.go:130: 2019-05-16T08:10:17.642Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-deployment" config was added or updated: &{queueImage map[dev.local:{} ko.local:{}]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.844]     logger.go:130: 2019-05-16T08:10:17.643Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{10.10.10.0/24,10.240.10.0/14,192.192.10.0/16 istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.845]     logger.go:130: 2019-05-16T08:10:17.647Z	ERROR	TestIstioOutboundIPRangesInjection	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.845]     logger.go:130: 2019-05-16T08:10:17.647Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.845]     logger.go:130: 2019-05-16T08:10:17.648Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.845]     logger.go:130: 2019-05-16T08:10:17.649Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.846]     logger.go:130: 2019-05-16T08:10:17.649Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.846]     logger.go:130: 2019-05-16T08:10:17.650Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.846]         "outputPaths": ["stdout"],
I0516 08:10:26.846]         "errorOutputPaths": ["stderr"],
I0516 08:10:26.847]         "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.847]     logger.go:130: 2019-05-16T08:10:17.650Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.847]         <match **>
I0516 08:10:26.847]           @type elasticsearch
I0516 08:10:26.847]         </match>
I0516 08:10:26.848]          http://localhost:8001/api/v1/namespaces/knative-monitoring/services/kibana-logging/proxy/app/kibana#/discover?_a=(query:(match:(kubernetes.labels.knative-dev%2FrevisionUID:(query:'${REVISION_UID}',type:phrase))))  }	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.848]     logger.go:130: 2019-05-16T08:10:17.650Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-autoscaler" config was added or updated: &{true 0.5 10 1 5m0s 10 200 10s 2s 30s}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.848]     logger.go:130: 2019-05-16T08:10:17.651Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-deployment" config was added or updated: &{queueImage map[dev.local:{} ko.local:{}]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.849]     logger.go:130: 2019-05-16T08:10:17.651Z	ERROR	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:159	Error updating revision config "config-network": "invalid CIDR address: 10.10.10.10/33"	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.849]     logger.go:130: 2019-05-16T08:10:17.662Z	ERROR	TestIstioOutboundIPRangesInjection	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.849]     logger.go:130: 2019-05-16T08:10:17.662Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.850]     logger.go:130: 2019-05-16T08:10:17.663Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.850]     logger.go:130: 2019-05-16T08:10:17.663Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.850]     logger.go:130: 2019-05-16T08:10:17.664Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.851]     logger.go:130: 2019-05-16T08:10:17.664Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.851]         "outputPaths": ["stdout"],
I0516 08:10:26.851]         "errorOutputPaths": ["stderr"],
I0516 08:10:26.851]         "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.851]     logger.go:130: 2019-05-16T08:10:17.665Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.852]         <match **>
I0516 08:10:26.852]           @type elasticsearch
I0516 08:10:26.852]         </match>
I0516 08:10:26.852]          http://localhost:8001/api/v1/namespaces/knative-monitoring/services/kibana-logging/proxy/app/kibana#/discover?_a=(query:(match:(kubernetes.labels.knative-dev%2FrevisionUID:(query:'${REVISION_UID}',type:phrase))))  }	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.853]     logger.go:130: 2019-05-16T08:10:17.665Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-autoscaler" config was added or updated: &{true 0.5 10 1 5m0s 10 200 10s 2s 30s}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.853]     logger.go:130: 2019-05-16T08:10:17.665Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-deployment" config was added or updated: &{queueImage map[dev.local:{} ko.local:{}]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.853]     logger.go:130: 2019-05-16T08:10:17.666Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{ istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.854]     logger.go:130: 2019-05-16T08:10:17.670Z	ERROR	TestIstioOutboundIPRangesInjection	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.854]     logger.go:130: 2019-05-16T08:10:17.670Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.854]     logger.go:130: 2019-05-16T08:10:17.671Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.855]     logger.go:130: 2019-05-16T08:10:17.671Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.855]     logger.go:130: 2019-05-16T08:10:17.678Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.859]     logger.go:130: 2019-05-16T08:10:17.679Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.859]         "outputPaths": ["stdout"],
I0516 08:10:26.859]         "errorOutputPaths": ["stderr"],
I0516 08:10:26.860]         "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.860]     logger.go:130: 2019-05-16T08:10:17.680Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.860]         <match **>
I0516 08:10:26.860]           @type elasticsearch
... skipping 3 lines ...
I0516 08:10:26.862]     logger.go:130: 2019-05-16T08:10:17.680Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-deployment" config was added or updated: &{queueImage map[dev.local:{} ko.local:{}]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.862]     logger.go:130: 2019-05-16T08:10:17.681Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{10.10.10.0/24 istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.863] === RUN   TestGlobalResyncOnConfigMapUpdateRevision
I0516 08:10:26.863] === RUN   TestGlobalResyncOnConfigMapUpdateRevision/Update_LoggingURL
I0516 08:10:26.863] --- PASS: TestGlobalResyncOnConfigMapUpdateRevision (0.72s)
I0516 08:10:26.864]     --- PASS: TestGlobalResyncOnConfigMapUpdateRevision/Update_LoggingURL (0.72s)
I0516 08:10:26.864]         logger.go:130: 2019-05-16T08:10:17.686Z	ERROR	TestGlobalResyncOnConfigMapUpdateRevision/Update_LoggingURL	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.864]         logger.go:130: 2019-05-16T08:10:17.686Z	DEBUG	TestGlobalResyncOnConfigMapUpdateRevision/Update_LoggingURL.revision-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.865]         logger.go:130: 2019-05-16T08:10:17.687Z	DEBUG	TestGlobalResyncOnConfigMapUpdateRevision/Update_LoggingURL.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.865]         logger.go:130: 2019-05-16T08:10:17.688Z	INFO	TestGlobalResyncOnConfigMapUpdateRevision/Update_LoggingURL.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.866]         logger.go:130: 2019-05-16T08:10:17.688Z	INFO	TestGlobalResyncOnConfigMapUpdateRevision/Update_LoggingURL.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.866]         logger.go:130: 2019-05-16T08:10:17.689Z	INFO	TestGlobalResyncOnConfigMapUpdateRevision/Update_LoggingURL.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.867]             "outputPaths": ["stdout"],
I0516 08:10:26.867]             "errorOutputPaths": ["stderr"],
I0516 08:10:26.867]             "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.867]         logger.go:130: 2019-05-16T08:10:17.689Z	INFO	TestGlobalResyncOnConfigMapUpdateRevision/Update_LoggingURL.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.868]             <match **>
I0516 08:10:26.868]               @type elasticsearch
... skipping 25 lines ...
I0516 08:10:26.894] E0516 08:10:19.137418   22734 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-rev.159f1b7cd9c4c0d8", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Revision", Namespace:"test", Name:"test-rev", UID:"test-rev-uid", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"InternalError", Message:"deployments.apps \"test-rev-deployment\" already exists", Source:v1.EventSource{Component:"revision-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649ac82952d8, ext:14347179879, loc:(*time.Location)(0x362de00)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649ac82952d8, ext:14347179879, loc:(*time.Location)(0x362de00)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:26.894] === RUN   TestGlobalResyncOnConfigMapUpdateDeployment/Disable_Fluentd
I0516 08:10:26.894] === RUN   TestGlobalResyncOnConfigMapUpdateDeployment/Update_Fluentd_Image
I0516 08:10:26.895] === RUN   TestGlobalResyncOnConfigMapUpdateDeployment/Update_QueueProxy_Image
I0516 08:10:26.895] --- PASS: TestGlobalResyncOnConfigMapUpdateDeployment (2.98s)
I0516 08:10:26.895]     --- PASS: TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges (0.74s)
I0516 08:10:26.896]         logger.go:130: 2019-05-16T08:10:18.410Z	ERROR	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.896]         logger.go:130: 2019-05-16T08:10:18.411Z	DEBUG	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.897]         logger.go:130: 2019-05-16T08:10:18.412Z	DEBUG	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.897]         logger.go:130: 2019-05-16T08:10:18.412Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.898]         logger.go:130: 2019-05-16T08:10:18.413Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.898]         logger.go:130: 2019-05-16T08:10:18.414Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.898]             "outputPaths": ["stdout"],
I0516 08:10:26.899]             "errorOutputPaths": ["stderr"],
I0516 08:10:26.899]             "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.899]         logger.go:130: 2019-05-16T08:10:18.414Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.900]             <match **>
I0516 08:10:26.900]               @type elasticsearch
... skipping 10 lines ...
I0516 08:10:26.905]         logger.go:130: 2019-05-16T08:10:19.133Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	revision/reconcile_resources.go:215	Created fluentd configmap: "test-rev-fluentd"	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.905]         logger.go:130: 2019-05-16T08:10:19.133Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	revision/reconcile_resources.go:134	Reconciling KPA:test-rev	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.906]         logger.go:130: 2019-05-16T08:10:19.133Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	revision/reconcile_resources.go:144	Created KPA:test-rev	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.906]         logger.go:130: 2019-05-16T08:10:19.134Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	controller/controller.go:305	Reconcile succeeded. Time taken: 4.019856ms.	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.907]         logger.go:130: 2019-05-16T08:10:19.135Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	revision/revision.go:221	Running reconcile Revision	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.907]         logger.go:130: 2019-05-16T08:10:19.136Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{10.0.0.1/24 istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.908]         logger.go:130: 2019-05-16T08:10:19.136Z	ERROR	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	revision/reconcile_resources.go:56	Error creating deployment "test-rev-deployment": deployments.apps "test-rev-deployment" already exists	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev", "knative.dev/deployment": "test-rev-deployment"}
I0516 08:10:26.915]         logger.go:130: 2019-05-16T08:10:19.136Z	ERROR	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	revision/revision.go:389	Failed to reconcile	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev", "phase": "user deployment", "error": "deployments.apps \"test-rev-deployment\" already exists"}
I0516 08:10:26.916]         logger.go:130: 2019-05-16T08:10:19.137Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller.event-broadcaster	record/event.go:221	Event(v1.ObjectReference{Kind:"Revision", Namespace:"test", Name:"test-rev", UID:"test-rev-uid", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Warning' reason: 'InternalError' deployments.apps "test-rev-deployment" already exists	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.921]         logger.go:130: 2019-05-16T08:10:19.137Z	ERROR	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	controller/controller.go:311	Reconcile error	{"knative.dev/controller": "revision-controller", "error": "deployments.apps \"test-rev-deployment\" already exists"}
I0516 08:10:26.921]         logger.go:130: 2019-05-16T08:10:19.138Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	controller/controller.go:298	Reconcile failed. Time taken: 3.339881ms.	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.922]         logger.go:130: 2019-05-16T08:10:19.138Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	revision/revision.go:221	Running reconcile Revision	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.922]         revision_test.go:684: Deployment updated: test-rev-deployment
I0516 08:10:26.924]         logger.go:130: 2019-05-16T08:10:19.139Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	controller/controller.go:255	Shutting down workers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.925]         logger.go:130: 2019-05-16T08:10:19.151Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	revision/cruds.go:97	Reconciled deployment diff (-desired, +observed):   v1.DeploymentSpec{
I0516 08:10:26.925]               	Replicas: &1,
I0516 08:10:26.925]               	Selector: &v1.LabelSelector{MatchLabels: map[string]string{"serving.knative.dev/revisionUID": "test-rev-uid"}},
... skipping 9 lines ...
I0516 08:10:26.928]             + 				"traffic.sidecar.istio.io/includeOutboundIPRanges": "10.0.0.1/24",
I0516 08:10:26.928]               			},
I0516 08:10:26.928]               			OwnerReferences: nil,
I0516 08:10:26.929]               			Initializers:    nil,
I0516 08:10:26.929]               			... // 2 identical fields
I0516 08:10:26.929]               		},
I0516 08:10:26.932]               		Spec: v1.PodSpec{Volumes: []v1.Volume{{Name: "varlog", VolumeSource: v1.VolumeSource{EmptyDir: &v1.EmptyDirVolumeSource{}}}, {Name: "configmap", VolumeSource: v1.VolumeSource{ConfigMap: &v1.ConfigMapVolumeSource{LocalObjectReference: v1.LocalObjectReference{Name: "test-rev-fluentd"}}}}}, Containers: []v1.Container{{Name: "user-container", Image: "gcr.io/repo/image", Command: []string{"echo"}, Args: []string{"hello", "world"}, WorkingDir: "/tmp", Ports: []v1.ContainerPort{{Name: "user-port", ContainerPort: 8080}}, Env: []v1.EnvVar{{Name: "EDITOR", Value: "emacs"}, {Name: "PORT", Value: "8080"}, {Name: "K_REVISION", Value: "test-rev"}, {Name: "K_CONFIGURATION"}, {Name: "K_SERVICE"}}, Resources: v1.ResourceRequirements{Limits: v1.ResourceList{}, Requests: v1.ResourceList{}}, VolumeMounts: []v1.VolumeMount{{Name: "varlog", MountPath: "/var/log"}}, LivenessProbe: &v1.Probe{TimeoutSeconds: 42}, ReadinessProbe: &v1.Probe{Handler: v1.Handler{HTTPGet: &v1.HTTPGetAction{Path: "health", Port: intstr.IntOrString{IntVal: 8012}, HTTPHeaders: []v1.HTTPHeader{{Name: "K-Kubelet-Probe", Value: "queue"}}}}, TimeoutSeconds: 43}, Lifecycle: &v1.Lifecycle{PreStop: &v1.Handler{HTTPGet: &v1.HTTPGetAction{Path: "/wait-for-drain", Port: intstr.IntOrString{IntVal: 8022}}}}, TerminationMessagePath: "/dev/null", TerminationMessagePolicy: "FallbackToLogsOnError"}, {Name: "queue-proxy", Image: "queueImage", Ports: []v1.ContainerPort{{Name: "queueadm-port", ContainerPort: 8022}, {Name: "queue-metrics", ContainerPort: 9090}, {Name: "queue-port", ContainerPort: 8012}}, Env: []v1.EnvVar{{Name: "SERVING_NAMESPACE", Value: "test"}, {Name: "SERVING_SERVICE"}, {Name: "SERVING_CONFIGURATION"}, {Name: "SERVING_REVISION", Value: "test-rev"}, {Name: "QUEUE_SERVING_PORT", Value: "8012"}, {Name: "CONTAINER_CONCURRENCY", Value: "0"}, {Name: "REVISION_TIMEOUT_SECONDS", Value: "60"}, {Name: "SERVING_POD", ValueFrom: &v1.EnvVarSource{FieldRef: &v1.ObjectFieldSelector{FieldPath: "metadata.name"}}}, {Name: "SERVING_POD_IP", ValueFrom: &v1.EnvVarSource{FieldRef: &v1.ObjectFieldSelector{FieldPath: "status.podIP"}}}, {Name: "SERVING_LOGGING_CONFIG", Value: "{\"level\": \"error\",\n\"outputPaths\": [\"stdout\"],\n\"errorOutputPaths\": [\"stderr\"],\n\"encoding\": \"json\"}"}, {Name: "SERVING_LOGGING_LEVEL", Value: "info"}, {Name: "SERVING_REQUEST_LOG_TEMPLATE"}, {Name: "SERVING_REQUEST_METRICS_BACKEND"}, {Name: "USER_PORT", Value: "8080"}, {Name: "SYSTEM_NAMESPACE", Value: "knative-testing"}}, Resources: v1.ResourceRequirements{Requests: v1.ResourceList{"cpu": {i: resource.int64Amount{value: 25, scale: -3}, s: "25m", Format: "DecimalSI"}}}, ReadinessProbe: &v1.Probe{Handler: v1.Handler{HTTPGet: &v1.HTTPGetAction{Path: "/health", Port: intstr.IntOrString{IntVal: 8022}}}, TimeoutSeconds: 10, PeriodSeconds: 1}}, {Name: "fluentd-proxy", Image: "fluentdImage", Env: []v1.EnvVar{{Name: "FLUENTD_ARGS", Value: "--no-supervisor -q"}, {Name: "SERVING_CONTAINER_NAME", Value: "user-container"}, {Name: "SERVING_CONFIGURATION"}, {Name: "SERVING_REVISION", Value: "test-rev"}, {Name: "SERVING_NAMESPACE", Value: "test"}, {Name: "SERVING_POD_NAME", ValueFrom: &v1.EnvVarSource{FieldRef: &v1.ObjectFieldSelector{FieldPath: "metadata.name"}}}}, Resources: v1.ResourceRequirements{Requests: v1.ResourceList{"cpu": {i: resource.int64Amount{value: 25, scale: -3}, s: "25m", Format: "DecimalSI"}}}, VolumeMounts: []v1.VolumeMount{{Name: "varlog", MountPath: "/var/log/revisions"}, {Name: "configmap", MountPath: "/etc/fluent/config.d"}}}}, TerminationGracePeriodSeconds: &60},
I0516 08:10:26.932]               	},
I0516 08:10:26.933]               	Strategy:        v1.DeploymentStrategy{},
I0516 08:10:26.933]               	MinReadySeconds: 0,
I0516 08:10:26.933]               	... // 3 identical fields
I0516 08:10:26.933]               }
I0516 08:10:26.933]             	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.934]         logger.go:130: 2019-05-16T08:10:19.152Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	revision/reconcile_resources.go:134	Reconciling KPA:test-rev	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.934]         logger.go:130: 2019-05-16T08:10:19.152Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Istio_Outbound_IP_Ranges.revision-controller	controller/controller.go:305	Reconcile succeeded. Time taken: 14.116975ms.	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.935]     --- PASS: TestGlobalResyncOnConfigMapUpdateDeployment/Disable_Fluentd (0.73s)
I0516 08:10:26.935]         logger.go:130: 2019-05-16T08:10:19.154Z	ERROR	TestGlobalResyncOnConfigMapUpdateDeployment/Disable_Fluentd	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.935]         logger.go:130: 2019-05-16T08:10:19.154Z	DEBUG	TestGlobalResyncOnConfigMapUpdateDeployment/Disable_Fluentd.revision-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.936]         logger.go:130: 2019-05-16T08:10:19.155Z	DEBUG	TestGlobalResyncOnConfigMapUpdateDeployment/Disable_Fluentd.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.936]         logger.go:130: 2019-05-16T08:10:19.155Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Disable_Fluentd.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.937]         logger.go:130: 2019-05-16T08:10:19.156Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Disable_Fluentd.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.937]         logger.go:130: 2019-05-16T08:10:19.156Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Disable_Fluentd.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.938]             "outputPaths": ["stdout"],
I0516 08:10:26.938]             "errorOutputPaths": ["stderr"],
I0516 08:10:26.938]             "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.938]         logger.go:130: 2019-05-16T08:10:19.156Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Disable_Fluentd.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.939]             <match **>
I0516 08:10:26.939]               @type elasticsearch
... skipping 29 lines ...
I0516 08:10:26.949]             - 					},
I0516 08:10:26.950]             - 				},
I0516 08:10:26.950]               			},
I0516 08:10:26.950]               			InitContainers: nil,
I0516 08:10:26.950]               			Containers: []v1.Container{
I0516 08:10:26.951]               				{Name: "user-container", Image: "gcr.io/repo/image", Command: []string{"echo"}, Args: []string{"hello", "world"}, WorkingDir: "/tmp", Ports: []v1.ContainerPort{{Name: "user-port", ContainerPort: 8080}}, Env: []v1.EnvVar{{Name: "EDITOR", Value: "emacs"}, {Name: "PORT", Value: "8080"}, {Name: "K_REVISION", Value: "test-rev"}, {Name: "K_CONFIGURATION"}, {Name: "K_SERVICE"}}, Resources: v1.ResourceRequirements{Limits: v1.ResourceList{}, Requests: v1.ResourceList{}}, VolumeMounts: []v1.VolumeMount{{Name: "varlog", MountPath: "/var/log"}}, LivenessProbe: &v1.Probe{TimeoutSeconds: 42}, ReadinessProbe: &v1.Probe{Handler: v1.Handler{HTTPGet: &v1.HTTPGetAction{Path: "health", Port: intstr.IntOrString{IntVal: 8012}, HTTPHeaders: []v1.HTTPHeader{{Name: "K-Kubelet-Probe", Value: "queue"}}}}, TimeoutSeconds: 43}, Lifecycle: &v1.Lifecycle{PreStop: &v1.Handler{HTTPGet: &v1.HTTPGetAction{Path: "/wait-for-drain", Port: intstr.IntOrString{IntVal: 8022}}}}, TerminationMessagePath: "/dev/null", TerminationMessagePolicy: "FallbackToLogsOnError"},
I0516 08:10:26.953]               				{Name: "queue-proxy", Image: "queueImage", Ports: []v1.ContainerPort{{Name: "queueadm-port", ContainerPort: 8022}, {Name: "queue-metrics", ContainerPort: 9090}, {Name: "queue-port", ContainerPort: 8012}}, Env: []v1.EnvVar{{Name: "SERVING_NAMESPACE", Value: "test"}, {Name: "SERVING_SERVICE"}, {Name: "SERVING_CONFIGURATION"}, {Name: "SERVING_REVISION", Value: "test-rev"}, {Name: "QUEUE_SERVING_PORT", Value: "8012"}, {Name: "CONTAINER_CONCURRENCY", Value: "0"}, {Name: "REVISION_TIMEOUT_SECONDS", Value: "60"}, {Name: "SERVING_POD", ValueFrom: &v1.EnvVarSource{FieldRef: &v1.ObjectFieldSelector{FieldPath: "metadata.name"}}}, {Name: "SERVING_POD_IP", ValueFrom: &v1.EnvVarSource{FieldRef: &v1.ObjectFieldSelector{FieldPath: "status.podIP"}}}, {Name: "SERVING_LOGGING_CONFIG", Value: "{\"level\": \"error\",\n\"outputPaths\": [\"stdout\"],\n\"errorOutputPaths\": [\"stderr\"],\n\"encoding\": \"json\"}"}, {Name: "SERVING_LOGGING_LEVEL", Value: "info"}, {Name: "SERVING_REQUEST_LOG_TEMPLATE"}, {Name: "SERVING_REQUEST_METRICS_BACKEND"}, {Name: "USER_PORT", Value: "8080"}, {Name: "SYSTEM_NAMESPACE", Value: "knative-testing"}}, Resources: v1.ResourceRequirements{Requests: v1.ResourceList{"cpu": {i: resource.int64Amount{value: 25, scale: -3}, s: "25m", Format: "DecimalSI"}}}, ReadinessProbe: &v1.Probe{Handler: v1.Handler{HTTPGet: &v1.HTTPGetAction{Path: "/health", Port: intstr.IntOrString{IntVal: 8022}}}, TimeoutSeconds: 10, PeriodSeconds: 1}},
I0516 08:10:26.953]             - 				{
I0516 08:10:26.953]             - 					Name:  "fluentd-proxy",
I0516 08:10:26.953]             - 					Image: "fluentdImage",
I0516 08:10:26.953]             - 					Env: []v1.EnvVar{
I0516 08:10:26.954]             - 						{Name: "FLUENTD_ARGS", Value: "--no-supervisor -q"},
I0516 08:10:26.954]             - 						{Name: "SERVING_CONTAINER_NAME", Value: "user-container"},
... skipping 26 lines ...
I0516 08:10:26.960]               	... // 3 identical fields
I0516 08:10:26.960]               }
I0516 08:10:26.961]             	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.961]         logger.go:130: 2019-05-16T08:10:19.887Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Disable_Fluentd.revision-controller	revision/reconcile_resources.go:134	Reconciling KPA:test-rev	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.961]         logger.go:130: 2019-05-16T08:10:19.887Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Disable_Fluentd.revision-controller	controller/controller.go:305	Reconcile succeeded. Time taken: 19.112989ms.	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.962]     --- PASS: TestGlobalResyncOnConfigMapUpdateDeployment/Update_Fluentd_Image (0.74s)
I0516 08:10:26.962]         logger.go:130: 2019-05-16T08:10:19.889Z	ERROR	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Fluentd_Image	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.962]         logger.go:130: 2019-05-16T08:10:19.889Z	DEBUG	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Fluentd_Image.revision-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.963]         logger.go:130: 2019-05-16T08:10:19.890Z	DEBUG	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Fluentd_Image.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.963]         logger.go:130: 2019-05-16T08:10:19.891Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Fluentd_Image.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.964]         logger.go:130: 2019-05-16T08:10:19.891Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Fluentd_Image.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.964]         logger.go:130: 2019-05-16T08:10:19.892Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Fluentd_Image.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.964]             "outputPaths": ["stdout"],
I0516 08:10:26.965]             "errorOutputPaths": ["stderr"],
I0516 08:10:26.965]             "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.966]         logger.go:130: 2019-05-16T08:10:19.892Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Fluentd_Image.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.966]             <match **>
I0516 08:10:26.966]               @type elasticsearch
... skipping 25 lines ...
I0516 08:10:26.976]               		ObjectMeta: v1.ObjectMeta{Labels: map[string]string{"app": "test-rev", "serving.knative.dev/revision": "test-rev", "serving.knative.dev/revisionUID": "test-rev-uid", "serving.knative.dev/route": "test-route", "testLabel1": "foo", "testLabel2": "bar"}, Annotations: map[string]string{"sidecar.istio.io/inject": "true", "testAnnotation": "test", "traffic.sidecar.istio.io/includeOutboundIPRanges": "*"}},
I0516 08:10:26.976]               		Spec: v1.PodSpec{
I0516 08:10:26.976]               			Volumes:        []v1.Volume{{Name: "varlog", VolumeSource: v1.VolumeSource{EmptyDir: &v1.EmptyDirVolumeSource{}}}, {Name: "configmap", VolumeSource: v1.VolumeSource{ConfigMap: &v1.ConfigMapVolumeSource{LocalObjectReference: v1.LocalObjectReference{Name: "test-rev-fluentd"}}}}},
I0516 08:10:26.977]               			InitContainers: nil,
I0516 08:10:26.977]               			Containers: []v1.Container{
I0516 08:10:26.978]               				{Name: "user-container", Image: "gcr.io/repo/image", Command: []string{"echo"}, Args: []string{"hello", "world"}, WorkingDir: "/tmp", Ports: []v1.ContainerPort{{Name: "user-port", ContainerPort: 8080}}, Env: []v1.EnvVar{{Name: "EDITOR", Value: "emacs"}, {Name: "PORT", Value: "8080"}, {Name: "K_REVISION", Value: "test-rev"}, {Name: "K_CONFIGURATION"}, {Name: "K_SERVICE"}}, Resources: v1.ResourceRequirements{Limits: v1.ResourceList{}, Requests: v1.ResourceList{}}, VolumeMounts: []v1.VolumeMount{{Name: "varlog", MountPath: "/var/log"}}, LivenessProbe: &v1.Probe{TimeoutSeconds: 42}, ReadinessProbe: &v1.Probe{Handler: v1.Handler{HTTPGet: &v1.HTTPGetAction{Path: "health", Port: intstr.IntOrString{IntVal: 8012}, HTTPHeaders: []v1.HTTPHeader{{Name: "K-Kubelet-Probe", Value: "queue"}}}}, TimeoutSeconds: 43}, Lifecycle: &v1.Lifecycle{PreStop: &v1.Handler{HTTPGet: &v1.HTTPGetAction{Path: "/wait-for-drain", Port: intstr.IntOrString{IntVal: 8022}}}}, TerminationMessagePath: "/dev/null", TerminationMessagePolicy: "FallbackToLogsOnError"},
I0516 08:10:26.979]               				{Name: "queue-proxy", Image: "queueImage", Ports: []v1.ContainerPort{{Name: "queueadm-port", ContainerPort: 8022}, {Name: "queue-metrics", ContainerPort: 9090}, {Name: "queue-port", ContainerPort: 8012}}, Env: []v1.EnvVar{{Name: "SERVING_NAMESPACE", Value: "test"}, {Name: "SERVING_SERVICE"}, {Name: "SERVING_CONFIGURATION"}, {Name: "SERVING_REVISION", Value: "test-rev"}, {Name: "QUEUE_SERVING_PORT", Value: "8012"}, {Name: "CONTAINER_CONCURRENCY", Value: "0"}, {Name: "REVISION_TIMEOUT_SECONDS", Value: "60"}, {Name: "SERVING_POD", ValueFrom: &v1.EnvVarSource{FieldRef: &v1.ObjectFieldSelector{FieldPath: "metadata.name"}}}, {Name: "SERVING_POD_IP", ValueFrom: &v1.EnvVarSource{FieldRef: &v1.ObjectFieldSelector{FieldPath: "status.podIP"}}}, {Name: "SERVING_LOGGING_CONFIG", Value: "{\"level\": \"error\",\n\"outputPaths\": [\"stdout\"],\n\"errorOutputPaths\": [\"stderr\"],\n\"encoding\": \"json\"}"}, {Name: "SERVING_LOGGING_LEVEL", Value: "info"}, {Name: "SERVING_REQUEST_LOG_TEMPLATE"}, {Name: "SERVING_REQUEST_METRICS_BACKEND"}, {Name: "USER_PORT", Value: "8080"}, {Name: "SYSTEM_NAMESPACE", Value: "knative-testing"}}, Resources: v1.ResourceRequirements{Requests: v1.ResourceList{"cpu": {i: resource.int64Amount{value: 25, scale: -3}, s: "25m", Format: "DecimalSI"}}}, ReadinessProbe: &v1.Probe{Handler: v1.Handler{HTTPGet: &v1.HTTPGetAction{Path: "/health", Port: intstr.IntOrString{IntVal: 8022}}}, TimeoutSeconds: 10, PeriodSeconds: 1}},
I0516 08:10:26.980]               				{
I0516 08:10:26.980]               					Name:    "fluentd-proxy",
I0516 08:10:26.980]             - 					Image:   "fluentdImage",
I0516 08:10:26.980]             + 					Image:   "newFluentdImage",
I0516 08:10:26.980]               					Command: nil,
I0516 08:10:26.981]               					Args:    nil,
... skipping 10 lines ...
I0516 08:10:26.983]               	... // 3 identical fields
I0516 08:10:26.983]               }
I0516 08:10:26.984]             	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.984]         logger.go:130: 2019-05-16T08:10:20.632Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Fluentd_Image.revision-controller	revision/reconcile_resources.go:134	Reconciling KPA:test-rev	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.984]         logger.go:130: 2019-05-16T08:10:20.632Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_Fluentd_Image.revision-controller	controller/controller.go:305	Reconcile succeeded. Time taken: 20.853169ms.	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:26.985]     --- PASS: TestGlobalResyncOnConfigMapUpdateDeployment/Update_QueueProxy_Image (0.75s)
I0516 08:10:26.985]         logger.go:130: 2019-05-16T08:10:20.635Z	ERROR	TestGlobalResyncOnConfigMapUpdateDeployment/Update_QueueProxy_Image	revision/revision.go:123	Failed to create resolver transport: open /var/run/secrets/kubernetes.io/serviceaccount/ca.crt: no such file or directory
I0516 08:10:26.986]         logger.go:130: 2019-05-16T08:10:20.635Z	DEBUG	TestGlobalResyncOnConfigMapUpdateDeployment/Update_QueueProxy_Image.revision-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.986]         logger.go:130: 2019-05-16T08:10:20.636Z	DEBUG	TestGlobalResyncOnConfigMapUpdateDeployment/Update_QueueProxy_Image.revision-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.986]         logger.go:130: 2019-05-16T08:10:20.636Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_QueueProxy_Image.revision-controller	revision/revision.go:145	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.987]         logger.go:130: 2019-05-16T08:10:20.637Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_QueueProxy_Image.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.987]         logger.go:130: 2019-05-16T08:10:20.637Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_QueueProxy_Image.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I0516 08:10:26.988]             "outputPaths": ["stdout"],
I0516 08:10:26.988]             "errorOutputPaths": ["stderr"],
I0516 08:10:26.988]             "encoding": "json"} map[activator:info autoscaler:info controller:info queueproxy:info webhook:info]}	{"knative.dev/controller": "revision-controller"}
I0516 08:10:26.989]         logger.go:130: 2019-05-16T08:10:20.638Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_QueueProxy_Image.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I0516 08:10:26.989]             <match **>
I0516 08:10:26.989]               @type elasticsearch
... skipping 47 lines ...
I0516 08:10:27.006]         logger.go:130: 2019-05-16T08:10:21.386Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_QueueProxy_Image.revision-controller	revision/reconcile_resources.go:134	Reconciling KPA:test-rev	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:27.007]         logger.go:130: 2019-05-16T08:10:21.387Z	INFO	TestGlobalResyncOnConfigMapUpdateDeployment/Update_QueueProxy_Image.revision-controller	controller/controller.go:305	Reconcile succeeded. Time taken: 18.60117ms.	{"knative.dev/controller": "revision-controller", "knative.dev/key": "test/test-rev"}
I0516 08:10:27.007] === RUN   TestReconcile
I0516 08:10:27.007] === RUN   TestReconcile/bad_workqueue_key
I0516 08:10:27.008] === RUN   TestReconcile/key_not_found
I0516 08:10:27.008] {"level":"info","ts":1557994221.458599,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.009] {"level":"error","ts":1557994221.4587774,"logger":"fallback","caller":"revision/revision.go:229","msg":"revision \"foo/not-found\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:229\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.009] === RUN   TestReconcile/nop_deletion_reconcile
I0516 08:10:27.009] {"level":"info","ts":1557994221.493644,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.010] === RUN   TestReconcile/first_revision_reconciliation
I0516 08:10:27.010] {"level":"info","ts":1557994221.5372887,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.010] {"level":"info","ts":1557994221.5380707,"logger":"fallback","caller":"revision/reconcile_resources.go:59","msg":"Created deployment \"first-reconcile-deployment\"","knative.dev/deployment":"first-reconcile-deployment"}
I0516 08:10:27.011] {"level":"info","ts":1557994221.5387313,"logger":"fallback","caller":"revision/reconcile_resources.go:121","msg":"Created image cache \"first-reconcile-cache\""}
I0516 08:10:27.011] {"level":"info","ts":1557994221.538869,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:first-reconcile"}
I0516 08:10:27.011] {"level":"info","ts":1557994221.5392625,"logger":"fallback","caller":"revision/reconcile_resources.go:144","msg":"Created KPA:first-reconcile"}
I0516 08:10:27.011] === RUN   TestReconcile/failure_updating_revision_status
I0516 08:10:27.012] {"level":"info","ts":1557994221.6428745,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.012] {"level":"info","ts":1557994221.6438546,"logger":"fallback","caller":"revision/reconcile_resources.go:59","msg":"Created deployment \"update-status-failure-deployment\"","knative.dev/deployment":"update-status-failure-deployment"}
I0516 08:10:27.012] {"level":"info","ts":1557994221.6447797,"logger":"fallback","caller":"revision/reconcile_resources.go:121","msg":"Created image cache \"update-status-failure-cache\""}
I0516 08:10:27.013] {"level":"info","ts":1557994221.6449132,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:update-status-failure"}
I0516 08:10:27.013] {"level":"warn","ts":1557994221.6454659,"logger":"fallback","caller":"revision/revision.go:247","msg":"Failed to update revision status","error":"inducing failure for update revisions"}
I0516 08:10:27.013] === RUN   TestReconcile/failure_creating_kpa
I0516 08:10:27.014] {"level":"info","ts":1557994221.781238,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.014] {"level":"info","ts":1557994221.7822723,"logger":"fallback","caller":"revision/reconcile_resources.go:59","msg":"Created deployment \"create-kpa-failure-deployment\"","knative.dev/deployment":"create-kpa-failure-deployment"}
I0516 08:10:27.014] {"level":"info","ts":1557994221.783229,"logger":"fallback","caller":"revision/reconcile_resources.go:121","msg":"Created image cache \"create-kpa-failure-cache\""}
I0516 08:10:27.015] {"level":"info","ts":1557994221.783374,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:create-kpa-failure"}
I0516 08:10:27.016] {"level":"error","ts":1557994221.7838612,"logger":"fallback","caller":"revision/reconcile_resources.go:141","msg":"Error creating KPA create-kpa-failure: inducing failure for create podautoscalers","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcileKPA\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/reconcile_resources.go:141\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:388\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.017] {"level":"error","ts":1557994221.784214,"logger":"fallback","caller":"revision/revision.go:389","msg":"Failed to reconcile","phase":"KPA","error":"inducing failure for create podautoscalers","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:389\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.017] === RUN   TestReconcile/failure_creating_user_deployment
I0516 08:10:27.018] {"level":"info","ts":1557994221.8991563,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.019] {"level":"error","ts":1557994221.9000823,"logger":"fallback","caller":"revision/reconcile_resources.go:56","msg":"Error creating deployment \"create-user-deploy-failure-deployment\": inducing failure for create deployments","knative.dev/deployment":"create-user-deploy-failure-deployment","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcileDeployment\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/reconcile_resources.go:56\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:388\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.020] {"level":"error","ts":1557994221.900485,"logger":"fallback","caller":"revision/revision.go:389","msg":"Failed to reconcile","phase":"user deployment","error":"inducing failure for create deployments","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:389\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.020] === RUN   TestReconcile/stable_revision_reconciliation
I0516 08:10:27.021] {"level":"info","ts":1557994222.0372643,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.021] {"level":"info","ts":1557994222.0387232,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:stable-reconcile"}
I0516 08:10:27.021] === RUN   TestReconcile/update_deployment_containers
I0516 08:10:27.022] {"level":"info","ts":1557994222.1335373,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.023] {"level":"info","ts":1557994222.1405811,"logger":"fallback","caller":"revision/cruds.go:97","msg":"Reconciled deployment diff (-desired, +observed):   v1.DeploymentSpec{\n  \tReplicas: &1,\n  \tSelector: &v1.LabelSelector{MatchLabels: map[string]string{\"serving.knative.dev/revisionUID\": \"test-uid\"}},\n  \tTemplate: v1.PodTemplateSpec{\n  \t\tObjectMeta: v1.ObjectMeta{Labels: map[string]string{\"app\": \"fix-containers\", \"serving.knative.dev/revision\": \"fix-containers\", \"serving.knative.dev/revisionUID\": \"test-uid\"}, Annotations: map[string]string{\"sidecar.istio.io/inject\": \"true\", \"traffic.sidecar.istio.io/includeOutboundIPRanges\": \"*\"}},\n  \t\tSpec: v1.PodSpec{\n  \t\t\tVolumes:        []v1.Volume{{Name: \"varlog\", VolumeSource: v1.VolumeSource{EmptyDir: &v1.EmptyDirVolumeSource{}}}},\n  \t\t\tInitContainers: nil,\n  \t\t\tContainers: []v1.Container{\n  \t\t\t\t{\n  \t\t\t\t\tName:    \"user-container\",\n- \t\t\t\t\tImage:   \"asdf\",\n+ \t\t\t\t\tImage:   \"busybox\",\n  \t\t\t\t\tCommand: nil,\n  \t\t\t\t\tArgs:    nil,\n  \t\t\t\t\t... // 17 identical fields\n  \t\t\t\t},\n  \t\t\t\t{\n  \t\t\t\t\tName:    \"queue-proxy\",\n- \t\t\t\t\tImage:   \"asdf\",\n+ \t\t\t\t\tImage:   \"queueImage\",\n  \t\t\t\t\tCommand: nil,\n  \t\t\t\t\tArgs:    nil,\n  \t\t\t\t\t... // 17 identical fields\n  \t\t\t\t},\n  \t\t\t},\n  \t\t\tRestartPolicy:                 \"\",\n  \t\t\tTerminationGracePeriodSeconds: &300,\n  \t\t\t... // 24 identical fields\n  \t\t},\n  \t},\n  \tStrategy:        v1.DeploymentStrategy{},\n  \tMinReadySeconds: 0,\n  \t... // 3 identical fields\n  }\n"}
I0516 08:10:27.023] {"level":"info","ts":1557994222.149459,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:fix-containers"}
I0516 08:10:27.024] === RUN   TestReconcile/failure_updating_deployment
I0516 08:10:27.024] {"level":"info","ts":1557994222.2981858,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.025] {"level":"error","ts":1557994222.298874,"logger":"fallback","caller":"revision/reconcile_resources.go:71","msg":"Error updating deployment \"failure-update-deploy-deployment\": inducing failure for update deployments","knative.dev/deployment":"failure-update-deploy-deployment","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcileDeployment\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/reconcile_resources.go:71\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:388\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.026] {"level":"error","ts":1557994222.299176,"logger":"fallback","caller":"revision/revision.go:389","msg":"Failed to reconcile","phase":"user deployment","error":"inducing failure for update deployments","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:389\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.026] === RUN   TestReconcile/deactivated_revision_is_stable
I0516 08:10:27.027] {"level":"info","ts":1557994222.458162,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.027] {"level":"info","ts":1557994222.4598124,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:stable-deactivation"}
I0516 08:10:27.027] === RUN   TestReconcile/endpoint_is_created_(not_ready)
I0516 08:10:27.028] {"level":"info","ts":1557994222.5410998,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.028] {"level":"info","ts":1557994222.542438,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:endpoint-created-not-ready"}
... skipping 12 lines ...
I0516 08:10:27.032] === RUN   TestReconcile/mutated_KPA_gets_fixed
I0516 08:10:27.032] {"level":"info","ts":1557994223.2135324,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.032] {"level":"info","ts":1557994223.2152343,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:fix-mutated-kpa"}
I0516 08:10:27.033] {"level":"info","ts":1557994223.2155116,"logger":"fallback","caller":"revision/reconcile_resources.go:159","msg":"KPA fix-mutated-kpa needs reconciliation"}
I0516 08:10:27.033] === RUN   TestReconcile/mutated_KPA_gets_error_during_the_fix
I0516 08:10:27.033] {"level":"info","ts":1557994223.3081503,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.034] {"level":"info","ts":1557994223.3093376,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:fix-mutated-kpa-fail"}
I0516 08:10:27.034] {"level":"info","ts":1557994223.3094893,"logger":"fallback","caller":"revision/reconcile_resources.go:159","msg":"KPA fix-mutated-kpa-fail needs reconciliation"}
I0516 08:10:27.035] {"level":"error","ts":1557994223.3098564,"logger":"fallback","caller":"revision/revision.go:389","msg":"Failed to reconcile","phase":"KPA","error":"inducing failure for update podautoscalers","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:389\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.035] === RUN   TestReconcile/surface_deployment_timeout
I0516 08:10:27.035] {"level":"info","ts":1557994223.3938944,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.036] {"level":"info","ts":1557994223.410156,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:deploy-timeout"}
I0516 08:10:27.036] === RUN   TestReconcile/surface_pod_errors
I0516 08:10:27.036] {"level":"info","ts":1557994223.5067117,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.037] {"level":"info","ts":1557994223.5082908,"logger":"fallback","caller":"revision/reconcile_resources.go:88","msg":"pod-error marking exiting with: 5/I failed man!","knative.dev/deployment":"pod-error-deployment"}
I0516 08:10:27.037] {"level":"info","ts":1557994223.5085082,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:pod-error"}
I0516 08:10:27.037] === RUN   TestReconcile/build_missing
I0516 08:10:27.038] {"level":"info","ts":1557994223.5985324,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.039] {"level":"error","ts":1557994223.7039568,"logger":"fallback","caller":"revision/revision.go:287","msg":"Error fetching Build \"the-build\" for Revision \"missing-build\": builds.testing.build.knative.dev \"the-build\" not found","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcileBuild\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:287\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:358\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.039] === RUN   TestReconcile/build_running
I0516 08:10:27.039] {"level":"info","ts":1557994223.768972,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.040] === RUN   TestReconcile/build_newly_done
I0516 08:10:27.040] {"level":"info","ts":1557994223.922451,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.040] {"level":"info","ts":1557994224.028221,"logger":"fallback","caller":"revision/reconcile_resources.go:59","msg":"Created deployment \"done-build-deployment\"","knative.dev/deployment":"done-build-deployment"}
I0516 08:10:27.041] {"level":"info","ts":1557994224.029335,"logger":"fallback","caller":"revision/reconcile_resources.go:121","msg":"Created image cache \"done-build-cache\""}
... skipping 9 lines ...
I0516 08:10:27.043] === RUN   TestReconcile/ready_steady_state
I0516 08:10:27.044] {"level":"info","ts":1557994224.7478802,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.044] {"level":"info","ts":1557994224.749426,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:steady-ready"}
I0516 08:10:27.044] === RUN   TestReconcile/lost_kpa_owner_ref
I0516 08:10:27.045] {"level":"info","ts":1557994224.851235,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.045] {"level":"info","ts":1557994224.852899,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:missing-owners"}
I0516 08:10:27.046] {"level":"error","ts":1557994224.8531935,"logger":"fallback","caller":"revision/revision.go:389","msg":"Failed to reconcile","phase":"KPA","error":"Revision: \"missing-owners\" does not own PodAutoscaler: \"missing-owners\"","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:389\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.046] === RUN   TestReconcile/lost_deployment_owner_ref
I0516 08:10:27.046] {"level":"info","ts":1557994224.9968603,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.047] {"level":"error","ts":1557994224.9972353,"logger":"fallback","caller":"revision/revision.go:389","msg":"Failed to reconcile","phase":"user deployment","error":"Revision: \"missing-owners\" does not own Deployment: \"missing-owners-deployment\"","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:389\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.048] --- PASS: TestReconcile (3.66s)
I0516 08:10:27.048]     --- PASS: TestReconcile/bad_workqueue_key (0.02s)
I0516 08:10:27.048]         logger.go:130: 2019-05-16T08:10:21.436Z	ERROR	TestReconcile/bad_workqueue_key.revision-controller	revision/revision.go:217	invalid resource key: too/many/parts	{"knative.dev/controller": "revision-controller"}
I0516 08:10:27.049]     --- PASS: TestReconcile/key_not_found (0.02s)
I0516 08:10:27.049]     --- PASS: TestReconcile/nop_deletion_reconcile (0.03s)
I0516 08:10:27.049]     --- PASS: TestReconcile/first_revision_reconciliation (0.10s)
I0516 08:10:27.049]     --- PASS: TestReconcile/failure_updating_revision_status (0.13s)
I0516 08:10:27.050]     --- PASS: TestReconcile/failure_creating_kpa (0.11s)
I0516 08:10:27.050]     --- PASS: TestReconcile/failure_creating_user_deployment (0.11s)
... skipping 28 lines ...
I0516 08:10:27.057] {"level":"info","ts":1557994225.086018,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:first-reconcile-var-log"}
I0516 08:10:27.058] {"level":"info","ts":1557994225.0865433,"logger":"fallback","caller":"revision/reconcile_resources.go:144","msg":"Created KPA:first-reconcile-var-log"}
I0516 08:10:27.058] === RUN   TestReconcileWithVarLogEnabled/failure_creating_fluentd_configmap
I0516 08:10:27.058] {"level":"info","ts":1557994225.2317247,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.059] {"level":"info","ts":1557994225.232711,"logger":"fallback","caller":"revision/reconcile_resources.go:59","msg":"Created deployment \"create-configmap-failure-deployment\"","knative.dev/deployment":"create-configmap-failure-deployment"}
I0516 08:10:27.059] {"level":"info","ts":1557994225.23352,"logger":"fallback","caller":"revision/reconcile_resources.go:121","msg":"Created image cache \"create-configmap-failure-cache\""}
I0516 08:10:27.060] {"level":"error","ts":1557994225.2337177,"logger":"fallback","caller":"revision/reconcile_resources.go:212","msg":"Error creating fluentd configmap","error":"inducing failure for create configmaps","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcileFluentdConfigMap\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/reconcile_resources.go:212\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:388\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.061] {"level":"error","ts":1557994225.2339935,"logger":"fallback","caller":"revision/revision.go:389","msg":"Failed to reconcile","phase":"fluentd configmap","error":"inducing failure for create configmaps","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:389\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.062] === RUN   TestReconcileWithVarLogEnabled/steady_state_after_initial_creation
I0516 08:10:27.062] {"level":"info","ts":1557994225.3639724,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.062] {"level":"info","ts":1557994225.3658652,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:steady-state"}
I0516 08:10:27.063] === RUN   TestReconcileWithVarLogEnabled/update_a_bad_fluentd_configmap
I0516 08:10:27.063] {"level":"info","ts":1557994225.488944,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.064] {"level":"info","ts":1557994225.4913306,"logger":"fallback","caller":"revision/reconcile_resources.go:226","msg":"Reconciling fluentd configmap diff (-desired, +observed):   map[string]string{\n+ \t\"bad key\":     \"bad value\",\n- \t\"varlog.conf\": \"\\n<source>\\n\\t@type tail\\n\\tpath /var/log/revisions/**/*.*\\n\\tpos_file /var/log/varlog.log.pos\\n\\ttag raw.*\\n\\tformat none\\n\\tmessage_key log\\n\\tread_from_head true\\n</source>\\n\\n<filter raw.var.log.**>\\n\\t@type record_transformer\\n\\tenable_ruby true\\n\\t<record>\\n\\t  kubernetes ${ {\\\"container_name\\\": \\\"#{ENV['SERVING_CONTAINER_NAME']}\\\", \\\"namespace_name\\\": \\\"#{ENV['SERVING_NAMESPACE']}\\\", \\\"pod_name\\\": \\\"#{ENV['SERVING_POD_NAME']}\\\", \\\"labels\\\": {\\\"knative_dev/configuration\\\": \\\"#{ENV['SERVING_CONFIGURATION']}\\\", \\\"knative_dev/revision\\\": \\\"#{ENV['SERVING_REVISION']}\\\"} } }\\n\\t\\tstream varlog\\n\\t\\t# Line breaks may be trimmed when collecting from files. Add them back so that\\n\\t\\t# multi line logs are still in multi line after combined by detect_exceptions.\\n\\t\\t# Remove this if https://github.com/GoogleCloudPlatform/fluent-plugin-detect-exceptions/pull/10 is released\\n\\t\\tlog ${ if record[\\\"log\\\"].end_with?(\\\"\\\\n\\\") then record[\\\"log\\\"] else record[\\\"log\\\"] + \\\"\\\\n\\\" end }\\n\\t</record>\\n</filter>\\n\\n<match raw.var.log.**>\\n\\t@id raw.var.log\\n\\t@type detect_exceptions\\n\\tremove_tag_prefix raw\\n\\tmessage log\\n\\tstream stream\\n\\tmultiline_flush_interval 5\\n\\tmax_bytes 500000\\n\\tmax_lines 1000\\n</match>\\n\\n\",\n  }\n"}
I0516 08:10:27.065] {"level":"info","ts":1557994225.4918742,"logger":"fallback","caller":"revision/reconcile_resources.go:134","msg":"Reconciling KPA:update-fluentd-config"}
I0516 08:10:27.065] === RUN   TestReconcileWithVarLogEnabled/failure_updating_fluentd_configmap
I0516 08:10:27.065] {"level":"info","ts":1557994225.59122,"logger":"fallback","caller":"revision/revision.go:221","msg":"Running reconcile Revision"}
I0516 08:10:27.067] {"level":"info","ts":1557994225.5930417,"logger":"fallback","caller":"revision/reconcile_resources.go:226","msg":"Reconciling fluentd configmap diff (-desired, +observed):   map[string]string{\n+ \t\"bad key\":     \"bad value\",\n- \t\"varlog.conf\": \"\\n<source>\\n\\t@type tail\\n\\tpath /var/log/revisions/**/*.*\\n\\tpos_file /var/log/varlog.log.pos\\n\\ttag raw.*\\n\\tformat none\\n\\tmessage_key log\\n\\tread_from_head true\\n</source>\\n\\n<filter raw.var.log.**>\\n\\t@type record_transformer\\n\\tenable_ruby true\\n\\t<record>\\n\\t  kubernetes ${ {\\\"container_name\\\": \\\"#{ENV['SERVING_CONTAINER_NAME']}\\\", \\\"namespace_name\\\": \\\"#{ENV['SERVING_NAMESPACE']}\\\", \\\"pod_name\\\": \\\"#{ENV['SERVING_POD_NAME']}\\\", \\\"labels\\\": {\\\"knative_dev/configuration\\\": \\\"#{ENV['SERVING_CONFIGURATION']}\\\", \\\"knative_dev/revision\\\": \\\"#{ENV['SERVING_REVISION']}\\\"} } }\\n\\t\\tstream varlog\\n\\t\\t# Line breaks may be trimmed when collecting from files. Add them back so that\\n\\t\\t# multi line logs are still in multi line after combined by detect_exceptions.\\n\\t\\t# Remove this if https://github.com/GoogleCloudPlatform/fluent-plugin-detect-exceptions/pull/10 is released\\n\\t\\tlog ${ if record[\\\"log\\\"].end_with?(\\\"\\\\n\\\") then record[\\\"log\\\"] else record[\\\"log\\\"] + \\\"\\\\n\\\" end }\\n\\t</record>\\n</filter>\\n\\n<match raw.var.log.**>\\n\\t@id raw.var.log\\n\\t@type detect_exceptions\\n\\tremove_tag_prefix raw\\n\\tmessage log\\n\\tstream stream\\n\\tmultiline_flush_interval 5\\n\\tmax_bytes 500000\\n\\tmax_lines 1000\\n</match>\\n\\n\",\n  }\n"}
I0516 08:10:27.068] {"level":"error","ts":1557994225.5933256,"logger":"fallback","caller":"revision/reconcile_resources.go:233","msg":"Error updating fluentd configmap","error":"inducing failure for update configmaps","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcileFluentdConfigMap\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/reconcile_resources.go:233\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:388\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.069] {"level":"error","ts":1557994225.5935724,"logger":"fallback","caller":"revision/revision.go:389","msg":"Failed to reconcile","phase":"fluentd configmap","error":"inducing failure for update configmaps","stacktrace":"github.com/knative/serving/pkg/reconciler/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:389\ngithub.com/knative/serving/pkg/reconciler/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/revision/revision.go:240\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.069] --- PASS: TestReconcileWithVarLogEnabled (0.60s)
I0516 08:10:27.070]     --- PASS: TestReconcileWithVarLogEnabled/first_revision_reconciliation_(with_/var/log_enabled) (0.12s)
I0516 08:10:27.070]     --- PASS: TestReconcileWithVarLogEnabled/failure_creating_fluentd_configmap (0.14s)
I0516 08:10:27.070]     --- PASS: TestReconcileWithVarLogEnabled/steady_state_after_initial_creation (0.05s)
I0516 08:10:27.070]     --- PASS: TestReconcileWithVarLogEnabled/update_a_bad_fluentd_configmap (0.08s)
I0516 08:10:27.071]     --- PASS: TestReconcileWithVarLogEnabled/failure_updating_fluentd_configmap (0.05s)
... skipping 207 lines ...
I0516 08:10:27.133]     logger.go:130: 2019-05-16T08:10:16.602Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:319	Creating placeholder k8s services	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.133]     logger.go:130: 2019-05-16T08:10:16.603Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/reconcile_resources.go:187	Created service test-route	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.133]     logger.go:130: 2019-05-16T08:10:16.604Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:356	Creating ClusterIngress.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.134]     queueing_test.go:123: ingress created: "route-"
I0516 08:10:27.134]     logger.go:130: 2019-05-16T08:10:16.605Z	INFO	TestNewRouteCallsSyncHandler.route-controller	controller/controller.go:255	Shutting down workers	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.134]     logger.go:130: 2019-05-16T08:10:16.607Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:367	Updating placeholder k8s services with clusterIngress information	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.135]     logger.go:130: 2019-05-16T08:10:16.607Z	WARN	TestNewRouteCallsSyncHandler.route-controller	route/reconcile_resources.go:219	Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.135]     logger.go:130: 2019-05-16T08:10:16.607Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:373	Route successfully synced	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.136]     logger.go:130: 2019-05-16T08:10:16.607Z	INFO	TestNewRouteCallsSyncHandler.route-controller	controller/controller.go:305	Reconcile succeeded. Time taken: 21.269081ms.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.138]     logger.go:130: 2019-05-16T08:10:16.608Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:274	Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route", GenerateName:"", Namespace:"test", SelfLink:"/apis/serving/v1alpha1/namespaces/test/Routes/test-route", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"route":"test-route"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string{"routes.serving.knative.dev"}, ClusterName:""}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:"", TrafficTarget:v1beta1.TrafficTarget{Tag:"", RevisionName:"test-rev", ConfigurationName:"", LatestRevision:(*bool)(0xc00061b35b), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:"AllTrafficAssigned", Status:"Unknown", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649a2440003e, ext:771810649, loc:(*time.Location)(0x33deb60)}}}, Reason:"", Message:""}, apis.Condition{Type:"IngressReady", Status:"Unknown", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649a24402db7, ext:771822342, loc:(*time.Location)(0x33deb60)}}}, Reason:"", Message:""}, apis.Condition{Type:"Ready", Status:"Unknown", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649a243fe00e, ext:771802424, loc:(*time.Location)(0x33deb60)}}}, Reason:"", Message:""}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:"", DeprecatedDomainInternal:"", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.138]     logger.go:130: 2019-05-16T08:10:16.609Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:441	All referred targets are routable, marking AllTrafficAssigned with traffic information.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.139]     logger.go:130: 2019-05-16T08:10:16.609Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:296	Updating targeted revisions.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.139]     logger.go:130: 2019-05-16T08:10:16.610Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:319	Creating placeholder k8s services	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.139]     logger.go:130: 2019-05-16T08:10:16.610Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:356	Creating ClusterIngress.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.140]     logger.go:130: 2019-05-16T08:10:16.612Z	ERROR	TestNewRouteCallsSyncHandler.route-controller	route/reconcile_resources.go:96	Failed to create ClusterIngress	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route", "error": "clusteringresses.networking.internal.knative.dev \"route-\" already exists"}
I0516 08:10:27.140]     logger.go:130: 2019-05-16T08:10:16.612Z	ERROR	TestNewRouteCallsSyncHandler.route-controller	controller/controller.go:311	Reconcile error	{"knative.dev/controller": "route-controller", "error": "clusteringresses.networking.internal.knative.dev \"route-\" already exists"}
I0516 08:10:27.141]     logger.go:130: 2019-05-16T08:10:16.612Z	INFO	TestNewRouteCallsSyncHandler.route-controller	controller/controller.go:298	Reconcile failed. Time taken: 4.761635ms.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.141] === RUN   TestReconcileClusterIngress_Insert
I0516 08:10:27.142] E0516 08:10:16.619157   22871 event.go:259] Could not construct reference to: '&v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route", GenerateName:"", Namespace:"test-ns", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions(nil)}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:"", DeprecatedDomainInternal:"", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}' due to: 'selfLink was empty, can't make reference'. Will not report event: 'Normal' 'Created' 'Created ClusterIngress "route-"'
I0516 08:10:27.143] --- PASS: TestReconcileClusterIngress_Insert (0.01s)
I0516 08:10:27.143]     logger.go:130: 2019-05-16T08:10:16.613Z	DEBUG	TestReconcileClusterIngress_Insert.route-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.144]     logger.go:130: 2019-05-16T08:10:16.615Z	DEBUG	TestReconcileClusterIngress_Insert.route-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.144]     logger.go:130: 2019-05-16T08:10:16.615Z	INFO	TestReconcileClusterIngress_Insert.route-controller	route/route.go:141	Setting up event handlers	{"knative.dev/controller": "route-controller"}
... skipping 55 lines ...
I0516 08:10:27.170] {"level":"info","ts":1557994216.681884,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.170] {"level":"info","ts":1557994216.6829107,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service test-route"}
I0516 08:10:27.171] {"level":"info","ts":1557994216.6833203,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.172] E0516 08:10:16.684573   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c47828f9e", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created placeholder service \"test-route\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a28b77f9e, ext:846750908, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a28b77f9e, ext:846750908, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.173] E0516 08:10:16.687171   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c47afe992", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created ClusterIngress \"route-\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a28e4d992, ext:849723058, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a28e4d992, ext:849723058, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.174] {"level":"info","ts":1557994216.6866572,"logger":"fallback","caller":"route/route.go:367","msg":"Updating placeholder k8s services with clusterIngress information"}
I0516 08:10:27.174] {"level":"warn","ts":1557994216.6877818,"logger":"fallback","caller":"route/reconcile_resources.go:219","msg":"Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I0516 08:10:27.175] {"level":"info","ts":1557994216.6879556,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.176] {"level":"info","ts":1557994216.6984768,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"test-route\", GenerateName:\"\", Namespace:\"test\", SelfLink:\"/apis/serving/v1alpha1/namespaces/test/Routes/test-route\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{\"route\":\"test-route\"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"test-rev\", ConfigurationName:\"test-config\", LatestRevision:(*bool)(0xc0000b69f8), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649a299a2f70, ext:861607054, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649a299a5d89, ext:861618898, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649a299a0b09, ext:861597781, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.177] {"level":"info","ts":1557994216.6995897,"logger":"fallback","caller":"route/route.go:419","msg":"Revision test/test-rev is inactive"}
I0516 08:10:27.177] {"level":"info","ts":1557994216.7000396,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.177] {"level":"info","ts":1557994216.7002027,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.178] {"level":"info","ts":1557994216.70543,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.179] {"level":"error","ts":1557994216.7063434,"logger":"fallback","caller":"route/reconcile_resources.go:182","msg":"Failed to create placeholder service","error":"services \"test-route\" already exists","stacktrace":"github.com/knative/serving/pkg/reconciler/route.(*Reconciler).reconcilePlaceholderServices\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/reconcile_resources.go:182\ngithub.com/knative/serving/pkg/reconciler/route.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/route.go:320\ngithub.com/knative/serving/pkg/reconciler/route.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/route.go:225\ngithub.com/knative/serving/pkg/reconciler/route.TestCreateRouteForOneReserveRevision\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/route_test.go:355\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.180] E0516 08:10:16.707668   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c48eb2011", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"CreationFailed", Message:"Failed to create placeholder service \"test-route\": services \"test-route\" already exists", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2a201011, ext:870380848, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2a201011, ext:870380848, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.182] E0516 08:10:16.709211   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c49066d5d", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"InternalError", Message:"services \"test-route\" already exists", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2a3b5d5d, ext:872170120, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2a3b5d5d, ext:872170120, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Warning", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.182] --- PASS: TestCreateRouteForOneReserveRevision (0.04s)
I0516 08:10:27.182]     logger.go:130: 2019-05-16T08:10:16.664Z	DEBUG	TestCreateRouteForOneReserveRevision.route-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.183]     logger.go:130: 2019-05-16T08:10:16.666Z	DEBUG	TestCreateRouteForOneReserveRevision.route-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.183]     logger.go:130: 2019-05-16T08:10:16.666Z	INFO	TestCreateRouteForOneReserveRevision.route-controller	route/route.go:141	Setting up event handlers	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.184]     logger.go:130: 2019-05-16T08:10:16.667Z	INFO	TestCreateRouteForOneReserveRevision.route-controller	route/route.go:180	Setting up ConfigMap receivers	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.184]     logger.go:130: 2019-05-16T08:10:16.667Z	INFO	TestCreateRouteForOneReserveRevision.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[prod-domain.com:0xc0004901b0 test-domain.dev:0xc0004901a8]}	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.185]     logger.go:130: 2019-05-16T08:10:16.668Z	INFO	TestCreateRouteForOneReserveRevision.route-controller.config-store	configmap/store.go:166	route config "config-network" config was added or updated: &{* istio.ingress.networking.knative.dev {{.Name}}.{{.Namespace}}.{{.Domain}} false enabled}	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.185]     logger.go:130: 2019-05-16T08:10:16.668Z	INFO	TestCreateRouteForOneReserveRevision.route-controller.config-store	configmap/store.go:166	route config "config-gc" config was added or updated: &{24h0m0s 15h0m0s 1 5h0m0s}	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.186]     logger.go:130: 2019-05-16T08:10:16.683Z	INFO	TestCreateRouteForOneReserveRevision.route-controller.event-broadcaster	record/event.go:221	Event(v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Created' Created placeholder service "test-route"	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.186]     hooks.go:112: Got an event message matching "Created placeholder service \"test-route\"": "Created placeholder service \"test-route\""
I0516 08:10:27.187]     logger.go:130: 2019-05-16T08:10:16.686Z	INFO	TestCreateRouteForOneReserveRevision.route-controller.event-broadcaster	record/event.go:221	Event(v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Created' Created ClusterIngress "route-"	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.187]     hooks.go:112: Got an event message matching "^Created ClusterIngress.*": "Created ClusterIngress \"route-\""
I0516 08:10:27.188]     logger.go:130: 2019-05-16T08:10:16.707Z	INFO	TestCreateRouteForOneReserveRevision.route-controller.event-broadcaster	record/event.go:221	Event(v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Warning' reason: 'CreationFailed' Failed to create placeholder service "test-route": services "test-route" already exists	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.188]     logger.go:130: 2019-05-16T08:10:16.708Z	INFO	TestCreateRouteForOneReserveRevision.route-controller.event-broadcaster	record/event.go:221	Event(v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Warning' reason: 'InternalError' services "test-route" already exists	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.189] === RUN   TestCreateRouteWithMultipleTargets
I0516 08:10:27.191] {"level":"info","ts":1557994216.7155244,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"test-route\", GenerateName:\"\", Namespace:\"test\", SelfLink:\"/apis/serving/v1alpha1/namespaces/test/Routes/test-route\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{\"route\":\"test-route\"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"test-config\", LatestRevision:(*bool)(0xc00059d25f), Percent:90, URL:(*apis.URL)(nil)}}, v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"test-rev\", ConfigurationName:\"\", LatestRevision:(*bool)(0xc00059d290), Percent:10, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649a2a9e0569, ext:878635656, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649a2a9e2b58, ext:878645367, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649a2a9deaa0, ext:878628811, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.191] {"level":"info","ts":1557994216.717732,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.191] {"level":"info","ts":1557994216.717931,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.192] {"level":"info","ts":1557994216.7241905,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.192] {"level":"info","ts":1557994216.7250314,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service test-route"}
I0516 08:10:27.192] {"level":"info","ts":1557994216.7254827,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.194] E0516 08:10:16.726174   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c4a0647b1", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created placeholder service \"test-route\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2b3b37b1, ext:888937683, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2b3b37b1, ext:888937683, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.194] {"level":"info","ts":1557994216.7280278,"logger":"fallback","caller":"route/route.go:367","msg":"Updating placeholder k8s services with clusterIngress information"}
I0516 08:10:27.194] {"level":"warn","ts":1557994216.7292984,"logger":"fallback","caller":"route/reconcile_resources.go:219","msg":"Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I0516 08:10:27.195] {"level":"info","ts":1557994216.7294903,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.196] E0516 08:10:16.728820   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c4a2d7ab2", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created ClusterIngress \"route-\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2b626ab2, ext:891506652, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2b626ab2, ext:891506652, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.196] --- PASS: TestCreateRouteWithMultipleTargets (0.02s)
I0516 08:10:27.197]     logger.go:130: 2019-05-16T08:10:16.710Z	DEBUG	TestCreateRouteWithMultipleTargets.route-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.197]     logger.go:130: 2019-05-16T08:10:16.711Z	DEBUG	TestCreateRouteWithMultipleTargets.route-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.198]     logger.go:130: 2019-05-16T08:10:16.712Z	INFO	TestCreateRouteWithMultipleTargets.route-controller	route/route.go:141	Setting up event handlers	{"knative.dev/controller": "route-controller"}
... skipping 11 lines ...
I0516 08:10:27.204] {"level":"info","ts":1557994216.7474618,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.204] {"level":"info","ts":1557994216.7485301,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service test-route"}
I0516 08:10:27.206] E0516 08:10:16.749235   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c4b6bf8c5", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created placeholder service \"test-route\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2ca0e8c5, ext:912379372, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2ca0e8c5, ext:912379372, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.206] {"level":"info","ts":1557994216.7500439,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.207] E0516 08:10:16.751771   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c4b901e88", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created ClusterIngress \"route-\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2cc50e88, ext:914748326, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2cc50e88, ext:914748326, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.208] {"level":"info","ts":1557994216.7522817,"logger":"fallback","caller":"route/route.go:367","msg":"Updating placeholder k8s services with clusterIngress information"}
I0516 08:10:27.208] {"level":"warn","ts":1557994216.752481,"logger":"fallback","caller":"route/reconcile_resources.go:219","msg":"Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I0516 08:10:27.209] {"level":"info","ts":1557994216.7526085,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.209] --- PASS: TestCreateRouteWithOneTargetReserve (0.02s)
I0516 08:10:27.209]     logger.go:130: 2019-05-16T08:10:16.732Z	DEBUG	TestCreateRouteWithOneTargetReserve.route-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.210]     logger.go:130: 2019-05-16T08:10:16.733Z	DEBUG	TestCreateRouteWithOneTargetReserve.route-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.210]     logger.go:130: 2019-05-16T08:10:16.734Z	INFO	TestCreateRouteWithOneTargetReserve.route-controller	route/route.go:141	Setting up event handlers	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.210]     logger.go:130: 2019-05-16T08:10:16.734Z	INFO	TestCreateRouteWithOneTargetReserve.route-controller	route/route.go:180	Setting up ConfigMap receivers	{"knative.dev/controller": "route-controller"}
... skipping 12 lines ...
I0516 08:10:27.219] {"level":"info","ts":1557994216.7768579,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service test-route-test-revision-1"}
I0516 08:10:27.220] E0516 08:10:16.777584   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c4d1c67fb", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created placeholder service \"test-route-test-revision-1\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2e5157fb, ext:940719385, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2e5157fb, ext:940719385, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.221] {"level":"info","ts":1557994216.7790446,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service test-route-test-revision-2"}
I0516 08:10:27.222] E0516 08:10:16.780030   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c4d3d1d21", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created placeholder service \"test-route-test-revision-2\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2e720d21, ext:942862909, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2e720d21, ext:942862909, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.223] {"level":"info","ts":1557994216.7794182,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.223] {"level":"info","ts":1557994216.783516,"logger":"fallback","caller":"route/route.go:367","msg":"Updating placeholder k8s services with clusterIngress information"}
I0516 08:10:27.223] {"level":"warn","ts":1557994216.783704,"logger":"fallback","caller":"route/reconcile_resources.go:219","msg":"Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I0516 08:10:27.224] {"level":"info","ts":1557994216.7838566,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.225] E0516 08:10:16.784086   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c4d75d4d1", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created ClusterIngress \"route-\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2eaac4d1, ext:946579962, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a2eaac4d1, ext:946579962, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.225] --- PASS: TestCreateRouteWithDuplicateTargets (0.03s)
I0516 08:10:27.226]     logger.go:130: 2019-05-16T08:10:16.756Z	DEBUG	TestCreateRouteWithDuplicateTargets.route-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.226]     logger.go:130: 2019-05-16T08:10:16.757Z	DEBUG	TestCreateRouteWithDuplicateTargets.route-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.226]     logger.go:130: 2019-05-16T08:10:16.757Z	INFO	TestCreateRouteWithDuplicateTargets.route-controller	route/route.go:141	Setting up event handlers	{"knative.dev/controller": "route-controller"}
... skipping 14 lines ...
I0516 08:10:27.235] E0516 08:10:16.866964   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c526e3234", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created placeholder service \"test-route\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a33a32234, ext:1029965661, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a33a32234, ext:1029965661, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.236] {"level":"info","ts":1557994216.8680336,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service test-route-bar"}
I0516 08:10:27.236] {"level":"info","ts":1557994216.8691082,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service test-route-foo"}
I0516 08:10:27.237] {"level":"info","ts":1557994216.869356,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.239] E0516 08:10:16.870720   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c528c9760", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created placeholder service \"test-route-bar\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a33c18760, ext:1031957629, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a33c18760, ext:1031957629, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.240] {"level":"info","ts":1557994216.871181,"logger":"fallback","caller":"route/route.go:367","msg":"Updating placeholder k8s services with clusterIngress information"}
I0516 08:10:27.241] {"level":"warn","ts":1557994216.871456,"logger":"fallback","caller":"route/reconcile_resources.go:219","msg":"Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I0516 08:10:27.241] {"level":"info","ts":1557994216.8715482,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.244] E0516 08:10:16.871607   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c529a5f63", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created placeholder service \"test-route-foo\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a33cf4f63, ext:1032860853, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a33cf4f63, ext:1032860853, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.247] E0516 08:10:16.873875   22871 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.159f1b7c52b5ae46", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created ClusterIngress \"route-\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a33ea9e46, ext:1034650477, loc:(*time.Location)(0x33deb60)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf2f649a33ea9e46, ext:1034650477, loc:(*time.Location)(0x33deb60)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I0516 08:10:27.248] --- PASS: TestCreateRouteWithNamedTargets (0.07s)
I0516 08:10:27.249]     logger.go:130: 2019-05-16T08:10:16.800Z	DEBUG	TestCreateRouteWithNamedTargets.route-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.250]     logger.go:130: 2019-05-16T08:10:16.802Z	DEBUG	TestCreateRouteWithNamedTargets.route-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "route-controller"}
... skipping 192 lines ...
I0516 08:10:27.443]         logger.go:130: 2019-05-16T08:10:19.491Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap/test-domain.dev.route-controller	controller/controller.go:305	Reconcile succeeded. Time taken: 4.33016ms.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I0516 08:10:27.444] === RUN   TestRouteDomain
I0516 08:10:27.445] --- PASS: TestRouteDomain (0.00s)
I0516 08:10:27.445] === RUN   TestReconcile
I0516 08:10:27.446] === RUN   TestReconcile/bad_workqueue_key
I0516 08:10:27.446] === RUN   TestReconcile/key_not_found
I0516 08:10:27.447] {"level":"error","ts":1557994219.7086816,"logger":"fallback","caller":"route/route.go:215","msg":"route \"foo/not-found\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/route.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/route.go:215\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.448] === RUN   TestReconcile/configuration_not_yet_ready
I0516 08:10:27.451] {"level":"info","ts":1557994219.7582574,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"first-reconcile\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"not-ready\", LatestRevision:(*bool)(0xc0007f08f8), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649aed2cb8c7, ext:3921542110, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649aed2ce31e, ext:3921552958, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649aed2c9cda, ext:3921535021, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.451] === RUN   TestReconcile/configuration_permanently_failed
I0516 08:10:27.454] {"level":"info","ts":1557994219.804568,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"first-reconcile\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"permanently-failed\", LatestRevision:(*bool)(0xc00086aed8), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649aefee4813, ext:3967781685, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649aefee7740, ext:3967793777, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649aefee2249, ext:3967772098, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.455] === RUN   TestReconcile/failure_updating_route_status
I0516 08:10:27.459] {"level":"info","ts":1557994219.875976,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"first-reconcile\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"not-ready\", LatestRevision:(*bool)(0xc00061a958), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649af4309129, ext:4039234624, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649af430baf3, ext:4039245329, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649af4307138, ext:4039226499, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.460] {"level":"warn","ts":1557994219.877225,"logger":"fallback","caller":"route/route.go:232","msg":"Failed to update route status","error":"inducing failure for update routes"}
I0516 08:10:27.460] === RUN   TestReconcile/simple_route_becomes_ready,_ingress_unknown
I0516 08:10:27.464] {"level":"info","ts":1557994219.9296796,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"becomes-ready\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"12-34\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"config\", LatestRevision:(*bool)(0xc00043f368), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649af7654429, ext:4093019950, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649af7656414, ext:4093028121, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649af7652c38, ext:4093013859, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.464] {"level":"info","ts":1557994219.93041,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.465] {"level":"info","ts":1557994219.9305437,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.466] {"level":"info","ts":1557994219.9315407,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.466] {"level":"info","ts":1557994219.9322598,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service becomes-ready"}
I0516 08:10:27.467] {"level":"info","ts":1557994219.9323716,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.468] {"level":"info","ts":1557994219.9332268,"logger":"fallback","caller":"route/route.go:367","msg":"Updating placeholder k8s services with clusterIngress information"}
I0516 08:10:27.468] {"level":"warn","ts":1557994219.9333317,"logger":"fallback","caller":"route/reconcile_resources.go:219","msg":"Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I0516 08:10:27.469] {"level":"info","ts":1557994219.9334524,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.470] === RUN   TestReconcile/custom_ingress_route_becomes_ready,_ingress_unknown
I0516 08:10:27.491] {"level":"info","ts":1557994219.9898555,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"becomes-ready\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"12-34\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string{\"networking.knative.dev/ingress.class\":\"custom-ingress-class\"}, OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"config\", LatestRevision:(*bool)(0xc000514468), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649afaf951c7, ext:4153054435, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649afaf97fcc, ext:4153066218, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649afaf933d7, ext:4153046821, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.491] {"level":"info","ts":1557994219.9907308,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.491] {"level":"info","ts":1557994219.9908597,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.492] {"level":"info","ts":1557994219.991895,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.492] {"level":"info","ts":1557994219.9925358,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service becomes-ready"}
I0516 08:10:27.501] {"level":"info","ts":1557994219.9926493,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.502] {"level":"info","ts":1557994219.993426,"logger":"fallback","caller":"route/route.go:367","msg":"Updating placeholder k8s services with clusterIngress information"}
I0516 08:10:27.502] {"level":"warn","ts":1557994219.9935286,"logger":"fallback","caller":"route/reconcile_resources.go:219","msg":"Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I0516 08:10:27.506] {"level":"info","ts":1557994219.9936004,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.506] === RUN   TestReconcile/cluster_local_route_becomes_ready,_ingress_unknown
I0516 08:10:27.513] {"level":"info","ts":1557994220.044518,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"becomes-ready\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"65-23\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{\"serving.knative.dev/visibility\":\"cluster-local\"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"config\", LatestRevision:(*bool)(0xc0007f1bf8), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b02a2b7b9, ext:4207854783, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b02a2dc4e, ext:4207864166, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b02a2a105, ext:4207848998, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(0xc00081c100), DeprecatedDomain:\"becomes-ready.default.svc.cluster.local\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.515] {"level":"info","ts":1557994220.0452359,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.516] {"level":"info","ts":1557994220.0453653,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.518] {"level":"info","ts":1557994220.046467,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.519] {"level":"info","ts":1557994220.0471208,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service becomes-ready"}
I0516 08:10:27.519] {"level":"info","ts":1557994220.0472264,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.521] {"level":"info","ts":1557994220.0479643,"logger":"fallback","caller":"route/route.go:367","msg":"Updating placeholder k8s services with clusterIngress information"}
I0516 08:10:27.522] {"level":"warn","ts":1557994220.0480504,"logger":"fallback","caller":"route/reconcile_resources.go:219","msg":"Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I0516 08:10:27.523] {"level":"info","ts":1557994220.0481288,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.524] === RUN   TestReconcile/simple_route_becomes_ready
I0516 08:10:27.527] {"level":"info","ts":1557994220.1045313,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"becomes-ready\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"config\", LatestRevision:(*bool)(0xc0008aeea0), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b0635326a, ext:4267786110, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b06354c0f, ext:4267792675, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b06351aaa, ext:4267780051, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.528] {"level":"info","ts":1557994220.1052275,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.529] {"level":"info","ts":1557994220.1053503,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.529] {"level":"info","ts":1557994220.106121,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
... skipping 3 lines ...
I0516 08:10:27.532] {"level":"info","ts":1557994220.107556,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.532] === RUN   TestReconcile/failure_creating_k8s_placeholder_service
I0516 08:10:27.536] {"level":"info","ts":1557994220.1591773,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"create-svc-failure\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string{\"routes.serving.knative.dev\"}, ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"config\", LatestRevision:(*bool)(0xc00086a950), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b0978e441, ext:4322554183, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b09790165, ext:4322561644, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b0978cd74, ext:4322548419, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.537] {"level":"info","ts":1557994220.1598465,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.538] {"level":"info","ts":1557994220.1600113,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.538] {"level":"info","ts":1557994220.160291,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.539] {"level":"error","ts":1557994220.1609142,"logger":"fallback","caller":"route/reconcile_resources.go:182","msg":"Failed to create placeholder service","error":"inducing failure for create services","stacktrace":"github.com/knative/serving/pkg/reconciler/route.(*Reconciler).reconcilePlaceholderServices\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/reconcile_resources.go:182\ngithub.com/knative/serving/pkg/reconciler/route.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/route.go:320\ngithub.com/knative/serving/pkg/reconciler/route.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/route.go:225\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.541] === RUN   TestReconcile/failure_creating_cluster_ingress
I0516 08:10:27.544] {"level":"info","ts":1557994220.2321305,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"ingress-create-failure\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string{\"routes.serving.knative.dev\"}, ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"config\", LatestRevision:(*bool)(0xc000a32470), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b0dd012b0, ext:4395376593, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b0dd03d1f, ext:4395387453, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b0dcfeedb, ext:4395367463, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.546] {"level":"info","ts":1557994220.2331083,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.546] {"level":"info","ts":1557994220.2332728,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.547] {"level":"info","ts":1557994220.2337296,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.548] {"level":"info","ts":1557994220.234646,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service ingress-create-failure"}
I0516 08:10:27.548] {"level":"info","ts":1557994220.2347858,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.549] {"level":"error","ts":1557994220.235746,"logger":"fallback","caller":"route/reconcile_resources.go:96","msg":"Failed to create ClusterIngress","error":"inducing failure for create clusteringresses","stacktrace":"github.com/knative/serving/pkg/reconciler/route.(*Reconciler).reconcileClusterIngress\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/reconcile_resources.go:96\ngithub.com/knative/serving/pkg/reconciler/route.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/route.go:361\ngithub.com/knative/serving/pkg/reconciler/route.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/route.go:225\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.551] === RUN   TestReconcile/steady_state
I0516 08:10:27.553] {"level":"info","ts":1557994220.3198473,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"steady-state\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string{\"routes.serving.knative.dev\"}, ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"config\", LatestRevision:(*bool)(0xc0007f0a11), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649ade96081b, ext:3676785501, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649ade96560d, ext:3676805421, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649ade96d426, ext:3676837697, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(0xc0009cf400), DeprecatedDomain:\"steady-state.default.example.com\", DeprecatedDomainInternal:\"steady-state.default.svc.cluster.local\", Address:(*v1alpha1.Addressable)(0xc00098cd20), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"config-00001\", ConfigurationName:\"\", LatestRevision:(*bool)(0xc0007f0a10), Percent:100, URL:(*apis.URL)(nil)}}}}}}"}
I0516 08:10:27.554] {"level":"info","ts":1557994220.320984,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.554] {"level":"info","ts":1557994220.3212962,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.554] {"level":"info","ts":1557994220.3218687,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.555] {"level":"info","ts":1557994220.3228102,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
... skipping 31 lines ...
I0516 08:10:27.600] === RUN   TestReconcile/failure_updating_cluster_ingress
I0516 08:10:27.604] {"level":"info","ts":1557994220.7164793,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"update-ci-failure\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string{\"routes.serving.knative.dev\"}, ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"config\", LatestRevision:(*bool)(0xc0000b7550), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649adfc4c416, ext:3696625452, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649adfc553c3, ext:3696662239, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649adfc594a4, ext:3696678847, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(0xc00089e380), DeprecatedDomain:\"update-ci-failure.default.example.com\", DeprecatedDomainInternal:\"update-ci-failure.default.svc.cluster.local\", Address:(*v1alpha1.Addressable)(0xc000ce3e40), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"config-00001\", ConfigurationName:\"\", LatestRevision:(*bool)(nil), Percent:100, URL:(*apis.URL)(nil)}}}}}}"}
I0516 08:10:27.605] {"level":"info","ts":1557994220.717298,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.616] {"level":"info","ts":1557994220.7174654,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.617] {"level":"info","ts":1557994220.717856,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.617] {"level":"info","ts":1557994220.7185526,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.620] {"level":"error","ts":1557994220.7193027,"logger":"fallback","caller":"route/reconcile_resources.go:119","msg":"Failed to update ClusterIngress","error":"inducing failure for update clusteringresses","stacktrace":"github.com/knative/serving/pkg/reconciler/route.(*Reconciler).reconcileClusterIngress\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/reconcile_resources.go:119\ngithub.com/knative/serving/pkg/reconciler/route.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/route.go:361\ngithub.com/knative/serving/pkg/reconciler/route.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/route/route.go:225\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:27.620] === RUN   TestReconcile/reconcile_service_mutation
I0516 08:10:27.623] {"level":"info","ts":1557994220.7909732,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"svc-mutation\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string{\"routes.serving.knative.dev\"}, ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"config\", LatestRevision:(*bool)(0xc000ac2411), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649adfe6c8fa, ext:3698854934, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649adfe74ec3, ext:3698889181, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649adfe78d4c, ext:3698905196, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(0xc000bc0980), DeprecatedDomain:\"svc-mutation.default.example.com\", DeprecatedDomainInternal:\"svc-mutation.default.svc.cluster.local\", Address:(*v1alpha1.Addressable)(0xc000ac7640), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"config-00001\", ConfigurationName:\"\", LatestRevision:(*bool)(0xc000ac2410), Percent:100, URL:(*apis.URL)(nil)}}}}}}"}
I0516 08:10:27.623] {"level":"info","ts":1557994220.7919633,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.623] {"level":"info","ts":1557994220.792118,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.624] {"level":"info","ts":1557994220.7924273,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.624] {"level":"info","ts":1557994220.793019,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
... skipping 57 lines ...
I0516 08:10:27.654] {"level":"info","ts":1557994221.524197,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.655] {"level":"info","ts":1557994221.524359,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.655] {"level":"info","ts":1557994221.524891,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.655] {"level":"info","ts":1557994221.5258238,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service named-traffic-split"}
I0516 08:10:27.655] {"level":"info","ts":1557994221.5259593,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.656] {"level":"info","ts":1557994221.5272903,"logger":"fallback","caller":"route/route.go:367","msg":"Updating placeholder k8s services with clusterIngress information"}
I0516 08:10:27.656] {"level":"warn","ts":1557994221.5274093,"logger":"fallback","caller":"route/reconcile_resources.go:219","msg":"Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I0516 08:10:27.656] {"level":"info","ts":1557994221.5274997,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.656] === RUN   TestReconcile/same_revision_targets
I0516 08:10:27.658] {"level":"info","ts":1557994221.649115,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"same-revision-targets\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"1-2\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string{\"routes.serving.knative.dev\"}, ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"gray\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"gray\", LatestRevision:(*bool)(0xc00046edc0), Percent:50, URL:(*apis.URL)(nil)}}, v1alpha1.TrafficTarget{DeprecatedName:\"also-gray\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"gray-00001\", ConfigurationName:\"\", LatestRevision:(*bool)(0xc00046edc1), Percent:50, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b66a92dea, ext:5812258082, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b66a9a7ab, ext:5812289225, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649b66a908cd, ext:5812248605, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.659] {"level":"info","ts":1557994221.6502597,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.659] {"level":"info","ts":1557994221.6511216,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.659] {"level":"info","ts":1557994221.6521506,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.659] {"level":"info","ts":1557994221.6530063,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service same-revision-targets"}
I0516 08:10:27.660] {"level":"info","ts":1557994221.6536467,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service same-revision-targets-also-gray"}
I0516 08:10:27.660] {"level":"info","ts":1557994221.6542542,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service same-revision-targets-gray"}
I0516 08:10:27.660] {"level":"info","ts":1557994221.654372,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.661] {"level":"info","ts":1557994221.656552,"logger":"fallback","caller":"route/route.go:367","msg":"Updating placeholder k8s services with clusterIngress information"}
I0516 08:10:27.661] {"level":"warn","ts":1557994221.6567156,"logger":"fallback","caller":"route/reconcile_resources.go:219","msg":"Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I0516 08:10:27.661] {"level":"info","ts":1557994221.656807,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.661] === RUN   TestReconcile/change_route_configuration
I0516 08:10:27.663] {"level":"info","ts":1557994221.7915316,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"switch-configs\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string{\"routes.serving.knative.dev\"}, ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"green\", LatestRevision:(*bool)(0xc000c0af40), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649ae122d9fd, ext:3719568661, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649ae1232262, ext:3719587197, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649ae1235169, ext:3719599234, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(0xc000aab580), DeprecatedDomain:\"switch-configs.default.example.com\", DeprecatedDomainInternal:\"switch-configs.default.svc.cluster.local\", Address:(*v1alpha1.Addressable)(0xc000c025c0), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"blue\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"blue-00001\", ConfigurationName:\"\", LatestRevision:(*bool)(nil), Percent:100, URL:(*apis.URL)(nil)}}}}}}"}
I0516 08:10:27.664] {"level":"info","ts":1557994221.7927878,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.664] {"level":"info","ts":1557994221.7929583,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.664] {"level":"info","ts":1557994221.7933068,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
... skipping 35 lines ...
I0516 08:10:27.683] {"level":"info","ts":1557994222.6853924,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"my-route\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string{\"routes.serving.knative.dev\"}, ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"config\", LatestRevision:(*bool)(0xc000594ad1), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649ae21bfb1d, ext:3735895596, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649ae21c42f8, ext:3735914031, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"True\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649ae21c813e, ext:3735929970, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(0xc00045d600), DeprecatedDomain:\"my-route.default.example.com\", DeprecatedDomainInternal:\"my-route.default.svc.cluster.local\", Address:(*v1alpha1.Addressable)(0xc000b67620), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"config-00001\", ConfigurationName:\"\", LatestRevision:(*bool)(0xc000594ad0), Percent:100, URL:(*apis.URL)(nil)}}}}}}"}
I0516 08:10:27.683] {"level":"info","ts":1557994222.6884694,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.684] {"level":"info","ts":1557994222.6894605,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.684] {"level":"info","ts":1557994222.6898909,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.684] --- PASS: TestReconcile (3.24s)
I0516 08:10:27.684]     --- PASS: TestReconcile/bad_workqueue_key (0.07s)
I0516 08:10:27.685]         logger.go:130: 2019-05-16T08:10:19.648Z	ERROR	TestReconcile/bad_workqueue_key.route-controller	route/route.go:204	invalid resource key: too/many/parts	{"knative.dev/controller": "route-controller"}
I0516 08:10:27.685]     --- PASS: TestReconcile/key_not_found (0.06s)
I0516 08:10:27.685]     --- PASS: TestReconcile/configuration_not_yet_ready (0.06s)
I0516 08:10:27.685]     --- PASS: TestReconcile/configuration_permanently_failed (0.03s)
I0516 08:10:27.686]     --- PASS: TestReconcile/failure_updating_route_status (0.05s)
I0516 08:10:27.686]     --- PASS: TestReconcile/simple_route_becomes_ready,_ingress_unknown (0.05s)
I0516 08:10:27.686]     --- PASS: TestReconcile/custom_ingress_route_becomes_ready,_ingress_unknown (0.05s)
... skipping 25 lines ...
I0516 08:10:27.692]     --- PASS: TestReconcile/check_that_we_can_find_the_cluster_ingress_with_old_naming (0.08s)
I0516 08:10:27.692]     --- PASS: TestReconcile/check_that_we_do_nothing_with_a_deletion_timestamp_and_no_finalizers (0.13s)
I0516 08:10:27.693]     --- PASS: TestReconcile/check_that_we_do_nothing_with_a_deletion_timestamp_and_another_finalizer_first (0.07s)
I0516 08:10:27.694]     --- PASS: TestReconcile/check_that_we_do_nothing_with_a_deletion_timestamp_and_route_finalizer_first (0.08s)
I0516 08:10:27.694]     --- PASS: TestReconcile/deletes_service_when_route_no_longer_references_service (0.04s)
I0516 08:10:27.694]     --- PASS: TestReconcile/deletes_service_fails (0.09s)
I0516 08:10:27.694]         logger.go:130: 2019-05-16T08:10:22.690Z	ERROR	TestReconcile/deletes_service_fails.route-controller	route/reconcile_resources.go:132	Failed to delete service	{"knative.dev/controller": "route-controller", "error": "inducing failure for delete services"}
I0516 08:10:27.696] === RUN   TestReconcile_EnableAutoTLS
I0516 08:10:27.697] === RUN   TestReconcile_EnableAutoTLS/check_that_Certificate_and_ClusterIngressTLS_are_correctly_configured_when_creating_a_Route
I0516 08:10:27.701] {"level":"info","ts":1557994222.8225484,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"becomes-ready\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"12-34\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"config\", LatestRevision:(*bool)(0xc000bd5d98), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649bb0ffd33c, ext:6985708641, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649bb0fffee2, ext:6985719800, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649bb0ffa5bc, ext:6985697061, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.701] {"level":"info","ts":1557994222.823692,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.702] {"level":"info","ts":1557994222.8238974,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.703] {"level":"info","ts":1557994222.8253522,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.703] {"level":"info","ts":1557994222.8264854,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service becomes-ready"}
I0516 08:10:27.704] {"level":"info","ts":1557994222.827827,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.705] {"level":"info","ts":1557994222.8290849,"logger":"fallback","caller":"route/route.go:367","msg":"Updating placeholder k8s services with clusterIngress information"}
I0516 08:10:27.705] {"level":"warn","ts":1557994222.8292613,"logger":"fallback","caller":"route/reconcile_resources.go:219","msg":"Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I0516 08:10:27.706] {"level":"info","ts":1557994222.8294055,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.707] === RUN   TestReconcile_EnableAutoTLS/check_that_Certificate_and_ClusterIngressTLS_are_correctly_updated_when_updating_a_Route
I0516 08:10:27.710] {"level":"info","ts":1557994222.937049,"logger":"fallback","caller":"route/route.go:274","msg":"Reconciling route: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"becomes-ready\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"12-34\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{DeprecatedGeneration:0, Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{DeprecatedName:\"\", TrafficTarget:v1beta1.TrafficTarget{Tag:\"\", RevisionName:\"\", ConfigurationName:\"config\", LatestRevision:(*bool)(0xc0007ded48), Percent:100, URL:(*apis.URL)(nil)}}}}, Status:v1alpha1.RouteStatus{Status:v1beta1.Status{ObservedGeneration:0, Conditions:v1beta1.Conditions{apis.Condition{Type:\"AllTrafficAssigned\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649bb7d498af, ext:7100316104, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"IngressReady\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649bb7d4c440, ext:7100327265, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}, apis.Condition{Type:\"Ready\", Status:\"Unknown\", Severity:\"\", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbf2f649bb7d47798, ext:7100307677, loc:(*time.Location)(0x33deb60)}}}, Reason:\"\", Message:\"\"}}}, RouteStatusFields:v1alpha1.RouteStatusFields{URL:(*apis.URL)(nil), DeprecatedDomain:\"\", DeprecatedDomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil)}}}"}
I0516 08:10:27.720] {"level":"info","ts":1557994222.938244,"logger":"fallback","caller":"route/route.go:441","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I0516 08:10:27.721] {"level":"info","ts":1557994222.93847,"logger":"fallback","caller":"route/route.go:296","msg":"Updating targeted revisions."}
I0516 08:10:27.722] {"level":"info","ts":1557994222.9398224,"logger":"fallback","caller":"route/route.go:319","msg":"Creating placeholder k8s services"}
I0516 08:10:27.723] {"level":"info","ts":1557994222.9409487,"logger":"fallback","caller":"route/reconcile_resources.go:187","msg":"Created service becomes-ready"}
I0516 08:10:27.724] {"level":"info","ts":1557994222.9421988,"logger":"fallback","caller":"route/route.go:356","msg":"Creating ClusterIngress."}
I0516 08:10:27.725] {"level":"info","ts":1557994222.9434905,"logger":"fallback","caller":"route/route.go:367","msg":"Updating placeholder k8s services with clusterIngress information"}
I0516 08:10:27.725] {"level":"warn","ts":1557994222.943691,"logger":"fallback","caller":"route/reconcile_resources.go:219","msg":"Failed to update k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I0516 08:10:27.726] {"level":"info","ts":1557994222.943829,"logger":"fallback","caller":"route/route.go:373","msg":"Route successfully synced"}
I0516 08:10:27.727] --- PASS: TestReconcile_EnableAutoTLS (0.29s)
I0516 08:10:27.727]     --- PASS: TestReconcile_EnableAutoTLS/check_that_Certificate_and_ClusterIngressTLS_are_correctly_configured_when_creating_a_Route (0.11s)
I0516 08:10:27.728]     --- PASS: TestReconcile_EnableAutoTLS/check_that_Certificate_and_ClusterIngressTLS_are_correctly_updated_when_updating_a_Route (0.11s)
I0516 08:10:27.728] PASS
I0516 08:10:27.732] ok  	github.com/knative/serving/pkg/reconciler/route	8.251s
... skipping 263 lines ...
I0516 08:10:37.305] --- PASS: TestNewController (0.00s)
I0516 08:10:37.306]     logger.go:130: 2019-05-16T08:10:30.842Z	DEBUG	TestNewController.serverlessservice-controller	reconciler/reconciler.go:138	Creating event broadcaster	{"knative.dev/controller": "serverlessservice-controller"}
I0516 08:10:37.306]     logger.go:130: 2019-05-16T08:10:30.843Z	DEBUG	TestNewController.serverlessservice-controller	reconciler/reconciler.go:157	Creating stats reporter	{"knative.dev/controller": "serverlessservice-controller"}
I0516 08:10:37.307]     logger.go:130: 2019-05-16T08:10:30.843Z	INFO	TestNewController.serverlessservice-controller	serverlessservice/serverlessservice.go:104	Setting up event handlers	{"knative.dev/controller": "serverlessservice-controller"}
I0516 08:10:37.307] === RUN   TestReconcile
I0516 08:10:37.307] === RUN   TestReconcile/bad_workqueue_key,_Part_I
I0516 08:10:37.308] {"level":"error","ts":1557994230.882876,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:148","msg":"Invalid resource key: too/many/parts","stacktrace":"github.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:148\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:37.308] === RUN   TestReconcile/bad_workqueue_key,_Part_II
I0516 08:10:37.309] {"level":"error","ts":1557994230.9680011,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:157","msg":"SKS resource \"too-few-parts\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:157\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:37.309] === RUN   TestReconcile/key_not_found
I0516 08:10:37.310] {"level":"error","ts":1557994231.0552466,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:157","msg":"SKS resource \"foo/not-found\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:157\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:37.310] === RUN   TestReconcile/steady_state
I0516 08:10:37.311] === RUN   TestReconcile/steady_switch_to_proxy_mode
I0516 08:10:37.311] {"level":"info","ts":1557994231.4199853,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:331","msg":"Public K8s Endpoints changed; reconciling: to-proxy"}
I0516 08:10:37.311] {"level":"info","ts":1557994231.4202461,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:340","msg":"Endpoints to-proxy has no ready endpoints"}
I0516 08:10:37.311] === RUN   TestReconcile/user_changes_public_svc
I0516 08:10:37.312] {"level":"info","ts":1557994231.6462562,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:249","msg":"Public K8s Service changed; reconciling: svc-change  v1.ServiceSpec{\n  \tPorts:     []v1.ServicePort{{Name: \"http\", Protocol: \"TCP\", Port: 80, TargetPort: intstr.IntOrString{IntVal: 8012}}},\n- \tSelector:  nil,\n+ \tSelector:  map[string]string{\"pod-x\": \"a-1557994230846055009\"},\n  \tClusterIP: \"\",\n  \tType:      \"\",\n  \t... // 9 identical fields\n  }\n"}
... skipping 5 lines ...
I0516 08:10:37.313] {"level":"info","ts":1557994232.3941636,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:358","msg":"K8s service cde-priv does not exist; creating."}
I0516 08:10:37.314] {"level":"info","ts":1557994232.394608,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:366","msg":"Created K8s service: cde-priv"}
I0516 08:10:37.314] {"level":"info","ts":1557994232.3948107,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:226","msg":"K8s service cde does not exist; creating."}
I0516 08:10:37.314] {"level":"info","ts":1557994232.3950286,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:235","msg":"Created K8s service: cde"}
I0516 08:10:37.315] {"level":"info","ts":1557994232.3955166,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:312","msg":"K8s endpoints \"cde\" does not exist; creating."}
I0516 08:10:37.315] {"level":"info","ts":1557994232.3959026,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:319","msg":"Created K8s Endpoints: cde"}
I0516 08:10:37.315] === RUN   TestReconcile/update-eps-fail
I0516 08:10:37.316] {"level":"info","ts":1557994232.6349306,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:331","msg":"Public K8s Endpoints changed; reconciling: failA"}
I0516 08:10:37.317] {"level":"error","ts":1557994232.6351225,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:333","msg":"Error updating public K8s Endpoints:failA","error":"inducing failure for update endpoints","stacktrace":"github.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).reconcilePublicEndpoints\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:333\ngithub.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:197\ngithub.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:165\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:37.317] === RUN   TestReconcile/svc-fail-pub
I0516 08:10:37.318] {"level":"info","ts":1557994232.8457327,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:226","msg":"K8s service fail2 does not exist; creating."}
I0516 08:10:37.319] {"level":"error","ts":1557994232.8460424,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:232","msg":"Error creating K8s Service:fail2","error":"inducing failure for create services","stacktrace":"github.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).reconcilePublicService\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:232\ngithub.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:197\ngithub.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:165\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:37.319] === RUN   TestReconcile/eps_create_fail_pub
I0516 08:10:37.319] {"level":"info","ts":1557994233.0325437,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:226","msg":"K8s service fail3 does not exist; creating."}
I0516 08:10:37.320] {"level":"info","ts":1557994233.032914,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:235","msg":"Created K8s service: fail3"}
I0516 08:10:37.320] {"level":"info","ts":1557994233.0334263,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:312","msg":"K8s endpoints \"fail3\" does not exist; creating."}
I0516 08:10:37.321] {"level":"error","ts":1557994233.0336788,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:316","msg":"Error creating K8s Endpoints:fail3","error":"inducing failure for create endpoints","stacktrace":"github.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).reconcilePublicEndpoints\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:316\ngithub.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:197\ngithub.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:165\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:37.322] === RUN   TestReconcile/OnCreate-no-eps
I0516 08:10:37.322] {"level":"info","ts":1557994233.2680361,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:358","msg":"K8s service cneps-priv does not exist; creating."}
I0516 08:10:37.322] {"level":"info","ts":1557994233.26842,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:366","msg":"Created K8s service: cneps-priv"}
I0516 08:10:37.323] {"level":"info","ts":1557994233.2686462,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:226","msg":"K8s service cneps does not exist; creating."}
I0516 08:10:37.323] {"level":"info","ts":1557994233.2688735,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:235","msg":"Created K8s service: cneps"}
I0516 08:10:37.323] {"level":"info","ts":1557994233.269317,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:299","msg":"cneps-priv is in mode Serve but has no endpoints, using Activator endpoints for now"}
... skipping 10 lines ...
I0516 08:10:37.327] {"level":"info","ts":1557994233.7087386,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:366","msg":"Created K8s service: cnaeps-priv"}
I0516 08:10:37.327] {"level":"info","ts":1557994233.7089345,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:226","msg":"K8s service cnaeps does not exist; creating."}
I0516 08:10:37.328] {"level":"info","ts":1557994233.709138,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:235","msg":"Created K8s service: cnaeps"}
I0516 08:10:37.328] {"level":"info","ts":1557994233.7094276,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:312","msg":"K8s endpoints \"cnaeps\" does not exist; creating."}
I0516 08:10:37.328] {"level":"info","ts":1557994233.709683,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:319","msg":"Created K8s Endpoints: cnaeps"}
I0516 08:10:37.329] {"level":"info","ts":1557994233.7097824,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:340","msg":"Endpoints cnaeps has no ready endpoints"}
I0516 08:10:37.329] === RUN   TestReconcile/svc-fail-priv
I0516 08:10:37.329] {"level":"info","ts":1557994233.9822214,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:358","msg":"K8s service fail-priv does not exist; creating."}
I0516 08:10:37.331] {"level":"error","ts":1557994233.9825556,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:363","msg":"Error creating K8s Service:fail-priv","error":"inducing failure for create services","stacktrace":"github.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).reconcilePrivateService\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:363\ngithub.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:197\ngithub.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:165\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:37.331] === RUN   TestReconcile/update-sks-fail
I0516 08:10:37.331] === RUN   TestReconcile/ronin-priv-service/fail5
I0516 08:10:37.331] === RUN   TestReconcile/ronin-pub-service/fail6
I0516 08:10:37.332] === RUN   TestReconcile/ronin-pub-eps/fail7
I0516 08:10:37.332] === RUN   TestReconcile/update-svc-fail-priv
I0516 08:10:37.332] {"level":"info","ts":1557994235.1320503,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:382","msg":"Private K8s Service changed; reconciling: fail9-priv"}
I0516 08:10:37.333] {"level":"error","ts":1557994235.132353,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:384","msg":"Error updating private K8s Service:fail9-priv","error":"inducing failure for update services","stacktrace":"github.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).reconcilePrivateService\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:384\ngithub.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:197\ngithub.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:165\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:37.334] === RUN   TestReconcile/update-svc-fail-pub
I0516 08:10:37.334] {"level":"info","ts":1557994235.3734875,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:249","msg":"Public K8s Service changed; reconciling: fail8  v1.ServiceSpec{\n  \tPorts:     []v1.ServicePort{{Name: \"http\", Protocol: \"TCP\", Port: 80, TargetPort: intstr.IntOrString{IntVal: 8012}}},\n- \tSelector:  nil,\n+ \tSelector:  map[string]string{\"pod-x\": \"a-1557994230848602672\"},\n  \tClusterIP: \"\",\n  \tType:      \"\",\n  \t... // 9 identical fields\n  }\n"}
I0516 08:10:37.335] {"level":"error","ts":1557994235.3737464,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:251","msg":"Error updating public K8s Service:fail8","error":"inducing failure for update services","stacktrace":"github.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).reconcilePublicService\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:251\ngithub.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:197\ngithub.com/knative/serving/pkg/reconciler/serverlessservice.(*reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/serverlessservice/serverlessservice.go:165\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:37.336] === RUN   TestReconcile/pod_change
I0516 08:10:37.336] {"level":"info","ts":1557994235.5872672,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:331","msg":"Public K8s Endpoints changed; reconciling: change"}
I0516 08:10:37.336] === RUN   TestReconcile/proxy_mode;_pod_change_-_activator
I0516 08:10:37.337] {"level":"info","ts":1557994235.8063045,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:331","msg":"Public K8s Endpoints changed; reconciling: change"}
I0516 08:10:37.337] {"level":"info","ts":1557994235.8065705,"logger":"fallback","caller":"serverlessservice/serverlessservice.go:340","msg":"Endpoints change has no ready endpoints"}
I0516 08:10:37.337] === RUN   TestReconcile/serving_mode;_serving_pod_comes_online
... skipping 42 lines ...
I0516 08:10:37.347]               	PrivateServiceName: "to-proxy-priv",
I0516 08:10:37.347]               }
I0516 08:10:37.347]             	{"knative.dev/controller": "serverlessservice-controller"}
I0516 08:10:37.347]     --- PASS: TestReconcile/user_changes_public_svc (0.18s)
I0516 08:10:37.347]     --- PASS: TestReconcile/user_changes_priv_svc (0.20s)
I0516 08:10:37.348]     --- PASS: TestReconcile/OnCreate-deployment-does-not-exist (0.27s)
I0516 08:10:37.348]         logger.go:130: 2019-05-16T08:10:32.207Z	ERROR	TestReconcile/OnCreate-deployment-does-not-exist.serverlessservice-controller	serverlessservice/serverlessservice.go:416	Error fetching Pod Scalable "blah" for SKS "cde": deployments.apps "blah" not found	{"knative.dev/controller": "serverlessservice-controller"}
I0516 08:10:37.348]     --- PASS: TestReconcile/OnCreate-deployment-exists (0.20s)
I0516 08:10:37.348]         logger.go:130: 2019-05-16T08:10:32.396Z	DEBUG	TestReconcile/OnCreate-deployment-exists.serverlessservice-controller	serverlessservice/serverlessservice.go:214	StatusDiff:   v1alpha1.ServerlessServiceStatus{
I0516 08:10:37.349]               	Status: v1beta1.Status{
I0516 08:10:37.349]               		ObservedGeneration: 0,
I0516 08:10:37.349]             - 		Conditions:         nil,
I0516 08:10:37.349]             + 		Conditions: v1beta1.Conditions{
... skipping 12 lines ...
I0516 08:10:37.352]             - 	ServiceName:        "",
I0516 08:10:37.353]             + 	ServiceName:        "cde",
I0516 08:10:37.353]             - 	PrivateServiceName: "",
I0516 08:10:37.353]             + 	PrivateServiceName: "cde-priv",
I0516 08:10:37.353]               }
I0516 08:10:37.354]             	{"knative.dev/controller": "serverlessservice-controller"}
I0516 08:10:37.354]     --- PASS: TestReconcile/update-eps-fail (0.19s)
I0516 08:10:37.354]     --- PASS: TestReconcile/svc-fail-pub (0.18s)
I0516 08:10:37.354]     --- PASS: TestReconcile/eps_create_fail_pub (0.18s)
I0516 08:10:37.354]     --- PASS: TestReconcile/OnCreate-no-eps (0.22s)
I0516 08:10:37.355]         logger.go:130: 2019-05-16T08:10:33.270Z	DEBUG	TestReconcile/OnCreate-no-eps.serverlessservice-controller	serverlessservice/serverlessservice.go:214	StatusDiff:   v1alpha1.ServerlessServiceStatus{
I0516 08:10:37.355]               	Status: v1beta1.Status{
I0516 08:10:37.355]               		ObservedGeneration: 0,
I0516 08:10:37.355]             - 		Conditions:         nil,
... skipping 69 lines ...
I0516 08:10:37.373]             - 	ServiceName:        "",
I0516 08:10:37.373]             + 	ServiceName:        "cnaeps",
I0516 08:10:37.373]             - 	PrivateServiceName: "",
I0516 08:10:37.373]             + 	PrivateServiceName: "cnaeps-priv",
I0516 08:10:37.373]               }
I0516 08:10:37.374]             	{"knative.dev/controller": "serverlessservice-controller"}
I0516 08:10:37.374]     --- PASS: TestReconcile/svc-fail-priv (0.22s)
I0516 08:10:37.374]     --- PASS: TestReconcile/update-sks-fail (0.29s)
I0516 08:10:37.374]         logger.go:130: 2019-05-16T08:10:34.281Z	DEBUG	TestReconcile/update-sks-fail.serverlessservice-controller	serverlessservice/serverlessservice.go:214	StatusDiff:   v1alpha1.ServerlessServiceStatus{
I0516 08:10:37.374]               	Status: v1beta1.Status{
I0516 08:10:37.375]               		ObservedGeneration: 0,
I0516 08:10:37.375]             - 		Conditions:         nil,
I0516 08:10:37.375]             + 		Conditions: v1beta1.Conditions{
I0516 08:10:37.375]             + 			{
I0516 08:10:37.375]             + 				Type:               "EndpointsPopulated",
... skipping 11 lines ...
I0516 08:10:37.377]               	PrivateServiceName: "fail4-priv",
I0516 08:10:37.377]               }
I0516 08:10:37.377]             	{"knative.dev/controller": "serverlessservice-controller"}
I0516 08:10:37.378]     --- PASS: TestReconcile/ronin-priv-service/fail5 (0.14s)
I0516 08:10:37.378]     --- PASS: TestReconcile/ronin-pub-service/fail6 (0.17s)
I0516 08:10:37.378]     --- PASS: TestReconcile/ronin-pub-eps/fail7 (0.18s)
I0516 08:10:37.378]     --- PASS: TestReconcile/update-svc-fail-priv (0.26s)
I0516 08:10:37.378]     --- PASS: TestReconcile/update-svc-fail-pub (0.22s)
I0516 08:10:37.378]     --- PASS: TestReconcile/pod_change (0.19s)
I0516 08:10:37.379]     --- PASS: TestReconcile/proxy_mode;_pod_change_-_activator (0.18s)
I0516 08:10:37.379]     --- PASS: TestReconcile/serving_mode;_serving_pod_comes_online (0.15s)
I0516 08:10:37.379]         logger.go:130: 2019-05-16T08:10:35.972Z	DEBUG	TestReconcile/serving_mode;_serving_pod_comes_online.serverlessservice-controller	serverlessservice/serverlessservice.go:214	StatusDiff:   v1alpha1.ServerlessServiceStatus{
I0516 08:10:37.379]               	Status: v1beta1.Status{
I0516 08:10:37.379]               		ObservedGeneration: 0,
... skipping 95 lines ...
I0516 08:10:37.398] --- PASS: TestServiceNames (0.00s)
I0516 08:10:37.398] PASS
I0516 08:10:37.398] ok  	github.com/knative/serving/pkg/reconciler/serverlessservice/resources/names	1.030s
I0516 08:10:40.052] === RUN   TestReconcile
I0516 08:10:40.053] === RUN   TestReconcile/bad_workqueue_key
I0516 08:10:40.053] === RUN   TestReconcile/key_not_found
I0516 08:10:40.054] {"level":"error","ts":1557994236.2453876,"logger":"fallback","caller":"service/service.go:119","msg":"service \"foo/not-found\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:119\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:40.054] === RUN   TestReconcile/nop_deletion_reconcile
I0516 08:10:40.054] === RUN   TestReconcile/inline_-_create_route_and_service
I0516 08:10:40.055] === RUN   TestReconcile/runLatest_-_create_route_and_service
I0516 08:10:40.055] === RUN   TestReconcile/pinned_-_create_route_and_service
I0516 08:10:40.055] === RUN   TestReconcile/pinned_-_create_route_and_service_-_via_release
I0516 08:10:40.055] === RUN   TestReconcile/pinned_-_with_ready_config_and_route
... skipping 19 lines ...
I0516 08:10:40.063] {"level":"info","ts":1557994237.793987,"logger":"fallback","caller":"service/service.go:408","msg":"Reconciling route diff (-desired, +observed): "}
I0516 08:10:40.063] === RUN   TestReconcile/runLatest_-_update_route_config_labels_ignoring_serving.knative.dev/route
I0516 08:10:40.063] {"level":"info","ts":1557994237.869503,"logger":"fallback","caller":"service/service.go:361","msg":"Reconciling configuration diff (-desired, +observed): "}
I0516 08:10:40.064] {"level":"info","ts":1557994237.8705783,"logger":"fallback","caller":"service/service.go:408","msg":"Reconciling route diff (-desired, +observed): "}
I0516 08:10:40.064] === RUN   TestReconcile/runLatest_-_bad_config_update
I0516 08:10:40.065] {"level":"info","ts":1557994237.9492354,"logger":"fallback","caller":"service/service.go:361","msg":"Reconciling configuration diff (-desired, +observed):   v1alpha1.ConfigurationSpec{\n  \tDeprecatedGeneration: 0,\n  \tDeprecatedBuild:      nil,\n  \tDeprecatedRevisionTemplate: &v1alpha1.RevisionTemplateSpec{\n  \t\tObjectMeta: v1.ObjectMeta{},\n  \t\tSpec: v1alpha1.RevisionSpec{\n  \t\t\t... // 4 identical fields\n  \t\t\tDeprecatedBuildName: \"\",\n  \t\t\tDeprecatedBuildRef:  nil,\n  \t\t\tDeprecatedContainer: &v1.Container{\n  \t\t\t\tName:    \"\",\n- \t\t\t\tImage:   \"#\",\n+ \t\t\t\tImage:   \"busybox\",\n  \t\t\t\tCommand: nil,\n  \t\t\t\tArgs:    nil,\n  \t\t\t\t... // 17 identical fields\n  \t\t\t},\n  \t\t},\n  \t},\n  \tTemplate: nil,\n  }\n"}
I0516 08:10:40.068] {"level":"error","ts":1557994237.95007,"logger":"fallback","caller":"service/service.go:212","msg":"Failed to reconcile Service: \"bad-config-update\" failed to reconcile Configuration: \"bad-config-update\"","error":"Failed to parse image reference: spec.revisionTemplate.spec.container.image\nimage: \"#\", error: could not parse reference","stacktrace":"github.com/knative/serving/pkg/reconciler/service.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:212\ngithub.com/knative/serving/pkg/reconciler/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:150\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:40.069] === RUN   TestReconcile/runLatest_-_route_creation_failure
I0516 08:10:40.071] {"level":"error","ts":1557994238.006625,"logger":"fallback","caller":"service/service.go:236","msg":"Failed to create Route \"create-route-failure\": inducing failure for create routes","stacktrace":"github.com/knative/serving/pkg/reconciler/service.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:236\ngithub.com/knative/serving/pkg/reconciler/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:150\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:40.071] === RUN   TestReconcile/runLatest_-_configuration_creation_failure
I0516 08:10:40.072] {"level":"error","ts":1557994238.1030433,"logger":"fallback","caller":"service/service.go:197","msg":"Failed to create Configuration \"create-config-failure\": inducing failure for create configurations","stacktrace":"github.com/knative/serving/pkg/reconciler/service.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:197\ngithub.com/knative/serving/pkg/reconciler/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:150\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:40.073] === RUN   TestReconcile/runLatest_-_update_route_failure
I0516 08:10:40.074] {"level":"info","ts":1557994238.1762059,"logger":"fallback","caller":"service/service.go:408","msg":"Reconciling route diff (-desired, +observed):   v1alpha1.RouteSpec{\n  \tDeprecatedGeneration: 0,\n- \tTraffic: []v1alpha1.TrafficTarget{\n- \t\t{\n- \t\t\tTrafficTarget: v1beta1.TrafficTarget{ConfigurationName: \"update-route-failure\", Percent: 100},\n- \t\t},\n- \t},\n+ \tTraffic: nil,\n  }\n"}
I0516 08:10:40.076] {"level":"error","ts":1557994238.1767511,"logger":"fallback","caller":"service/service.go:249","msg":"Failed to reconcile Service: \"update-route-failure\" failed to reconcile Route: \"update-route-failure\"","stacktrace":"github.com/knative/serving/pkg/reconciler/service.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:249\ngithub.com/knative/serving/pkg/reconciler/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:150\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:40.076] === RUN   TestReconcile/runLatest_-_update_config_failure
I0516 08:10:40.079] {"level":"info","ts":1557994238.2482038,"logger":"fallback","caller":"service/service.go:361","msg":"Reconciling configuration diff (-desired, +observed):   v1alpha1.ConfigurationSpec{\n  \tDeprecatedGeneration: 0,\n- \tDeprecatedBuild:      nil,\n+ \tDeprecatedBuild: &v1alpha1.RawExtension{\n+ \t\tObject: &unstructured.Unstructured{\n+ \t\t\tObject: map[string]interface{}{\n+ \t\t\t\t\"apiVersion\": string(\"testing.build.knative.dev/v1alpha1\"),\n+ \t\t\t\t\"kind\":       string(\"Build\"),\n+ \t\t\t\t\"spec\": map[string]interface{}{\n+ \t\t\t\t\t\"steps\": []interface{}{\n+ \t\t\t\t\t\tmap[string]interface{}{\"image\": string(\"foo\")},\n+ \t\t\t\t\t\tmap[string]interface{}{\"image\": string(\"bar\")},\n+ \t\t\t\t\t},\n+ \t\t\t\t},\n+ \t\t\t},\n+ \t\t},\n+ \t},\n  \tDeprecatedRevisionTemplate: &v1alpha1.RevisionTemplateSpec{Spec: v1alpha1.RevisionSpec{RevisionSpec: v1beta1.RevisionSpec{TimeoutSeconds: &60}, DeprecatedContainer: &v1.Container{Image: \"busybox\", Resources: v1.ResourceRequirements{Limits: v1.ResourceList{}, Requests: v1.ResourceList{}}}}},\n  \tTemplate:                   nil,\n  }\n"}
I0516 08:10:40.081] {"level":"error","ts":1557994238.249082,"logger":"fallback","caller":"service/service.go:212","msg":"Failed to reconcile Service: \"update-config-failure\" failed to reconcile Configuration: \"update-config-failure\"","error":"inducing failure for update configurations","stacktrace":"github.com/knative/serving/pkg/reconciler/service.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:212\ngithub.com/knative/serving/pkg/reconciler/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:150\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:40.082] === RUN   TestReconcile/runLatest_-_failure_updating_service_status
I0516 08:10:40.082] {"level":"warn","ts":1557994238.3353841,"logger":"fallback","caller":"service/service.go:160","msg":"Failed to update service status","error":"inducing failure for update services"}
I0516 08:10:40.082] === RUN   TestReconcile/runLatest_-_route_and_config_ready,_propagate_ready
I0516 08:10:40.084] === RUN   TestReconcile/runLatest_-_route_ready_previous_version_and_config_ready,_service_not_ready
I0516 08:10:40.087] {"level":"error","ts":1557994238.5450387,"logger":"fallback","caller":"service/service.go:278","msg":"Route \"config-only-ready\" is not yet what we want:   []v1alpha1.TrafficTarget{\n  \t{\n  \t\t... // 1 ignored field\n  \t\tTrafficTarget: v1beta1.TrafficTarget{\n  \t\t\tTag:               \"\",\n- \t\t\tRevisionName:      \"config-only-ready-00001\",\n+ \t\t\tRevisionName:      \"config-only-ready-00002\",\n  \t\t\tConfigurationName: \"\",\n  \t\t\t... // 2 ignored and 1 identical fields\n  \t\t},\n  \t},\n  }\n","stacktrace":"github.com/knative/serving/pkg/reconciler/service.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:278\ngithub.com/knative/serving/pkg/reconciler/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/service/service.go:150\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:114\ngithub.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/reconciler/testing/table.go:351\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:865"}
I0516 08:10:40.088] === RUN   TestReconcile/runLatest_-_config_fails,_new_gen,_propagate_failure
I0516 08:10:40.088] === RUN   TestReconcile/runLatest_-_config_fails,_propagate_failure
I0516 08:10:40.088] === RUN   TestReconcile/runLatest_-_route_fails,_propagate_failure
I0516 08:10:40.088] === RUN   TestReconcile/runLatest_-_not_owned_config_exists
I0516 08:10:40.089] === RUN   TestReconcile/runLatest_-_not_owned_route_exists
I0516 08:10:40.090] === RUN   TestReconcile/runLatest_-_correct_not_owned_by_adding_owner_refs
I0516 08:10:40.090] --- PASS: TestReconcile (2.87s)
I0516 08:10:40.090]     --- PASS: TestReconcile/bad_workqueue_key (0.05s)
I0516 08:10:40.090]         logger.go:130: 2019-05-16T08:10:36.208Z	ERROR	TestReconcile/bad_workqueue_key.service-controller	service/service.go:110	invalid resource key: too/many/parts	{"knative.dev/controller": "service-controller"}
I0516 08:10:40.090]     --- PASS: TestReconcile/key_not_found (0.03s)
I0516 08:10:40.090]     --- PASS: TestReconcile/nop_deletion_reconcile (0.04s)
I0516 08:10:40.091]     --- PASS: TestReconcile/inline_-_create_route_and_service (0.06s)
I0516 08:10:40.091]     --- PASS: TestReconcile/runLatest_-_create_route_and_service (0.04s)
I0516 08:10:40.091]     --- PASS: TestReconcile/pinned_-_create_route_and_service (0.04s)
I0516 08:10:40.093]     --- PASS: TestReconcile/pinned_-_create_route_and_service_-_via_release (0.05s)
... skipping 324 lines ...
I0516 08:12:04.040] 2019/05/16 08:12:04 process.go:153: Running: gcloud beta container clusters create --quiet --enable-autoscaling --min-nodes=4 --max-nodes=4 --scopes=cloud-platform --enable-basic-auth --no-issue-client-certificate --project=knative-boskos-35 --region=us-central1 --machine-type=n1-standard-4 --image-type=cos --num-nodes=4 --network=kserving-e2e-net1128933491610750976 --cluster-version=1.12.7-gke.10 kserving-e2e-cls1128933491610750976
I0516 08:12:04.510] WARNING: Currently VPC-native is not the default mode during cluster creation. In the future, this will become the default mode and can be disabled using `--no-enable-ip-alias` flag. Use `--[no-]enable-ip-alias` flag to suppress this warning.
I0516 08:12:04.511] WARNING: Starting in 1.12, default node pools in new clusters will have their legacy Compute Engine instance metadata endpoints disabled by default. To create a cluster with legacy instance metadata endpoints disabled in the default node pool, run `clusters create` with the flag `--metadata disable-legacy-endpoints=true`.
I0516 08:12:04.511] This will enable the autorepair feature for nodes. Please see https://cloud.google.com/kubernetes-engine/docs/node-auto-repair for more information on node autorepairs.
I0516 08:12:07.214] Creating cluster kserving-e2e-cls1128933491610750976 in us-central1...
I0516 08:12:17.345] ..................................................done.
I0516 08:12:17.438] ERROR: (gcloud.beta.container.clusters.create) Operation [<Operation
I0516 08:12:17.438]  clusterConditions: [<StatusCondition
I0516 08:12:17.438]  code: CodeValueValuesEnum(GCE_STOCKOUT, 1)
I0516 08:12:17.439]  message: u'Try a different location, or try again later: Google Compute Engine does not have enough resources available to fulfill request: us-central1-a.'>]
I0516 08:12:17.439]  detail: u'Try a different location, or try again later: Google Compute Engine does not have enough resources available to fulfill request: us-central1-a.'
I0516 08:12:17.439]  endTime: u'2019-05-16T08:12:16.007684986Z'
I0516 08:12:17.439]  name: u'operation-1557994327170-f68bde57'
... skipping 8 lines ...
I0516 08:12:17.440]  stages: []>
I0516 08:12:17.440]  selfLink: u'https://container.googleapis.com/v1beta1/projects/845844644028/locations/us-central1/operations/operation-1557994327170-f68bde57'
I0516 08:12:17.441]  startTime: u'2019-05-16T08:12:07.170161293Z'
I0516 08:12:17.441]  status: StatusValueValuesEnum(DONE, 3)
I0516 08:12:17.441]  statusMessage: u'Try a different location, or try again later: Google Compute Engine does not have enough resources available to fulfill request: us-central1-a.'
I0516 08:12:17.441]  targetLink: u'https://container.googleapis.com/v1beta1/projects/845844644028/locations/us-central1/clusters/kserving-e2e-cls1128933491610750976'
I0516 08:12:17.441]  zone: u'us-central1'>] finished with error: Try a different location, or try again later: Google Compute Engine does not have enough resources available to fulfill request: us-central1-a.
I0516 08:12:17.511] 2019/05/16 08:12:17 process.go:155: Step 'gcloud beta container clusters create --quiet --enable-autoscaling --min-nodes=4 --max-nodes=4 --scopes=cloud-platform --enable-basic-auth --no-issue-client-certificate --project=knative-boskos-35 --region=us-central1 --machine-type=n1-standard-4 --image-type=cos --num-nodes=4 --network=kserving-e2e-net1128933491610750976 --cluster-version=1.12.7-gke.10 kserving-e2e-cls1128933491610750976' finished in 13.470709108s
I0516 08:12:17.526] 2019/05/16 08:12:17 main.go:312: Something went wrong: starting e2e cluster: error creating cluster: error during gcloud beta container clusters create --quiet --enable-autoscaling --min-nodes=4 --max-nodes=4 --scopes=cloud-platform --enable-basic-auth --no-issue-client-certificate --project=knative-boskos-35 --region=us-central1 --machine-type=n1-standard-4 --image-type=cos --num-nodes=4 --network=kserving-e2e-net1128933491610750976 --cluster-version=1.12.7-gke.10 kserving-e2e-cls1128933491610750976: exit status 1
I0516 08:12:17.535] Test subprocess exited with code 0
I0516 08:12:17.539] Artifacts were written to /workspace/_artifacts
I0516 08:12:17.540] Test result code is 1
I0516 08:12:17.540] Running integration test test/e2e-tests.sh
I0516 08:12:17.575] Cluster will have a minimum of 4 and a maximum of 4 nodes.
I0516 08:12:17.858] gcloud project is knative-boskos-35
... skipping 82 lines ...
I0516 08:13:29.404] 2019/05/16 08:13:29 process.go:153: Running: gcloud beta container clusters create --quiet --enable-autoscaling --min-nodes=4 --max-nodes=4 --scopes=cloud-platform --enable-basic-auth --no-issue-client-certificate --project=knative-boskos-34 --region=us-central1 --machine-type=n1-standard-4 --image-type=cos --num-nodes=4 --network=kserving-e2e-net1128933491610750976 --cluster-version=1.12.7-gke.10 kserving-e2e-cls1128933491610750976
I0516 08:13:29.810] WARNING: Currently VPC-native is not the default mode during cluster creation. In the future, this will become the default mode and can be disabled using `--no-enable-ip-alias` flag. Use `--[no-]enable-ip-alias` flag to suppress this warning.
I0516 08:13:29.810] WARNING: Starting in 1.12, default node pools in new clusters will have their legacy Compute Engine instance metadata endpoints disabled by default. To create a cluster with legacy instance metadata endpoints disabled in the default node pool, run `clusters create` with the flag `--metadata disable-legacy-endpoints=true`.
I0516 08:13:29.811] This will enable the autorepair feature for nodes. Please see https://cloud.google.com/kubernetes-engine/docs/node-auto-repair for more information on node autorepairs.
I0516 08:13:32.854] Creating cluster kserving-e2e-cls1128933491610750976 in us-central1...
I0516 08:13:48.043] ...........................................................................done.
I0516 08:13:48.086] ERROR: (gcloud.beta.container.clusters.create) Operation [<Operation
I0516 08:13:48.086]  clusterConditions: [<StatusCondition
I0516 08:13:48.086]  code: CodeValueValuesEnum(GCE_STOCKOUT, 1)
I0516 08:13:48.087]  message: u'Try a different location, or try again later: Google Compute Engine does not have enough resources available to fulfill request: us-central1-a.'>]
I0516 08:13:48.087]  detail: u'Try a different location, or try again later: Google Compute Engine does not have enough resources available to fulfill request: us-central1-a.'
I0516 08:13:48.087]  endTime: u'2019-05-16T08:13:44.113902461Z'
I0516 08:13:48.087]  name: u'operation-1557994412809-b11fc679'
... skipping 8 lines ...
I0516 08:13:48.088]  stages: []>
I0516 08:13:48.088]  selfLink: u'https://container.googleapis.com/v1beta1/projects/915326016979/locations/us-central1/operations/operation-1557994412809-b11fc679'
I0516 08:13:48.088]  startTime: u'2019-05-16T08:13:32.809529503Z'
I0516 08:13:48.088]  status: StatusValueValuesEnum(DONE, 3)
I0516 08:13:48.088]  statusMessage: u'Try a different location, or try again later: Google Compute Engine does not have enough resources available to fulfill request: us-central1-a.'
I0516 08:13:48.089]  targetLink: u'https://container.googleapis.com/v1beta1/projects/915326016979/locations/us-central1/clusters/kserving-e2e-cls1128933491610750976'
I0516 08:13:48.089]  zone: u'us-central1'>] finished with error: Try a different location, or try again later: Google Compute Engine does not have enough resources available to fulfill request: us-central1-a.
I0516 08:13:48.149] 2019/05/16 08:13:48 process.go:155: Step 'gcloud beta container clusters create --quiet --enable-autoscaling --min-nodes=4 --max-nodes=4 --scopes=cloud-platform --enable-basic-auth --no-issue-client-certificate --project=knative-boskos-34 --region=us-central1 --machine-type=n1-standard-4 --image-type=cos --num-nodes=4 --network=kserving-e2e-net1128933491610750976 --cluster-version=1.12.7-gke.10 kserving-e2e-cls1128933491610750976' finished in 18.745607757s
I0516 08:13:48.163] 2019/05/16 08:13:48 main.go:312: Something went wrong: starting e2e cluster: error creating cluster: error during gcloud beta container clusters create --quiet --enable-autoscaling --min-nodes=4 --max-nodes=4 --scopes=cloud-platform --enable-basic-auth --no-issue-client-certificate --project=knative-boskos-34 --region=us-central1 --machine-type=n1-standard-4 --image-type=cos --num-nodes=4 --network=kserving-e2e-net1128933491610750976 --cluster-version=1.12.7-gke.10 kserving-e2e-cls1128933491610750976: exit status 1
I0516 08:13:48.172] Test subprocess exited with code 0
I0516 08:13:48.176] Artifacts were written to /workspace/_artifacts
I0516 08:13:48.176] Test result code is 1
I0516 08:13:48.179] ==================================
I0516 08:13:48.180] ==== INTEGRATION TESTS FAILED ====
I0516 08:13:48.180] ==================================
W0516 08:13:48.210] Run: ('/workspace/./test-infra/jenkins/../scenarios/../hack/coalesce.py',)
E0516 08:13:48.211] Command failed
I0516 08:13:48.211] process 278 exited with code 1 after 11.9m
E0516 08:13:48.211] FAIL: ci-knative-serving-continuous
I0516 08:13:48.211] Call:  gcloud auth activate-service-account --key-file=/etc/test-account/service-account.json
W0516 08:13:48.622] Activated service account credentials for: [prow-job@knative-tests.iam.gserviceaccount.com]
I0516 08:13:48.666] process 24653 exited with code 0 after 0.0m
I0516 08:13:48.666] Call:  gcloud config get-value account
I0516 08:13:48.972] process 24665 exited with code 0 after 0.0m
I0516 08:13:48.972] Will upload results to gs://knative-prow/logs using prow-job@knative-tests.iam.gserviceaccount.com
I0516 08:13:48.972] Upload result and artifacts...
I0516 08:13:48.972] Gubernator results at https://gubernator.k8s.io/build/knative-prow/logs/ci-knative-serving-continuous/1128933491610750976
I0516 08:13:48.973] Call:  gsutil ls gs://knative-prow/logs/ci-knative-serving-continuous/1128933491610750976/artifacts
W0516 08:13:49.976] CommandException: One or more URLs matched no objects.
E0516 08:13:50.102] Command failed
I0516 08:13:50.103] process 24677 exited with code 1 after 0.0m
W0516 08:13:50.103] Remote dir gs://knative-prow/logs/ci-knative-serving-continuous/1128933491610750976/artifacts not exist yet
I0516 08:13:50.103] Call:  gsutil -m -q -o GSUtil:use_magicfile=True cp -r -c -z log,txt,xml /workspace/_artifacts gs://knative-prow/logs/ci-knative-serving-continuous/1128933491610750976/artifacts
I0516 08:13:51.777] process 24819 exited with code 0 after 0.0m
W0516 08:13:51.778] metadata path /workspace/_artifacts/metadata.json does not exist
W0516 08:13:51.778] metadata not found or invalid, init with empty metadata
... skipping 15 lines ...