ResultFAILURE
Tests 1 failed / 384 succeeded
Started2018-12-10 08:01
Elapsed47m2s
Versionunknown
Buildergke-prow-default-pool-7fbe232f-bpv6
podd42151af-fc51-11e8-93e0-0a580a3c0b38
infra-commit398b34466
podd42151af-fc51-11e8-93e0-0a580a3c0b38
repogithub.com/knative/serving
repo-commitb262e481ab6d54a9ec867093fd61f4ea9847fd4b
repos{u'github.com/knative/serving': u'master'}

Test Failures


//knative/serving/pkg/reconciler/v1alpha1/route:TestGlobalResyncOnUpdateDomainConfigMap 0.00s

bazel test //knative/serving/pkg/reconciler/v1alpha1/route:TestGlobalResyncOnUpdateDomainConfigMap
exec ${PAGER:-/usr/bin/less} "$0" || exit 1
Executing tests from //knative/serving/pkg/reconciler/v1alpha1/route:TestGlobalResyncOnUpdateDomainConfigMap
-----------------------------------------------------------------------------
logger.go:130: 2018-12-10T08:05:47.891Z	DEBUG	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "route-controller"}

				from junit_bazel.xml

Filter through log files


Show 384 Passed Tests

Error lines from build-log.txt

... skipping 1044 lines ...
I1210 08:06:10.554] - TestCreateRouteForOneReserveRevision :PASS:
I1210 08:06:10.578] - TestCreateRouteWithMultipleTargets :PASS:
I1210 08:06:10.597] - TestCreateRouteWithOneTargetReserve :PASS:
I1210 08:06:10.617] - TestCreateRouteWithDuplicateTargets :PASS:
I1210 08:06:10.640] - TestCreateRouteWithNamedTargets :PASS:
I1210 08:06:10.690] - TestUpdateDomainConfigMap :PASS:
I1210 08:06:10.709] - TestGlobalResyncOnUpdateDomainConfigMap :FAIL:
I1210 08:06:10.937] - TestReconcile :PASS:
I1210 08:06:10.967] - FAIL github.com/knative/serving/pkg/reconciler/v1alpha1/route
I1210 08:06:10.976] - TestSelectorMatches :PASS:
I1210 08:06:10.979] - TestNewConfigNoEntry :PASS:
I1210 08:06:10.982] - TestNewConfigBadYaml :PASS:
I1210 08:06:10.986] - TestNewConfig :PASS:
I1210 08:06:10.989] - TestLookupDomainForLabels :PASS:
I1210 08:06:10.993] - TestOurDomain :PASS:
... skipping 66 lines ...
I1210 08:06:11.342] - TestDurableConnectionWhenConnectionBreaksDown :PASS:
I1210 08:06:11.346] - TestConnectFailureReturnsError :PASS:
I1210 08:06:11.349] - TestKeepaliveWithNoConnectionReturnsError :PASS:
I1210 08:06:11.352] - ok github.com/knative/serving/pkg/websocket
I1210 08:06:11.365] - TestBuildDuckTypes :PASS:
I1210 08:06:11.370] - ok github.com/knative/serving/test/apis/testing/v1alpha1
I1210 08:06:11.401] Done parsing 362 tests, 1 tests failed
I1210 08:06:11.401] There were 1 test failures, full log:
I1210 08:06:11.403] ?   	github.com/knative/serving/cmd/activator	[no test files]
I1210 08:06:11.403] === RUN   TestLabelValueOrEmpty
I1210 08:06:11.403] === RUN   TestLabelValueOrEmpty/existing_key
I1210 08:06:11.403] === RUN   TestLabelValueOrEmpty/existing_empty_key
I1210 08:06:11.403] === RUN   TestLabelValueOrEmpty/non-existent_key
... skipping 21 lines ...
I1210 08:06:11.407] --- PASS: TestShutdown_ReturnError (0.10s)
I1210 08:06:11.407] === RUN   TestActiveEndpoint_Reserve_WaitsForReady
I1210 08:06:11.407] --- PASS: TestActiveEndpoint_Reserve_WaitsForReady (3.10s)
I1210 08:06:11.407] 	logger.go:130: 2018-12-10T08:05:03.973Z	INFO	TestActiveEndpoint_Reserve_WaitsForReady	activator/revision.go:101	Revision is ready	{"knative.dev/key": "test-namespace/test-rev"}
I1210 08:06:11.407] === RUN   TestActiveEndpoint_Reserve_ReadyTimeoutWithError
I1210 08:06:11.407] --- PASS: TestActiveEndpoint_Reserve_ReadyTimeoutWithError (3.10s)
I1210 08:06:11.408] 	logger.go:130: 2018-12-10T08:05:07.175Z	ERROR	TestActiveEndpoint_Reserve_ReadyTimeoutWithError	activator/revision.go:147	Failed to activate the revision.{error 25 0  Timeout waiting for revision to become ready}	{"knative.dev/key": "test-namespace/test-rev"}
I1210 08:06:11.408] === RUN   TestActivatorReporter
I1210 08:06:11.408] --- PASS: TestActivatorReporter (0.00s)
I1210 08:06:11.408] PASS
I1210 08:06:11.408] ok  	github.com/knative/serving/pkg/activator	7.865s
I1210 08:06:11.408] === RUN   TestMultipleDifferentKeys
I1210 08:06:11.408] --- PASS: TestMultipleDifferentKeys (0.00s)
... skipping 15 lines ...
I1210 08:06:11.410]     --- PASS: TestFilteringHandler/forward_a_request_containing_empty_retry_header (0.00s)
I1210 08:06:11.410] === RUN   TestActivationHandler
I1210 08:06:11.410] === RUN   TestActivationHandler/active_endpoint
I1210 08:06:11.411] === RUN   TestActivationHandler/active_endpoint_with_missing_count_header
I1210 08:06:11.411] === RUN   TestActivationHandler/no_active_endpoint
I1210 08:06:11.411] === RUN   TestActivationHandler/request_error
I1210 08:06:11.411] 2018/12/10 08:04:58 http: proxy error: request error
I1210 08:06:11.411] === RUN   TestActivationHandler/invalid_number_of_attempts
I1210 08:06:11.411] --- PASS: TestActivationHandler (0.01s)
I1210 08:06:11.411]     --- PASS: TestActivationHandler/active_endpoint (0.00s)
I1210 08:06:11.411]     	logger.go:130: 2018-12-10T08:04:58.476Z	INFO	TestActivationHandler/active_endpoint	handler/handler.go:68	got 123 attempts
I1210 08:06:11.412]     --- PASS: TestActivationHandler/active_endpoint_with_missing_count_header (0.00s)
I1210 08:06:11.412]     --- PASS: TestActivationHandler/no_active_endpoint (0.00s)
I1210 08:06:11.412]     	logger.go:130: 2018-12-10T08:04:58.479Z	ERROR	TestActivationHandler/no_active_endpoint	handler/handler.go:52	Error getting active endpoint: not found
I1210 08:06:11.412]     --- PASS: TestActivationHandler/request_error (0.00s)
I1210 08:06:11.412]     --- PASS: TestActivationHandler/invalid_number_of_attempts (0.00s)
I1210 08:06:11.412]     	logger.go:130: 2018-12-10T08:04:58.484Z	ERROR	TestActivationHandler/invalid_number_of_attempts	handler/handler.go:71	Value in knative-activator-num-retries header is not a valid integer. Error: strconv.Atoi: parsing "hi there": invalid syntax
I1210 08:06:11.412] === RUN   TestRequestEventHandler
I1210 08:06:11.413] --- PASS: TestRequestEventHandler (0.00s)
I1210 08:06:11.413] PASS
I1210 08:06:11.413] ok  	github.com/knative/serving/pkg/activator/handler	1.372s
I1210 08:06:11.413] === RUN   TestHeaderPruning
I1210 08:06:11.413] === RUN   TestHeaderPruning/revision_name_header
... skipping 23 lines ...
I1210 08:06:11.416]     	logger.go:130: 2018-12-10T08:04:59.034Z	INFO	TestRetryRoundTripper/no_retry	util/transports.go:107	Finished after 1 attempt(s). Response code: 200
I1210 08:06:11.416]     --- PASS: TestRetryRoundTripper/no_conditions (0.00s)
I1210 08:06:11.416]     	logger.go:130: 2018-12-10T08:04:59.035Z	DEBUG	TestRetryRoundTripper/no_conditions	util/transports.go:86	Retrying
I1210 08:06:11.416]     	logger.go:130: 2018-12-10T08:04:59.035Z	INFO	TestRetryRoundTripper/no_conditions	util/transports.go:107	Finished after 1 attempt(s). Response code: 500
I1210 08:06:11.416]     --- PASS: TestRetryRoundTripper/retry_on_error (0.00s)
I1210 08:06:11.416]     	logger.go:130: 2018-12-10T08:04:59.035Z	DEBUG	TestRetryRoundTripper/retry_on_error	util/transports.go:86	Retrying
I1210 08:06:11.417]     	logger.go:130: 2018-12-10T08:04:59.036Z	ERROR	TestRetryRoundTripper/retry_on_error	util/transports.go:93	Error making a request: some error
I1210 08:06:11.417]     	logger.go:130: 2018-12-10T08:04:59.036Z	DEBUG	TestRetryRoundTripper/retry_on_error	util/transports.go:86	Retrying
I1210 08:06:11.417]     	logger.go:130: 2018-12-10T08:04:59.036Z	ERROR	TestRetryRoundTripper/retry_on_error	util/transports.go:93	Error making a request: some error
I1210 08:06:11.417]     	logger.go:130: 2018-12-10T08:04:59.036Z	ERROR	TestRetryRoundTripper/retry_on_error	util/transports.go:115	Failed after 2 attempts. Last error: some error
I1210 08:06:11.417]     --- PASS: TestRetryRoundTripper/retry_on_condition_1 (0.00s)
I1210 08:06:11.417]     	logger.go:130: 2018-12-10T08:04:59.037Z	DEBUG	TestRetryRoundTripper/retry_on_condition_1	util/transports.go:86	Retrying
I1210 08:06:11.418]     	logger.go:130: 2018-12-10T08:04:59.037Z	DEBUG	TestRetryRoundTripper/retry_on_condition_1	util/transports.go:86	Retrying
I1210 08:06:11.418]     	logger.go:130: 2018-12-10T08:04:59.037Z	INFO	TestRetryRoundTripper/retry_on_condition_1	util/transports.go:107	Finished after 2 attempt(s). Response code: 500
I1210 08:06:11.418]     --- PASS: TestRetryRoundTripper/retry_on_condition_2 (0.00s)
I1210 08:06:11.418]     	logger.go:130: 2018-12-10T08:04:59.037Z	DEBUG	TestRetryRoundTripper/retry_on_condition_2	util/transports.go:86	Retrying
... skipping 909 lines ...
I1210 08:06:11.554] 	logger.go:130: 2018-12-10T08:05:07.215Z	DEBUG	TestAutoscaler_Stats_TrimAfterStableWindow	autoscaler/autoscaler.go:296	STABLE: Observed average 10.000 concurrency over 1m0s seconds over 60 samples over 1 pods.
I1210 08:06:11.554] 	logger.go:130: 2018-12-10T08:05:07.215Z	DEBUG	TestAutoscaler_Stats_TrimAfterStableWindow	autoscaler/autoscaler.go:298	PANIC: Observed average 10.000 concurrency over 6s seconds over 6 samples over 1 pods.
I1210 08:06:11.555] 	logger.go:130: 2018-12-10T08:05:07.215Z	DEBUG	TestAutoscaler_Stats_TrimAfterStableWindow	autoscaler/autoscaler.go:329	Operating in stable mode.
I1210 08:06:11.555] 	logger.go:130: 2018-12-10T08:05:07.216Z	DEBUG	TestAutoscaler_Stats_TrimAfterStableWindow	autoscaler/autoscaler.go:268	No data to scale on.
I1210 08:06:11.555] === RUN   TestAutoscaler_Stats_DenyNoTime
I1210 08:06:11.555] --- PASS: TestAutoscaler_Stats_DenyNoTime (0.00s)
I1210 08:06:11.555] 	logger.go:130: 2018-12-10T08:05:07.216Z	ERROR	TestAutoscaler_Stats_DenyNoTime	autoscaler/autoscaler.go:213	Missing time from stat: {Time:<nil> PodName:pod-1 AverageConcurrentRequests:1 RequestCount:5 LameDuck:false}
I1210 08:06:11.556] 	logger.go:130: 2018-12-10T08:05:07.216Z	DEBUG	TestAutoscaler_Stats_DenyNoTime	autoscaler/autoscaler.go:268	No data to scale on.
I1210 08:06:11.556] === RUN   TestAutoscaler_RateLimit_ScaleUp
I1210 08:06:11.556] --- PASS: TestAutoscaler_RateLimit_ScaleUp (0.00s)
I1210 08:06:11.556] 	autoscaler_test.go:513: Recording points: [1000].
I1210 08:06:11.556] 	logger.go:130: 2018-12-10T08:05:07.217Z	DEBUG	TestAutoscaler_RateLimit_ScaleUp	autoscaler/autoscaler.go:279	Current QPS: 1  Current concurrent clients: 1000
I1210 08:06:11.556] 	logger.go:130: 2018-12-10T08:05:07.217Z	DEBUG	TestAutoscaler_RateLimit_ScaleUp	autoscaler/autoscaler.go:296	STABLE: Observed average 1000.000 concurrency over 1m0s seconds over 1 samples over 1 pods.
... skipping 90 lines ...
I1210 08:06:11.573] {"level":"warn","ts":1544429107.358668,"logger":"fallback","caller":"autoscaler/multiscaler.go:224","msg":"Cannot scale: Desired scale == 0 && EnableScaleToZero == false."}
I1210 08:06:11.573] {"level":"warn","ts":1544429107.359652,"logger":"fallback","caller":"autoscaler/multiscaler.go:224","msg":"Cannot scale: Desired scale == 0 && EnableScaleToZero == false."}
I1210 08:06:11.573] {"level":"warn","ts":1544429107.3606489,"logger":"fallback","caller":"autoscaler/multiscaler.go:224","msg":"Cannot scale: Desired scale == 0 && EnableScaleToZero == false."}
I1210 08:06:11.574] --- PASS: TestMultiScalerWithoutScaleToZero (0.06s)
I1210 08:06:11.574] 	logger.go:130: 2018-12-10T08:05:07.330Z	DEBUG	TestMultiScalerWithoutScaleToZero	autoscaler/multiscaler.go:106	Creating MultiScaler with configuration &autoscaler.DynamicConfig{mutex:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:0, readerWait:0}, config:(*autoscaler.Config)(0xc420042b40), logger:(*zap.SugaredLogger)(0xc420328280), containerConcurrency:0}
I1210 08:06:11.574] === RUN   TestMultiScalerIgnoreNegativeScale
I1210 08:06:11.574] {"level":"error","ts":1544429107.394028,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.575] {"level":"error","ts":1544429107.3950038,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.575] {"level":"error","ts":1544429107.3960075,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.576] {"level":"error","ts":1544429107.3969128,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.576] {"level":"error","ts":1544429107.3979936,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.576] {"level":"error","ts":1544429107.3990016,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.577] {"level":"error","ts":1544429107.4000237,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.577] {"level":"error","ts":1544429107.4011555,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.577] {"level":"error","ts":1544429107.402017,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.578] {"level":"error","ts":1544429107.4030197,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.578] {"level":"error","ts":1544429107.4040468,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.578] {"level":"error","ts":1544429107.4050539,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.579] {"level":"error","ts":1544429107.4061537,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.579] {"level":"error","ts":1544429107.4089572,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.579] {"level":"error","ts":1544429107.4100933,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.580] {"level":"error","ts":1544429107.4110088,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.580] {"level":"error","ts":1544429107.4120195,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.580] {"level":"error","ts":1544429107.4130023,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.581] {"level":"error","ts":1544429107.4140077,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.581] {"level":"error","ts":1544429107.4150352,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.581] {"level":"error","ts":1544429107.4160192,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.582] {"level":"error","ts":1544429107.4170063,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.582] {"level":"error","ts":1544429107.4180036,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.583] {"level":"error","ts":1544429107.4190738,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.583] {"level":"error","ts":1544429107.4200072,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.583] {"level":"error","ts":1544429107.421148,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.584] {"level":"error","ts":1544429107.4220185,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.584] {"level":"error","ts":1544429107.4229915,"logger":"fallback","caller":"autoscaler/multiscaler.go:218","msg":"Cannot scale: desiredScale -1 < 0.","stacktrace":"github.com/knative/serving/pkg/autoscaler.(*MultiScaler).tickScaler\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:218\ngithub.com/knative/serving/pkg/autoscaler.(*MultiScaler).createScaler.func1\n\t/go/src/github.com/knative/serving/pkg/autoscaler/multiscaler.go:187"}
I1210 08:06:11.584] --- PASS: TestMultiScalerIgnoreNegativeScale (0.06s)
I1210 08:06:11.584] 	logger.go:130: 2018-12-10T08:05:07.392Z	DEBUG	TestMultiScalerIgnoreNegativeScale	autoscaler/multiscaler.go:106	Creating MultiScaler with configuration &autoscaler.DynamicConfig{mutex:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:0, readerWait:0}, config:(*autoscaler.Config)(0xc4200fc500), logger:(*zap.SugaredLogger)(0xc42001c000), containerConcurrency:0}
I1210 08:06:11.584] === RUN   TestMultiScalerRecordsStatistics
I1210 08:06:11.585] --- PASS: TestMultiScalerRecordsStatistics (0.00s)
I1210 08:06:11.585] 	logger.go:130: 2018-12-10T08:05:07.454Z	DEBUG	TestMultiScalerRecordsStatistics	autoscaler/multiscaler.go:106	Creating MultiScaler with configuration &autoscaler.DynamicConfig{mutex:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:0, readerWait:0}, config:(*autoscaler.Config)(0xc4208a2a00), logger:(*zap.SugaredLogger)(0xc42000e038), containerConcurrency:0}
I1210 08:06:11.585] PASS
... skipping 47 lines ...
I1210 08:06:11.590] === RUN   TestLastHeaderValue
I1210 08:06:11.590] --- PASS: TestLastHeaderValue (0.00s)
I1210 08:06:11.590] PASS
I1210 08:06:11.590] ok  	github.com/knative/serving/pkg/http	1.064s
I1210 08:06:11.590] ?   	github.com/knative/serving/pkg/http/h2c	[no test files]
I1210 08:06:11.591] === RUN   TestNewLogger
I1210 08:06:11.591] {"level":"warn","ts":1544429110.2756734,"logger":"fallback-logger","caller":"logging/config.go:65","msg":"Fetch GitHub commit ID from kodata failed: \"KO_DATA_PATH\" does not exist or is empty"}
I1210 08:06:11.591] {"level":"warn","ts":1544429110.2784019,"logger":"fallback-logger","caller":"logging/config.go:65","msg":"Fetch GitHub commit ID from kodata failed: \"KO_DATA_PATH\" does not exist or is empty"}
I1210 08:06:11.591] {"level":"warn","ts":1544429110.2810152,"logger":"fallback-logger","caller":"logging/config.go:65","msg":"Fetch GitHub commit ID from kodata failed: \"KO_DATA_PATH\" does not exist or is empty"}
I1210 08:06:11.591] {"knative.dev/jsonconfig":"{\"level\": \"info\", \"outputPaths\": [\"stdout\"],\"errorOutputPaths\": [\"stderr\"],\"encoding\": \"json\"}"}
I1210 08:06:11.591] {}
I1210 08:06:11.591] {}
I1210 08:06:11.591] {"knative.dev/jsonconfig":"{\"level\": \"error\", \"outputPaths\": [\"stdout\"],\"errorOutputPaths\": [\"stderr\"],\"encoding\": \"json\"}"}
I1210 08:06:11.592] {}
I1210 08:06:11.592] {}
I1210 08:06:11.592] --- PASS: TestNewLogger (0.01s)
I1210 08:06:11.592] === RUN   TestNewConfigNoEntry
I1210 08:06:11.592] --- PASS: TestNewConfigNoEntry (0.00s)
I1210 08:06:11.592] === RUN   TestNewConfig
I1210 08:06:11.592] --- PASS: TestNewConfig (0.00s)
I1210 08:06:11.592] === RUN   TestOurConfig
I1210 08:06:11.592] --- PASS: TestOurConfig (0.00s)
I1210 08:06:11.592] === RUN   TestNewLoggerFromConfig
I1210 08:06:11.592] {"knative.dev/jsonconfig":"{\"level\": \"error\",\n\"outputPaths\": [\"stdout\"],\n\"errorOutputPaths\": [\"stderr\"],\n\"encoding\": \"json\"}"}
I1210 08:06:11.593] {}
I1210 08:06:11.593] {}
I1210 08:06:11.593] --- PASS: TestNewLoggerFromConfig (0.00s)
I1210 08:06:11.593] === RUN   TestEmptyLevel
I1210 08:06:11.593] --- PASS: TestEmptyLevel (0.00s)
I1210 08:06:11.593] === RUN   TestInvalidLevel
I1210 08:06:11.593] --- PASS: TestInvalidLevel (0.00s)
I1210 08:06:11.593] === RUN   TestUpdateLevelFromConfigMap
I1210 08:06:11.593] {"level":"warn","ts":1544429110.293459,"logger":"fallback-logger","caller":"logging/config.go:65","msg":"Fetch GitHub commit ID from kodata failed: \"KO_DATA_PATH\" does not exist or is empty"}
I1210 08:06:11.594] {"level":"info","ts":1544429110.2937112,"logger":"fallback-logger","caller":"logging/config.go:157","msg":"Updating logging level for controller from debug to info."}
I1210 08:06:11.594] {"level":"info","ts":1544429110.2939165,"logger":"fallback-logger","caller":"logging/config.go:157","msg":"Updating logging level for controller from info to error."}
I1210 08:06:11.594] {"level":"error","ts":1544429110.2941692,"logger":"fallback-logger","caller":"logging/config.go:151","msg":"Failed to parse the logging configmap. Previous config map will be used.{error 25 0  invalid logging level: invalid}","stacktrace":"github.com/knative/serving/vendor/github.com/knative/pkg/logging.UpdateLevelFromConfigMap.func1\n\t/go/src/github.com/knative/serving/vendor/github.com/knative/pkg/logging/config.go:151\ngithub.com/knative/serving/pkg/logging.TestUpdateLevelFromConfigMap\n\t/go/src/github.com/knative/serving/pkg/logging/config_test.go:271\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.594] --- PASS: TestUpdateLevelFromConfigMap (0.00s)
I1210 08:06:11.594] PASS
I1210 08:06:11.594] ok  	github.com/knative/serving/pkg/logging	1.157s
I1210 08:06:11.595] ?   	github.com/knative/serving/pkg/metrics	[no test files]
I1210 08:06:11.595] === RUN   TestBreakerOverload
I1210 08:06:11.595] --- PASS: TestBreakerOverload (0.00s)
... skipping 173 lines ...
I1210 08:06:11.624] {"level":"info","ts":1544429119.984303,"logger":"fallback","caller":"kpa/kpa.go:219","msg":"PA got=0, want=1"}
I1210 08:06:11.624] --- PASS: TestEmptyEndpoints (0.00s)
I1210 08:06:11.625] 	logger.go:130: 2018-12-10T08:05:19.981Z	INFO	TestEmptyEndpoints	kpa/kpa_scaler.go:78	Autoscaler config map is added or updated: &ConfigMap{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:config-autoscaler,GenerateName:,Namespace:knative-serving,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,},Data:map[string]string{container-concurrency-target-default: 10.0,container-concurrency-target-percentage: 0.5,max-scale-up-rate: 1.0,panic-window: 10s,scale-to-zero-grace-period: 1m0s,stable-window: 5m,tick-interval: 2s,},BinaryData:map[string][]byte{},}
I1210 08:06:11.625] 	logger.go:130: 2018-12-10T08:05:19.981Z	DEBUG	TestEmptyEndpoints.kpa-class-podautoscaler-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I1210 08:06:11.625] 	logger.go:130: 2018-12-10T08:05:19.983Z	INFO	TestEmptyEndpoints.kpa-class-podautoscaler-controller	kpa/kpa.go:103	Setting up kpa-class event handlers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I1210 08:06:11.625] === RUN   TestControllerCreateError
I1210 08:06:11.626] {"level":"error","ts":1544429119.9880989,"logger":"fallback","caller":"kpa/kpa.go:186","msg":"Error creating Metric: asdf","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa/kpa.go:186\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa/kpa.go:155\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa.TestControllerCreateError\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa/kpa_test.go:370\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.626] --- PASS: TestControllerCreateError (0.00s)
I1210 08:06:11.626] 	logger.go:130: 2018-12-10T08:05:19.985Z	INFO	TestControllerCreateError	kpa/kpa_scaler.go:78	Autoscaler config map is added or updated: &ConfigMap{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:config-autoscaler,GenerateName:,Namespace:knative-serving,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,},Data:map[string]string{container-concurrency-target-default: 10.0,container-concurrency-target-percentage: 0.5,max-scale-up-rate: 1.0,panic-window: 10s,scale-to-zero-grace-period: 1m0s,stable-window: 5m,tick-interval: 2s,},BinaryData:map[string][]byte{},}
I1210 08:06:11.627] 	logger.go:130: 2018-12-10T08:05:19.985Z	DEBUG	TestControllerCreateError.kpa-class-podautoscaler-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I1210 08:06:11.627] 	logger.go:130: 2018-12-10T08:05:19.987Z	INFO	TestControllerCreateError.kpa-class-podautoscaler-controller	kpa/kpa.go:103	Setting up kpa-class event handlers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I1210 08:06:11.627] === RUN   TestControllerUpdateError
I1210 08:06:11.627] {"level":"error","ts":1544429119.9912345,"logger":"fallback","caller":"kpa/kpa.go:186","msg":"Error creating Metric: asdf","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa/kpa.go:186\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa/kpa.go:155\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa.TestControllerUpdateError\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa/kpa_test.go:408\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.627] --- PASS: TestControllerUpdateError (0.00s)
I1210 08:06:11.628] 	logger.go:130: 2018-12-10T08:05:19.989Z	INFO	TestControllerUpdateError	kpa/kpa_scaler.go:78	Autoscaler config map is added or updated: &ConfigMap{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:config-autoscaler,GenerateName:,Namespace:knative-serving,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,},Data:map[string]string{container-concurrency-target-default: 10.0,container-concurrency-target-percentage: 0.5,max-scale-up-rate: 1.0,panic-window: 10s,scale-to-zero-grace-period: 1m0s,stable-window: 5m,tick-interval: 2s,},BinaryData:map[string][]byte{},}
I1210 08:06:11.628] 	logger.go:130: 2018-12-10T08:05:19.989Z	DEBUG	TestControllerUpdateError.kpa-class-podautoscaler-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I1210 08:06:11.628] 	logger.go:130: 2018-12-10T08:05:19.990Z	INFO	TestControllerUpdateError.kpa-class-podautoscaler-controller	kpa/kpa.go:103	Setting up kpa-class event handlers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I1210 08:06:11.629] === RUN   TestControllerGetError
I1210 08:06:11.629] {"level":"error","ts":1544429119.9949033,"logger":"fallback","caller":"kpa/kpa.go:190","msg":"Error fetching Metric: asdf","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa/kpa.go:190\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa/kpa.go:155\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa.TestControllerGetError\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa/kpa_test.go:445\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.629] --- PASS: TestControllerGetError (0.00s)
I1210 08:06:11.630] 	logger.go:130: 2018-12-10T08:05:19.992Z	INFO	TestControllerGetError	kpa/kpa_scaler.go:78	Autoscaler config map is added or updated: &ConfigMap{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:config-autoscaler,GenerateName:,Namespace:knative-serving,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,},Data:map[string]string{container-concurrency-target-default: 10.0,container-concurrency-target-percentage: 0.5,max-scale-up-rate: 1.0,panic-window: 10s,scale-to-zero-grace-period: 1m0s,stable-window: 5m,tick-interval: 2s,},BinaryData:map[string][]byte{},}
I1210 08:06:11.630] 	logger.go:130: 2018-12-10T08:05:19.992Z	DEBUG	TestControllerGetError.kpa-class-podautoscaler-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I1210 08:06:11.630] 	logger.go:130: 2018-12-10T08:05:19.994Z	INFO	TestControllerGetError.kpa-class-podautoscaler-controller	kpa/kpa.go:103	Setting up kpa-class event handlers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I1210 08:06:11.630] === RUN   TestScaleFailure
I1210 08:06:11.630] {"level":"info","ts":1544429119.998841,"logger":"fallback","caller":"kpa/kpa_scaler.go:178","msg":"Scaling from 0 to 1"}
... skipping 2 lines ...
I1210 08:06:11.631] 	logger.go:130: 2018-12-10T08:05:19.996Z	DEBUG	TestScaleFailure.kpa-class-podautoscaler-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I1210 08:06:11.632] 	logger.go:130: 2018-12-10T08:05:19.997Z	INFO	TestScaleFailure.kpa-class-podautoscaler-controller	kpa/kpa.go:103	Setting up kpa-class event handlers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I1210 08:06:11.632] === RUN   TestBadKey
I1210 08:06:11.632] {"level":"info","ts":1544429120.0023913,"logger":"fallback","caller":"kpa/kpa.go:219","msg":"PA got=0, want=1"}
I1210 08:06:11.632] E1210 08:05:20.002090   10890 kpa.go:131] invalid resource key too/many/parts: unexpected key format: "too/many/parts"
I1210 08:06:11.632] --- PASS: TestBadKey (0.01s)
I1210 08:06:11.632] {"level":"warn","ts":1544429120.0100305,"logger":"fallback","caller":"kpa/kpa.go:162","msg":"Failed to update kpa status{error 25 0  podautoscalers.autoscaling.internal.knative.dev \"test-revision\" not found}"}
I1210 08:06:11.634] E1210 08:05:20.010378   10890 event.go:259] Could not construct reference to: '&v1alpha1.PodAutoscaler{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-revision", GenerateName:"", Namespace:"test-namespace", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"serving.knative.dev/revisionUID":"", "app":"test-revision", "serving.knative.dev/revision":"test-revision"}, Annotations:map[string]string{"autoscaling.knative.dev/class":"kpa.autoscaling.knative.dev", "autoscaling.knative.dev/metric":"concurrency"}, OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"serving.knative.dev/v1alpha1", Kind:"Revision", Name:"test-revision", UID:"", Controller:(*bool)(0xc4204e87e2), BlockOwnerDeletion:(*bool)(0xc4204e87e3)}}, Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Spec:v1alpha1.PodAutoscalerSpec{Generation:0, ConcurrencyModel:"", ContainerConcurrency:0, ScaleTargetRef:v1.CrossVersionObjectReference{Kind:"Deployment", Name:"test-revision-deployment", APIVersion:"apps/v1"}, ServiceName:"test-revision-service"}, Status:v1alpha1.PodAutoscalerStatus{Conditions:v1alpha1.Conditions{v1alpha1.Condition{Type:"Active", Status:"Unknown", Severity:"Error", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbefba5700092cb8a, ext:145035140, loc:(*time.Location)(0x23375a0)}}}, Reason:"Queued", Message:"Requests to the target are being buffered as resources are provisioned."}, v1alpha1.Condition{Type:"Ready", Status:"Unknown", Severity:"Error", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0xbefba570009378b0, ext:145079468, loc:(*time.Location)(0x23375a0)}}}, Reason:"Queued", Message:"Requests to the target are being buffered as resources are provisioned."}}}}' due to: 'selfLink was empty, can't make reference'. Will not report event: 'Warning' 'UpdateFailed' 'Failed to update status for PA "test-revision": podautoscalers.autoscaling.internal.knative.dev "test-revision" not found'
I1210 08:06:11.634] 	logger.go:130: 2018-12-10T08:05:19.999Z	INFO	TestBadKey	kpa/kpa_scaler.go:78	Autoscaler config map is added or updated: &ConfigMap{ObjectMeta:k8s_io_apimachinery_pkg_apis_meta_v1.ObjectMeta{Name:config-autoscaler,GenerateName:,Namespace:knative-serving,SelfLink:,UID:,ResourceVersion:,Generation:0,CreationTimestamp:0001-01-01 00:00:00 +0000 UTC,DeletionTimestamp:<nil>,DeletionGracePeriodSeconds:nil,Labels:map[string]string{},Annotations:map[string]string{},OwnerReferences:[],Finalizers:[],ClusterName:,Initializers:nil,},Data:map[string]string{container-concurrency-target-default: 10.0,container-concurrency-target-percentage: 0.5,max-scale-up-rate: 1.0,panic-window: 10s,scale-to-zero-grace-period: 1m0s,stable-window: 5m,tick-interval: 2s,},BinaryData:map[string][]byte{},}
I1210 08:06:11.634] 	logger.go:130: 2018-12-10T08:05:20.000Z	DEBUG	TestBadKey.kpa-class-podautoscaler-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I1210 08:06:11.635] 	logger.go:130: 2018-12-10T08:05:20.001Z	INFO	TestBadKey.kpa-class-podautoscaler-controller	kpa/kpa.go:103	Setting up kpa-class event handlers	{"knative.dev/controller": "kpa-class-podautoscaler-controller"}
I1210 08:06:11.635] PASS
I1210 08:06:11.635] ok  	github.com/knative/serving/pkg/reconciler/v1alpha1/autoscaling/kpa	1.394s
I1210 08:06:11.635] === RUN   TestReconcile
I1210 08:06:11.635] === RUN   TestReconcile/bad_workqueue_key
I1210 08:06:11.635] === RUN   TestReconcile/key_not_found
I1210 08:06:11.636] {"level":"error","ts":1544429124.952953,"logger":"fallback","caller":"clusteringress/clusteringress.go:131","msg":"clusteringress \"foo/not-found\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/clusteringress.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/clusteringress/clusteringress.go:131\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.636] === RUN   TestReconcile/skip_ingress_not_matching_class_key
I1210 08:06:11.636] {"level":"error","ts":1544429124.9721026,"logger":"fallback","caller":"clusteringress/clusteringress.go:131","msg":"clusteringress \"\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/clusteringress.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/clusteringress/clusteringress.go:131\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.637] === RUN   TestReconcile/create_VirtualService_matching_ClusterIngress
I1210 08:06:11.637] {"level":"info","ts":1544429125.0037894,"logger":"fallback","caller":"clusteringress/clusteringress.go:186","msg":"Reconciling clusterIngress :&{{ } {no-virtualservice-yet      0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[serving.knative.dev/route:test-route serving.knative.dev/routeNamespace:test-ns] map[] [] nil [] } {1234 [] [{[domain.com test-route.test-ns.svc.cluster.local test-route.test-ns.svc test-route.test-ns] 0xc4204b5360}]} {[{LoadBalancerReady Unknown Error {2018-12-10 08:05:25.003287469 +0000 UTC m=+0.161781506}  } {NetworkConfigured Unknown Error {2018-12-10 08:05:25.003264808 +0000 UTC m=+0.161758870}  } {Ready Unknown Error {2018-12-10 08:05:25.003307876 +0000 UTC m=+0.161801903}  }] <nil>}}"}
I1210 08:06:11.637] {"level":"info","ts":1544429125.007266,"logger":"fallback","caller":"clusteringress/clusteringress.go:187","msg":"Creating/Updating VirtualService"}
I1210 08:06:11.638] {"level":"info","ts":1544429125.007802,"logger":"fallback","caller":"clusteringress/clusteringress.go:200","msg":"ClusterIngress successfully synced"}
I1210 08:06:11.638] === RUN   TestReconcile/reconcile_VirtualService_to_match_desired_one
I1210 08:06:11.638] {"level":"info","ts":1544429125.0352073,"logger":"fallback","caller":"clusteringress/clusteringress.go:186","msg":"Reconciling clusterIngress :&{{ } {reconcile-virtualservice      0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[serving.knative.dev/routeNamespace:test-ns serving.knative.dev/route:test-route] map[] [] nil [] } {1234 [] [{[domain.com test-route.test-ns.svc.cluster.local test-route.test-ns.svc test-route.test-ns] 0xc420448880}]} {[{LoadBalancerReady Unknown Error {2018-12-10 08:05:25.035002481 +0000 UTC m=+0.193496490}  } {NetworkConfigured Unknown Error {2018-12-10 08:05:25.034994976 +0000 UTC m=+0.193489016}  } {Ready Unknown Error {2018-12-10 08:05:25.035010012 +0000 UTC m=+0.193504021}  }] <nil>}}"}
I1210 08:06:11.638] {"level":"info","ts":1544429125.0354447,"logger":"fallback","caller":"clusteringress/clusteringress.go:187","msg":"Creating/Updating VirtualService"}
I1210 08:06:11.639] {"level":"info","ts":1544429125.0357676,"logger":"fallback","caller":"clusteringress/clusteringress.go:200","msg":"ClusterIngress successfully synced"}
I1210 08:06:11.639] --- PASS: TestReconcile (0.15s)
I1210 08:06:11.639]     --- PASS: TestReconcile/bad_workqueue_key (0.02s)
I1210 08:06:11.639]     	logger.go:130: 2018-12-10T08:05:24.922Z	ERROR	TestReconcile/bad_workqueue_key.clusteringress-controller	clusteringress/clusteringress.go:120	invalid resource key: too/many/parts	{"knative.dev/controller": "clusteringress-controller"}
I1210 08:06:11.639]     --- PASS: TestReconcile/key_not_found (0.03s)
I1210 08:06:11.639]     --- PASS: TestReconcile/skip_ingress_not_matching_class_key (0.02s)
I1210 08:06:11.640]     --- PASS: TestReconcile/create_VirtualService_matching_ClusterIngress (0.04s)
I1210 08:06:11.640]     --- PASS: TestReconcile/reconcile_VirtualService_to_match_desired_one (0.02s)
I1210 08:06:11.640] === RUN   TestGlobalResyncOnUpdateGatewayConfigMap
I1210 08:06:11.641] E1210 08:05:25.075384   11009 event.go:259] Could not construct reference to: '&v1alpha1.ClusterIngress{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"config-update", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"serving.knative.dev/route":"test-route", "serving.knative.dev/routeNamespace":"test-ns"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Spec:v1alpha1.IngressSpec{Generation:1234, TLS:[]v1alpha1.ClusterIngressTLS(nil), Rules:[]v1alpha1.ClusterIngressRule{v1alpha1.ClusterIngressRule{Hosts:[]string{"domain.com", "test-route.test-ns.svc.cluster.local", "test-route.test-ns.svc", "test-route.test-ns"}, HTTP:(*v1alpha1.HTTPClusterIngressRuleValue)(0xc4201340a0)}}}, Status:v1alpha1.IngressStatus{Conditions:v1alpha1.Conditions{v1alpha1.Condition{Type:"LoadBalancerReady", Status:"True", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}}, Reason:"", Message:""}, v1alpha1.Condition{Type:"NetworkConfigured", Status:"True", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}}, Reason:"", Message:""}, v1alpha1.Condition{Type:"Ready", Status:"True", Severity:"", LastTransitionTime:apis.VolatileTime{Inner:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}}, Reason:"", Message:""}}, LoadBalancer:(*v1alpha1.LoadBalancerStatus)(0xc4201340c0)}}' due to: 'selfLink was empty, can't make reference'. Will not report event: 'Normal' 'Created' 'Created VirtualService "config-update"'
... skipping 50 lines ...
I1210 08:06:11.650]     --- PASS: TestNamer/VirtualService (0.00s)
I1210 08:06:11.650] PASS
I1210 08:06:11.651] ok  	github.com/knative/serving/pkg/reconciler/v1alpha1/clusteringress/resources/names	1.385s
I1210 08:06:11.651] === RUN   TestReconcile
I1210 08:06:11.651] === RUN   TestReconcile/bad_workqueue_key
I1210 08:06:11.651] === RUN   TestReconcile/key_not_found
I1210 08:06:11.651] {"level":"error","ts":1544429130.3572636,"logger":"fallback","caller":"configuration/configuration.go:122","msg":"configuration \"foo/not-found\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/configuration.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/configuration/configuration.go:122\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.652] === RUN   TestReconcile/create_revision_matching_generation
I1210 08:06:11.653] {"level":"info","ts":1544429130.3874466,"logger":"fallback","caller":"configuration/configuration.go:271","msg":"Created Revision:\n&{TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:no-revisions-yet-01234 GenerateName: Namespace:foo SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[serving.knative.dev/configuration:no-revisions-yet serving.knative.dev/service: serving.knative.dev/configurationGeneration:1234] Annotations:map[] OwnerReferences:[{APIVersion:serving.knative.dev/v1alpha1 Kind:Configuration Name:no-revisions-yet UID: Controller:0xc420046778 BlockOwnerDeletion:0xc420046779}] Initializers:nil Finalizers:[] ClusterName:} Spec:{Generation:0 DeprecatedServingState: ConcurrencyModel: ContainerConcurrency:0 ServiceAccountName: BuildName: BuildRef:nil Container:{Name: Image:busybox Command:[] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[] VolumeDevices:[] LivenessProbe:nil ReadinessProbe:nil Lifecycle:nil TerminationMessagePath: TerminationMessagePolicy: ImagePullPolicy: SecurityContext:nil Stdin:false StdinOnce:false TTY:false} TimeoutSeconds:&Duration{Duration:1m0s,}} Status:{ServiceName: Conditions:[] ObservedGeneration:0 LogURL: ImageDigest:}}"}
I1210 08:06:11.653] {"level":"info","ts":1544429130.3877492,"logger":"fallback","caller":"configuration/configuration.go:188","msg":"Revision \"no-revisions-yet-01234\" of configuration \"no-revisions-yet\" is not ready"}
I1210 08:06:11.653] === RUN   TestReconcile/webhook_validation_failure
I1210 08:06:11.654] {"level":"error","ts":1544429130.4177527,"logger":"fallback","caller":"configuration/configuration.go:165","msg":"Failed to create Revision \"validation-failure-01234\": invalid value \"Bogus\": spec.concurrencyModel","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/configuration.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/configuration/configuration.go:165\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/configuration.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/configuration/configuration.go:133\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.654] {"level":"warn","ts":1544429130.4182715,"logger":"fallback","caller":"configuration/configuration.go:140","msg":"Failed to update configuration status{error 25 0  invalid value \"Bogus\": spec.revisionTemplate.spec.concurrencyModel}"}
I1210 08:06:11.654] === RUN   TestReconcile/elide_build_when_a_matching_one_already_exists
I1210 08:06:11.655] {"level":"info","ts":1544429130.4468174,"logger":"fallback","caller":"configuration/configuration.go:271","msg":"Created Revision:\n&{TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:need-rev-and-build-99998 GenerateName: Namespace:foo SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[serving.knative.dev/service: serving.knative.dev/configurationGeneration:99998 serving.knative.dev/configuration:need-rev-and-build] Annotations:map[] OwnerReferences:[{APIVersion:serving.knative.dev/v1alpha1 Kind:Configuration Name:need-rev-and-build UID: Controller:0xc420472570 BlockOwnerDeletion:0xc420472571}] Initializers:nil Finalizers:[] ClusterName:} Spec:{Generation:0 DeprecatedServingState: ConcurrencyModel: ContainerConcurrency:0 ServiceAccountName: BuildName: BuildRef:&ObjectReference{Kind:Build,Namespace:,Name:something-else-12345,UID:,APIVersion:testing.build.knative.dev/v1alpha1,ResourceVersion:,FieldPath:,} Container:{Name: Image:busybox Command:[] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[] VolumeDevices:[] LivenessProbe:nil ReadinessProbe:nil Lifecycle:nil TerminationMessagePath: TerminationMessagePolicy: ImagePullPolicy: SecurityContext:nil Stdin:false StdinOnce:false TTY:false} TimeoutSeconds:&Duration{Duration:1m0s,}} Status:{ServiceName: Conditions:[] ObservedGeneration:0 LogURL: ImageDigest:}}"}
I1210 08:06:11.655] {"level":"info","ts":1544429130.447256,"logger":"fallback","caller":"configuration/configuration.go:188","msg":"Revision \"need-rev-and-build-99998\" of configuration \"need-rev-and-build\" is not ready"}
I1210 08:06:11.655] === RUN   TestReconcile/create_revision_matching_generation_with_build
I1210 08:06:11.656] {"level":"info","ts":1544429130.4974756,"logger":"fallback","caller":"configuration/configuration.go:255","msg":"Created Build:\nneed-rev-and-build-99998"}
I1210 08:06:11.657] {"level":"info","ts":1544429130.498529,"logger":"fallback","caller":"configuration/configuration.go:271","msg":"Created Revision:\n&{TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:need-rev-and-build-99998 GenerateName: Namespace:foo SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[serving.knative.dev/configurationGeneration:99998 serving.knative.dev/configuration:need-rev-and-build serving.knative.dev/service:] Annotations:map[] OwnerReferences:[{APIVersion:serving.knative.dev/v1alpha1 Kind:Configuration Name:need-rev-and-build UID: Controller:0xc420414538 BlockOwnerDeletion:0xc420414539}] Initializers:nil Finalizers:[] ClusterName:} Spec:{Generation:0 DeprecatedServingState: ConcurrencyModel: ContainerConcurrency:0 ServiceAccountName: BuildName: BuildRef:&ObjectReference{Kind:Build,Namespace:,Name:need-rev-and-build-99998,UID:,APIVersion:testing.build.knative.dev/v1alpha1,ResourceVersion:,FieldPath:,} Container:{Name: Image:busybox Command:[] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[] VolumeDevices:[] LivenessProbe:nil ReadinessProbe:nil Lifecycle:nil TerminationMessagePath: TerminationMessagePolicy: ImagePullPolicy: SecurityContext:nil Stdin:false StdinOnce:false TTY:false} TimeoutSeconds:&Duration{Duration:1m0s,}} Status:{ServiceName: Conditions:[] ObservedGeneration:0 LogURL: ImageDigest:}}"}
... skipping 2 lines ...
I1210 08:06:11.657] {"level":"info","ts":1544429130.5427294,"logger":"fallback","caller":"configuration/configuration.go:188","msg":"Revision \"matching-revision-not-done-05432\" of configuration \"matching-revision-not-done\" is not ready"}
I1210 08:06:11.658] === RUN   TestReconcile/reconcile_revision_matching_generation_(ready:_true)
I1210 08:06:11.658] {"level":"info","ts":1544429130.5978158,"logger":"fallback","caller":"configuration/configuration.go:191","msg":"Revision \"matching-revision-done-05555\" of configuration \"matching-revision-done\" is ready"}
I1210 08:06:11.658] === RUN   TestReconcile/reconcile_revision_matching_generation_(ready:_true,_idempotent)
I1210 08:06:11.658] {"level":"info","ts":1544429130.623258,"logger":"fallback","caller":"configuration/configuration.go:191","msg":"Revision \"matching-revision-done-idempotent-05566\" of configuration \"matching-revision-done-idempotent\" is ready"}
I1210 08:06:11.658] === RUN   TestReconcile/reconcile_revision_matching_generation_(ready:_false)
I1210 08:06:11.659] {"level":"info","ts":1544429130.6481287,"logger":"fallback","caller":"configuration/configuration.go:207","msg":"Revision \"matching-revision-failed-05555\" of configuration \"matching-revision-failed\" has failed"}
I1210 08:06:11.659] === RUN   TestReconcile/reconcile_revision_matching_generation_(ready:_bad)
I1210 08:06:11.660] {"level":"error","ts":1544429130.6811476,"logger":"fallback","caller":"configuration/configuration.go:216","msg":"Error reconciling Configuration \"bad-condition\": unrecognized condition status: Bad on revision \"bad-condition-05555\"","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/configuration.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/configuration/configuration.go:216\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/configuration.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/configuration/configuration.go:133\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.660] === RUN   TestReconcile/failure_creating_build
I1210 08:06:11.660] {"level":"error","ts":1544429130.7064357,"logger":"fallback","caller":"configuration/configuration.go:165","msg":"Failed to create Revision \"create-build-failure-99998\": inducing failure for create builds","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/configuration.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/configuration/configuration.go:165\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/configuration.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/configuration/configuration.go:133\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.661] === RUN   TestReconcile/failure_creating_revision
I1210 08:06:11.661] {"level":"error","ts":1544429130.7310114,"logger":"fallback","caller":"configuration/configuration.go:165","msg":"Failed to create Revision \"create-revision-failure-99998\": inducing failure for create revisions","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/configuration.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/configuration/configuration.go:165\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/configuration.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/configuration/configuration.go:133\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.662] === RUN   TestReconcile/failure_updating_configuration_status
I1210 08:06:11.662] {"level":"info","ts":1544429130.76435,"logger":"fallback","caller":"configuration/configuration.go:271","msg":"Created Revision:\n&{TypeMeta:{Kind: APIVersion:} ObjectMeta:{Name:update-config-failure-01234 GenerateName: Namespace:foo SelfLink: UID: ResourceVersion: Generation:0 CreationTimestamp:0001-01-01 00:00:00 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[serving.knative.dev/service: serving.knative.dev/configurationGeneration:1234 serving.knative.dev/configuration:update-config-failure] Annotations:map[] OwnerReferences:[{APIVersion:serving.knative.dev/v1alpha1 Kind:Configuration Name:update-config-failure UID: Controller:0xc420431090 BlockOwnerDeletion:0xc420431091}] Initializers:nil Finalizers:[] ClusterName:} Spec:{Generation:0 DeprecatedServingState: ConcurrencyModel: ContainerConcurrency:0 ServiceAccountName: BuildName: BuildRef:nil Container:{Name: Image:busybox Command:[] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[] VolumeDevices:[] LivenessProbe:nil ReadinessProbe:nil Lifecycle:nil TerminationMessagePath: TerminationMessagePolicy: ImagePullPolicy: SecurityContext:nil Stdin:false StdinOnce:false TTY:false} TimeoutSeconds:&Duration{Duration:1m0s,}} Status:{ServiceName: Conditions:[] ObservedGeneration:0 LogURL: ImageDigest:}}"}
I1210 08:06:11.663] {"level":"info","ts":1544429130.7647176,"logger":"fallback","caller":"configuration/configuration.go:188","msg":"Revision \"update-config-failure-01234\" of configuration \"update-config-failure\" is not ready"}
I1210 08:06:11.663] {"level":"warn","ts":1544429130.7652915,"logger":"fallback","caller":"configuration/configuration.go:140","msg":"Failed to update configuration status{error 25 0  inducing failure for update configurations}"}
I1210 08:06:11.663] === RUN   TestReconcile/failed_revision_recovers
I1210 08:06:11.663] {"level":"info","ts":1544429130.8090088,"logger":"fallback","caller":"configuration/configuration.go:191","msg":"Revision \"revision-recovers-01337\" of configuration \"revision-recovers\" is ready"}
I1210 08:06:11.663] --- PASS: TestReconcile (0.50s)
I1210 08:06:11.663]     --- PASS: TestReconcile/bad_workqueue_key (0.02s)
I1210 08:06:11.664]     	logger.go:130: 2018-12-10T08:05:30.346Z	ERROR	TestReconcile/bad_workqueue_key.configuration-controller	configuration/configuration.go:111	invalid resource key: too/many/parts	{"knative.dev/controller": "configuration-controller"}
I1210 08:06:11.664]     --- PASS: TestReconcile/key_not_found (0.01s)
I1210 08:06:11.664]     --- PASS: TestReconcile/create_revision_matching_generation (0.04s)
I1210 08:06:11.664]     --- PASS: TestReconcile/webhook_validation_failure (0.02s)
I1210 08:06:11.664]     --- PASS: TestReconcile/elide_build_when_a_matching_one_already_exists (0.03s)
I1210 08:06:11.664]     --- PASS: TestReconcile/create_revision_matching_generation_with_build (0.05s)
I1210 08:06:11.665]     --- PASS: TestReconcile/reconcile_revision_matching_generation_(ready:_unknown) (0.03s)
... skipping 94 lines ...
I1210 08:06:11.680] === RUN   TestReconcile/label_runLatest_configuration
I1210 08:06:11.681] {"level":"info","ts":1544429136.7374783,"logger":"fallback","caller":"labeler/labeler.go:99","msg":"Time to sync the labels: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"first-reconcile\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{Generation:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Domain:\"\", DomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{Name:\"\", RevisionName:\"the-config-00001\", ConfigurationName:\"\", Percent:100}}, Conditions:v1alpha1.Conditions(nil), ObservedGeneration:0}}"}
I1210 08:06:11.681] === RUN   TestReconcile/steady_state
I1210 08:06:11.682] {"level":"info","ts":1544429136.801874,"logger":"fallback","caller":"labeler/labeler.go:99","msg":"Time to sync the labels: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"steady-state\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{Generation:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Domain:\"\", DomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{Name:\"\", RevisionName:\"the-config-00001\", ConfigurationName:\"\", Percent:100}}, Conditions:v1alpha1.Conditions(nil), ObservedGeneration:0}}"}
I1210 08:06:11.682] === RUN   TestReconcile/failure_adding_label
I1210 08:06:11.683] {"level":"info","ts":1544429136.8686497,"logger":"fallback","caller":"labeler/labeler.go:99","msg":"Time to sync the labels: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"add-label-failure\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{Generation:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Domain:\"\", DomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{Name:\"\", RevisionName:\"the-config-00001\", ConfigurationName:\"\", Percent:100}}, Conditions:v1alpha1.Conditions(nil), ObservedGeneration:0}}"}
I1210 08:06:11.683] {"level":"error","ts":1544429136.8696454,"logger":"fallback","caller":"labeler/labels.go:100","msg":"Failed to add route label to configuration \"the-config\": inducing failure for patch configurations","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/labeler.(*Reconciler).setLabelForGivenConfigurations\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/labeler/labels.go:100\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/labeler.(*Reconciler).syncLabels\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/labeler/labels.go:53\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/labeler.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/labeler/labeler.go:100\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.683] === RUN   TestReconcile/label_config_with_incorrect_label
I1210 08:06:11.684] {"level":"info","ts":1544429136.9188738,"logger":"fallback","caller":"labeler/labeler.go:99","msg":"Time to sync the labels: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"the-route\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{Generation:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Domain:\"\", DomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{Name:\"\", RevisionName:\"the-config-00001\", ConfigurationName:\"\", Percent:100}}, Conditions:v1alpha1.Conditions(nil), ObservedGeneration:0}}"}
I1210 08:06:11.684] === RUN   TestReconcile/change_configurations
I1210 08:06:11.685] {"level":"info","ts":1544429136.9468231,"logger":"fallback","caller":"labeler/labeler.go:99","msg":"Time to sync the labels: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"config-change\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{Generation:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Domain:\"\", DomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{Name:\"\", RevisionName:\"new-config-00001\", ConfigurationName:\"\", Percent:100}}, Conditions:v1alpha1.Conditions(nil), ObservedGeneration:0}}"}
I1210 08:06:11.685] === RUN   TestReconcile/delete_route
I1210 08:06:11.685] {"level":"info","ts":1544429136.9966588,"logger":"fallback","caller":"labeler/labeler.go:91","msg":"Clearing labels for deleted Route: \"default/delete-route\""}
I1210 08:06:11.686] === RUN   TestReconcile/failure_while_removing_an_annotation_should_return_an_error
I1210 08:06:11.686] {"level":"info","ts":1544429137.023715,"logger":"fallback","caller":"labeler/labeler.go:99","msg":"Time to sync the labels: &v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:\"\", APIVersion:\"\"}, ObjectMeta:v1.ObjectMeta{Name:\"delete-label-failure\", GenerateName:\"\", Namespace:\"default\", SelfLink:\"\", UID:\"\", ResourceVersion:\"\", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:\"\"}, Spec:v1alpha1.RouteSpec{Generation:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Domain:\"\", DomainInternal:\"\", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget{v1alpha1.TrafficTarget{Name:\"\", RevisionName:\"new-config-00001\", ConfigurationName:\"\", Percent:100}}, Conditions:v1alpha1.Conditions(nil), ObservedGeneration:0}}"}
I1210 08:06:11.687] {"level":"error","ts":1544429137.0245876,"logger":"fallback","caller":"labeler/labels.go:132","msg":"Failed to remove route label to configuration \"old-config\": inducing failure for patch configurations","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/labeler.(*Reconciler).deleteLabelForOutsideOfGivenConfigurations\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/labeler/labels.go:132\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/labeler.(*Reconciler).syncLabels\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/labeler/labels.go:50\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/labeler.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/labeler/labeler.go:100\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.687] --- PASS: TestReconcile (0.38s)
I1210 08:06:11.687]     --- PASS: TestReconcile/bad_workqueue_key (0.02s)
I1210 08:06:11.687]     	logger.go:130: 2018-12-10T08:05:36.682Z	ERROR	TestReconcile/bad_workqueue_key.labeler-controller	labeler/labeler.go:83	invalid resource key: too/many/parts	{"knative.dev/controller": "labeler-controller"}
I1210 08:06:11.687]     --- PASS: TestReconcile/key_not_found (0.03s)
I1210 08:06:11.688]     --- PASS: TestReconcile/label_runLatest_configuration (0.04s)
I1210 08:06:11.688]     --- PASS: TestReconcile/steady_state (0.04s)
I1210 08:06:11.688]     --- PASS: TestReconcile/failure_adding_label (0.04s)
I1210 08:06:11.688]     --- PASS: TestReconcile/label_config_with_incorrect_label (0.04s)
I1210 08:06:11.688]     --- PASS: TestReconcile/change_configurations (0.02s)
... skipping 44 lines ...
I1210 08:06:11.694] === RUN   TestNewRevisionCallsSyncHandler
I1210 08:06:11.694] --- PASS: TestNewRevisionCallsSyncHandler (1.02s)
I1210 08:06:11.694] 	logger.go:130: 2018-12-10T08:05:41.622Z	DEBUG	TestNewRevisionCallsSyncHandler.revision-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.694] 	logger.go:130: 2018-12-10T08:05:41.632Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller	revision/revision.go:146	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.694] 	logger.go:130: 2018-12-10T08:05:41.633Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller.config-store	configmap/store.go:166	revision config "config-controller" config was added or updated: &{queueImage map[]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.695] 	logger.go:130: 2018-12-10T08:05:41.633Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.695] 	logger.go:130: 2018-12-10T08:05:41.634Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I1210 08:06:11.695] 		"outputPaths": ["stdout"],
I1210 08:06:11.695] 		"errorOutputPaths": ["stderr"],
I1210 08:06:11.695] 		"encoding": "json"} map[queueproxy:info]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.696] 	logger.go:130: 2018-12-10T08:05:41.634Z	INFO	TestNewRevisionCallsSyncHandler.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I1210 08:06:11.696] 		<match **>
I1210 08:06:11.696] 		  @type elasticsearch
... skipping 36 lines ...
I1210 08:06:11.702] --- PASS: TestNewResolverTransport (2.27s)
I1210 08:06:11.702]     --- PASS: TestNewResolverTransport/cases[0] (0.74s)
I1210 08:06:11.702]     --- PASS: TestNewResolverTransport/cases[1] (0.84s)
I1210 08:06:11.702]     --- PASS: TestNewResolverTransport/cases[2] (0.69s)
I1210 08:06:11.702] === RUN   TestResolutionFailed
I1210 08:06:11.702] {"level":"info","ts":1544429158.652287,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.703] {"level":"error","ts":1544429158.6526616,"logger":"fallback","caller":"revision/revision.go:385","msg":"Failed to reconcile image digest: {error 25 0  I am the expected error message, hear me ROAR!}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:385\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.createRevision\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision_test.go:243\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.TestResolutionFailed\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision_test.go:373\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.703] --- PASS: TestResolutionFailed (0.68s)
I1210 08:06:11.703] 	logger.go:130: 2018-12-10T08:05:58.648Z	DEBUG	TestResolutionFailed.revision-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.703] 	logger.go:130: 2018-12-10T08:05:58.649Z	INFO	TestResolutionFailed.revision-controller	revision/revision.go:146	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.703] 	logger.go:130: 2018-12-10T08:05:58.650Z	INFO	TestResolutionFailed.revision-controller.config-store	configmap/store.go:166	revision config "config-controller" config was added or updated: &{queueImage map[]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.703] 	logger.go:130: 2018-12-10T08:05:58.650Z	INFO	TestResolutionFailed.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.703] 	logger.go:130: 2018-12-10T08:05:58.651Z	INFO	TestResolutionFailed.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I1210 08:06:11.703] 		"outputPaths": ["stdout"],
I1210 08:06:11.704] 		"errorOutputPaths": ["stderr"],
I1210 08:06:11.704] 		"encoding": "json"} map[queueproxy:info]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.704] 	logger.go:130: 2018-12-10T08:05:58.651Z	INFO	TestResolutionFailed.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I1210 08:06:11.705] 		<match **>
I1210 08:06:11.705] 		  @type elasticsearch
... skipping 11 lines ...
I1210 08:06:11.707] {"level":"info","ts":1544429159.4650357,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.707] {"level":"info","ts":1544429159.4654887,"logger":"fallback","caller":"revision/reconcile_resources.go:173","msg":"Endpoints not created yet \"test-rev-service\"","knative.dev/k8sservice":"test-rev-service"}
I1210 08:06:11.707] --- PASS: TestUpdateRevWithWithUpdatedLoggingURL (0.81s)
I1210 08:06:11.707] 	logger.go:130: 2018-12-10T08:05:59.454Z	DEBUG	TestUpdateRevWithWithUpdatedLoggingURL.revision-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.707] 	logger.go:130: 2018-12-10T08:05:59.456Z	INFO	TestUpdateRevWithWithUpdatedLoggingURL.revision-controller	revision/revision.go:146	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.707] 	logger.go:130: 2018-12-10T08:05:59.456Z	INFO	TestUpdateRevWithWithUpdatedLoggingURL.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.708] 	logger.go:130: 2018-12-10T08:05:59.457Z	INFO	TestUpdateRevWithWithUpdatedLoggingURL.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I1210 08:06:11.708] 		"outputPaths": ["stdout"],
I1210 08:06:11.708] 		"errorOutputPaths": ["stderr"],
I1210 08:06:11.708] 		"encoding": "json"} map[queueproxy:info]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.708] 	logger.go:130: 2018-12-10T08:05:59.458Z	INFO	TestUpdateRevWithWithUpdatedLoggingURL.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I1210 08:06:11.708] 		<match **>
I1210 08:06:11.708] 		  @type elasticsearch
... skipping 23 lines ...
I1210 08:06:11.711] {"level":"info","ts":1544429160.061294,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.712] --- PASS: TestMarkRevReadyUponEndpointBecomesReady (0.60s)
I1210 08:06:11.712] 	logger.go:130: 2018-12-10T08:06:00.055Z	DEBUG	TestMarkRevReadyUponEndpointBecomesReady.revision-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.712] 	logger.go:130: 2018-12-10T08:06:00.056Z	INFO	TestMarkRevReadyUponEndpointBecomesReady.revision-controller	revision/revision.go:146	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.712] 	logger.go:130: 2018-12-10T08:06:00.056Z	INFO	TestMarkRevReadyUponEndpointBecomesReady.revision-controller.config-store	configmap/store.go:166	revision config "config-controller" config was added or updated: &{queueImage map[]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.713] 	logger.go:130: 2018-12-10T08:06:00.057Z	INFO	TestMarkRevReadyUponEndpointBecomesReady.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.713] 	logger.go:130: 2018-12-10T08:06:00.057Z	INFO	TestMarkRevReadyUponEndpointBecomesReady.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I1210 08:06:11.713] 		"outputPaths": ["stdout"],
I1210 08:06:11.713] 		"errorOutputPaths": ["stderr"],
I1210 08:06:11.713] 		"encoding": "json"} map[queueproxy:info]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.713] 	logger.go:130: 2018-12-10T08:06:00.057Z	INFO	TestMarkRevReadyUponEndpointBecomesReady.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I1210 08:06:11.713] 		<match **>
I1210 08:06:11.714] 		  @type elasticsearch
... skipping 13 lines ...
I1210 08:06:11.717] {"level":"info","ts":1544429160.711392,"logger":"fallback","caller":"revision/reconcile_resources.go:107","msg":"Created kpa \"test-rev\""}
I1210 08:06:11.717] --- PASS: TestNoQueueSidecarImageUpdateFail (0.65s)
I1210 08:06:11.717] 	logger.go:130: 2018-12-10T08:06:00.706Z	DEBUG	TestNoQueueSidecarImageUpdateFail.revision-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.718] 	logger.go:130: 2018-12-10T08:06:00.707Z	INFO	TestNoQueueSidecarImageUpdateFail.revision-controller	revision/revision.go:146	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.719] 	logger.go:130: 2018-12-10T08:06:00.707Z	INFO	TestNoQueueSidecarImageUpdateFail.revision-controller.config-store	configmap/store.go:166	revision config "config-controller" config was added or updated: &{queueImage map[]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.719] 	logger.go:130: 2018-12-10T08:06:00.708Z	INFO	TestNoQueueSidecarImageUpdateFail.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.719] 	logger.go:130: 2018-12-10T08:06:00.708Z	INFO	TestNoQueueSidecarImageUpdateFail.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I1210 08:06:11.719] 		"outputPaths": ["stdout"],
I1210 08:06:11.719] 		"errorOutputPaths": ["stderr"],
I1210 08:06:11.720] 		"encoding": "json"} map[queueproxy:info]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.720] 	logger.go:130: 2018-12-10T08:06:00.708Z	INFO	TestNoQueueSidecarImageUpdateFail.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I1210 08:06:11.720] 		<match **>
I1210 08:06:11.720] 		  @type elasticsearch
I1210 08:06:11.720] 		</match>
I1210 08:06:11.720] 		 }	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.721] 	logger.go:130: 2018-12-10T08:06:00.709Z	INFO	TestNoQueueSidecarImageUpdateFail.revision-controller.config-store	configmap/store.go:166	revision config "config-autoscaler" config was added or updated: &{false false 0.5 10 1 5m0s 10s 2s 30s}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.721] 	logger.go:130: 2018-12-10T08:06:00.709Z	ERROR	TestNoQueueSidecarImageUpdateFail.revision-controller.config-store	configmap/store.go:159	Error updating revision config "config-controller": "Queue sidecar image is missing"	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.721] === RUN   TestIstioOutboundIPRangesInjection
I1210 08:06:11.721] {"level":"info","ts":1544429161.360559,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.721] {"level":"info","ts":1544429161.361369,"logger":"fallback","caller":"revision/reconcile_resources.go:57","msg":"Created deployment \"test-rev-deployment\"","knative.dev/deployment":"test-rev-deployment"}
I1210 08:06:11.722] {"level":"info","ts":1544429161.3616,"logger":"fallback","caller":"revision/reconcile_resources.go:84","msg":"Created image cache \"test-rev-cache\"","knative.dev/deployment":"test-rev-deployment"}
I1210 08:06:11.722] {"level":"info","ts":1544429161.3619695,"logger":"fallback","caller":"revision/reconcile_resources.go:145","msg":"Created Service \"test-rev-service\"","knative.dev/k8sservice":"test-rev-service"}
I1210 08:06:11.722] {"level":"info","ts":1544429161.3620987,"logger":"fallback","caller":"revision/reconcile_resources.go:173","msg":"Endpoints not created yet \"test-rev-service\"","knative.dev/k8sservice":"test-rev-service"}
... skipping 28 lines ...
I1210 08:06:11.728] {"level":"info","ts":1544429164.172421,"logger":"fallback","caller":"revision/reconcile_resources.go:225","msg":"Created fluentd configmap: \"test-rev-fluentd\""}
I1210 08:06:11.729] {"level":"info","ts":1544429164.1726103,"logger":"fallback","caller":"revision/reconcile_resources.go:107","msg":"Created kpa \"test-rev\""}
I1210 08:06:11.729] --- PASS: TestIstioOutboundIPRangesInjection (3.46s)
I1210 08:06:11.729] 	logger.go:130: 2018-12-10T08:06:01.355Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.729] 	logger.go:130: 2018-12-10T08:06:01.357Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller	revision/revision.go:146	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.729] 	logger.go:130: 2018-12-10T08:06:01.357Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.730] 	logger.go:130: 2018-12-10T08:06:01.358Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I1210 08:06:11.730] 		"outputPaths": ["stdout"],
I1210 08:06:11.730] 		"errorOutputPaths": ["stderr"],
I1210 08:06:11.730] 		"encoding": "json"} map[queueproxy:info]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.730] 	logger.go:130: 2018-12-10T08:06:01.358Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I1210 08:06:11.730] 		<match **>
I1210 08:06:11.731] 		  @type elasticsearch
... skipping 2 lines ...
I1210 08:06:11.731] 	logger.go:130: 2018-12-10T08:06:01.358Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-autoscaler" config was added or updated: &{false false 0.5 10 1 5m0s 10s 2s 30s}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.731] 	logger.go:130: 2018-12-10T08:06:01.359Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-controller" config was added or updated: &{queueImage map[]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.732] 	logger.go:130: 2018-12-10T08:06:01.359Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{10.10.10.0/24}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.732] 	logger.go:130: 2018-12-10T08:06:01.965Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.732] 	logger.go:130: 2018-12-10T08:06:01.967Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller	revision/revision.go:146	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.732] 	logger.go:130: 2018-12-10T08:06:01.968Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.733] 	logger.go:130: 2018-12-10T08:06:01.968Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I1210 08:06:11.733] 		"outputPaths": ["stdout"],
I1210 08:06:11.733] 		"errorOutputPaths": ["stderr"],
I1210 08:06:11.733] 		"encoding": "json"} map[queueproxy:info]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.733] 	logger.go:130: 2018-12-10T08:06:01.968Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I1210 08:06:11.733] 		<match **>
I1210 08:06:11.733] 		  @type elasticsearch
... skipping 2 lines ...
I1210 08:06:11.734] 	logger.go:130: 2018-12-10T08:06:01.969Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-autoscaler" config was added or updated: &{false false 0.5 10 1 5m0s 10s 2s 30s}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.734] 	logger.go:130: 2018-12-10T08:06:01.969Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-controller" config was added or updated: &{queueImage map[]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.734] 	logger.go:130: 2018-12-10T08:06:01.970Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{10.10.10.0/24,10.240.10.0/14,192.192.10.0/16}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.735] 	logger.go:130: 2018-12-10T08:06:02.775Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.735] 	logger.go:130: 2018-12-10T08:06:02.777Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller	revision/revision.go:146	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.735] 	logger.go:130: 2018-12-10T08:06:02.777Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.735] 	logger.go:130: 2018-12-10T08:06:02.778Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I1210 08:06:11.736] 		"outputPaths": ["stdout"],
I1210 08:06:11.736] 		"errorOutputPaths": ["stderr"],
I1210 08:06:11.736] 		"encoding": "json"} map[queueproxy:info]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.736] 	logger.go:130: 2018-12-10T08:06:02.778Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I1210 08:06:11.736] 		<match **>
I1210 08:06:11.736] 		  @type elasticsearch
I1210 08:06:11.736] 		</match>
I1210 08:06:11.737] 		 }	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.737] 	logger.go:130: 2018-12-10T08:06:02.780Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-autoscaler" config was added or updated: &{false false 0.5 10 1 5m0s 10s 2s 30s}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.737] 	logger.go:130: 2018-12-10T08:06:02.780Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-controller" config was added or updated: &{queueImage map[]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.737] 	logger.go:130: 2018-12-10T08:06:02.781Z	ERROR	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:159	Error updating revision config "config-network": "invalid CIDR address: 10.10.10.10/33"	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.738] 	logger.go:130: 2018-12-10T08:06:03.502Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.738] 	logger.go:130: 2018-12-10T08:06:03.503Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller	revision/revision.go:146	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.738] 	logger.go:130: 2018-12-10T08:06:03.504Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.738] 	logger.go:130: 2018-12-10T08:06:03.504Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I1210 08:06:11.738] 		"outputPaths": ["stdout"],
I1210 08:06:11.739] 		"errorOutputPaths": ["stderr"],
I1210 08:06:11.739] 		"encoding": "json"} map[queueproxy:info]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.739] 	logger.go:130: 2018-12-10T08:06:03.505Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I1210 08:06:11.739] 		<match **>
I1210 08:06:11.739] 		  @type elasticsearch
... skipping 2 lines ...
I1210 08:06:11.740] 	logger.go:130: 2018-12-10T08:06:03.505Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-autoscaler" config was added or updated: &{false false 0.5 10 1 5m0s 10s 2s 30s}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.740] 	logger.go:130: 2018-12-10T08:06:03.506Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-controller" config was added or updated: &{queueImage map[]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.740] 	logger.go:130: 2018-12-10T08:06:03.506Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.741] 	logger.go:130: 2018-12-10T08:06:04.167Z	DEBUG	TestIstioOutboundIPRangesInjection.revision-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.741] 	logger.go:130: 2018-12-10T08:06:04.168Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller	revision/revision.go:146	Setting up event handlers	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.741] 	logger.go:130: 2018-12-10T08:06:04.168Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.741] 	logger.go:130: 2018-12-10T08:06:04.169Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-logging" config was added or updated: &{{"level": "error",
I1210 08:06:11.742] 		"outputPaths": ["stdout"],
I1210 08:06:11.742] 		"errorOutputPaths": ["stderr"],
I1210 08:06:11.742] 		"encoding": "json"} map[queueproxy:info]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.742] 	logger.go:130: 2018-12-10T08:06:04.169Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-observability" config was added or updated: &{true fluentdImage 
I1210 08:06:11.742] 		<match **>
I1210 08:06:11.742] 		  @type elasticsearch
... skipping 3 lines ...
I1210 08:06:11.743] 	logger.go:130: 2018-12-10T08:06:04.170Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-controller" config was added or updated: &{queueImage map[]}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.744] 	logger.go:130: 2018-12-10T08:06:04.170Z	INFO	TestIstioOutboundIPRangesInjection.revision-controller.config-store	configmap/store.go:166	revision config "config-network" config was added or updated: &{10.10.10.0/24}	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.744] === RUN   TestReconcile
I1210 08:06:11.744] === RUN   TestReconcile/bad_workqueue_key
I1210 08:06:11.744] === RUN   TestReconcile/key_not_found
I1210 08:06:11.744] {"level":"info","ts":1544429164.2256997,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.745] {"level":"error","ts":1544429164.2259283,"logger":"fallback","caller":"revision/revision.go:244","msg":"revision \"foo/not-found\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:244\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.745] === RUN   TestReconcile/first_revision_reconciliation
I1210 08:06:11.745] {"level":"info","ts":1544429164.2386386,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.745] {"level":"info","ts":1544429164.2392597,"logger":"fallback","caller":"revision/reconcile_resources.go:57","msg":"Created deployment \"first-reconcile-deployment\"","knative.dev/deployment":"first-reconcile-deployment"}
I1210 08:06:11.745] {"level":"info","ts":1544429164.2394454,"logger":"fallback","caller":"revision/reconcile_resources.go:84","msg":"Created image cache \"first-reconcile-cache\"","knative.dev/deployment":"first-reconcile-deployment"}
I1210 08:06:11.746] {"level":"info","ts":1544429164.239676,"logger":"fallback","caller":"revision/reconcile_resources.go:145","msg":"Created Service \"first-reconcile-service\"","knative.dev/k8sservice":"first-reconcile-service"}
I1210 08:06:11.746] {"level":"info","ts":1544429164.2398067,"logger":"fallback","caller":"revision/reconcile_resources.go:173","msg":"Endpoints not created yet \"first-reconcile-service\"","knative.dev/k8sservice":"first-reconcile-service"}
I1210 08:06:11.746] {"level":"info","ts":1544429164.2400885,"logger":"fallback","caller":"revision/reconcile_resources.go:107","msg":"Created kpa \"first-reconcile\""}
I1210 08:06:11.746] === RUN   TestReconcile/failure_updating_revision_status
I1210 08:06:11.746] {"level":"info","ts":1544429164.2951593,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.747] {"level":"info","ts":1544429164.2960694,"logger":"fallback","caller":"revision/reconcile_resources.go:57","msg":"Created deployment \"update-status-failure-deployment\"","knative.dev/deployment":"update-status-failure-deployment"}
I1210 08:06:11.747] {"level":"info","ts":1544429164.296371,"logger":"fallback","caller":"revision/reconcile_resources.go:84","msg":"Created image cache \"update-status-failure-cache\"","knative.dev/deployment":"update-status-failure-deployment"}
I1210 08:06:11.747] {"level":"info","ts":1544429164.2966726,"logger":"fallback","caller":"revision/reconcile_resources.go:145","msg":"Created Service \"update-status-failure-service\"","knative.dev/k8sservice":"update-status-failure-service"}
I1210 08:06:11.747] {"level":"info","ts":1544429164.296809,"logger":"fallback","caller":"revision/reconcile_resources.go:173","msg":"Endpoints not created yet \"update-status-failure-service\"","knative.dev/k8sservice":"update-status-failure-service"}
I1210 08:06:11.748] {"level":"warn","ts":1544429164.2971747,"logger":"fallback","caller":"revision/revision.go:261","msg":"Failed to update revision status{error 25 0  inducing failure for update revisions}"}
I1210 08:06:11.748] === RUN   TestReconcile/failure_creating_kpa
I1210 08:06:11.748] {"level":"info","ts":1544429164.3706605,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.748] {"level":"info","ts":1544429164.371656,"logger":"fallback","caller":"revision/reconcile_resources.go:57","msg":"Created deployment \"create-kpa-failure-deployment\"","knative.dev/deployment":"create-kpa-failure-deployment"}
I1210 08:06:11.749] {"level":"info","ts":1544429164.3719828,"logger":"fallback","caller":"revision/reconcile_resources.go:84","msg":"Created image cache \"create-kpa-failure-cache\"","knative.dev/deployment":"create-kpa-failure-deployment"}
I1210 08:06:11.749] {"level":"info","ts":1544429164.3723857,"logger":"fallback","caller":"revision/reconcile_resources.go:145","msg":"Created Service \"create-kpa-failure-service\"","knative.dev/k8sservice":"create-kpa-failure-service"}
I1210 08:06:11.749] {"level":"info","ts":1544429164.3725164,"logger":"fallback","caller":"revision/reconcile_resources.go:173","msg":"Endpoints not created yet \"create-kpa-failure-service\"","knative.dev/k8sservice":"create-kpa-failure-service"}
I1210 08:06:11.750] {"level":"error","ts":1544429164.3729682,"logger":"fallback","caller":"revision/reconcile_resources.go:104","msg":"Error creating KPA \"create-kpa-failure\": inducing failure for create podautoscalers","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcileKPA\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/reconcile_resources.go:104\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).(github.com/knative/serving/pkg/reconciler/v1alpha1/revision.reconcileKPA)-fm\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:380\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:384\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.751] {"level":"error","ts":1544429164.3733363,"logger":"fallback","caller":"revision/revision.go:385","msg":"Failed to reconcile KPA: {error 25 0  inducing failure for create podautoscalers}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:385\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.751] === RUN   TestReconcile/failure_creating_user_deployment
I1210 08:06:11.751] {"level":"info","ts":1544429164.4418156,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.752] {"level":"error","ts":1544429164.4426537,"logger":"fallback","caller":"revision/reconcile_resources.go:54","msg":"Error creating deployment \"create-user-deploy-failure-deployment\": inducing failure for create deployments","knative.dev/deployment":"create-user-deploy-failure-deployment","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcileDeployment\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/reconcile_resources.go:54\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).(github.com/knative/serving/pkg/reconciler/v1alpha1/revision.reconcileDeployment)-fm\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:370\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:384\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.752] {"level":"error","ts":1544429164.44314,"logger":"fallback","caller":"revision/revision.go:385","msg":"Failed to reconcile user deployment: {error 25 0  inducing failure for create deployments}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:385\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.753] === RUN   TestReconcile/failure_creating_user_service
I1210 08:06:11.753] {"level":"info","ts":1544429164.4964268,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.753] {"level":"info","ts":1544429164.4974585,"logger":"fallback","caller":"revision/reconcile_resources.go:57","msg":"Created deployment \"create-user-service-failure-deployment\"","knative.dev/deployment":"create-user-service-failure-deployment"}
I1210 08:06:11.753] {"level":"info","ts":1544429164.4978855,"logger":"fallback","caller":"revision/reconcile_resources.go:84","msg":"Created image cache \"create-user-service-failure-cache\"","knative.dev/deployment":"create-user-service-failure-deployment"}
I1210 08:06:11.754] {"level":"error","ts":1544429164.4983096,"logger":"fallback","caller":"revision/reconcile_resources.go:142","msg":"Error creating Service \"create-user-service-failure-service\": inducing failure for create services","knative.dev/k8sservice":"create-user-service-failure-service","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcileService\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/reconcile_resources.go:142\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).(github.com/knative/serving/pkg/reconciler/v1alpha1/revision.reconcileService)-fm\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:373\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:384\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.755] {"level":"error","ts":1544429164.4987073,"logger":"fallback","caller":"revision/revision.go:385","msg":"Failed to reconcile user k8s service: {error 25 0  inducing failure for create services}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:385\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.755] === RUN   TestReconcile/stable_revision_reconciliation
I1210 08:06:11.755] {"level":"info","ts":1544429164.5780075,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.756] {"level":"info","ts":1544429164.5787222,"logger":"fallback","caller":"revision/reconcile_resources.go:173","msg":"Endpoints not created yet \"stable-reconcile-service\"","knative.dev/k8sservice":"stable-reconcile-service"}
I1210 08:06:11.756] === RUN   TestReconcile/deactivated_revision_is_stable
I1210 08:06:11.756] {"level":"info","ts":1544429164.6183698,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.756] === RUN   TestReconcile/endpoint_is_created_(not_ready)
... skipping 10 lines ...
I1210 08:06:11.757] {"level":"info","ts":1544429164.8256085,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.758] {"level":"info","ts":1544429164.8262208,"logger":"fallback","caller":"revision/cruds.go:90","msg":"Reconciling service diff (-desired, +observed): {v1.ServiceSpec}.Ports:\n\t-: []v1.ServicePort{{Name: \"http\", Protocol: v1.Protocol(\"TCP\"), Port: 80, TargetPort: intstr.IntOrString{Type: intstr.Type(1), StrVal: \"queue-port\"}}}\n\t+: []v1.ServicePort(nil)\n{v1.ServiceSpec}.Selector:\n\t-: map[string]string{\"serving.knative.dev/revision\": \"fix-mutated-service\"}\n\t+: map[string]string(nil)\n"}
I1210 08:06:11.758] {"level":"info","ts":1544429164.826474,"logger":"fallback","caller":"revision/reconcile_resources.go:161","msg":"Updated Service \"fix-mutated-service-service\"","knative.dev/k8sservice":"fix-mutated-service-service"}
I1210 08:06:11.758] === RUN   TestReconcile/failure_updating_user_service
I1210 08:06:11.758] {"level":"info","ts":1544429164.8964148,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.759] {"level":"info","ts":1544429164.8973114,"logger":"fallback","caller":"revision/cruds.go:90","msg":"Reconciling service diff (-desired, +observed): {v1.ServiceSpec}.Ports:\n\t-: []v1.ServicePort{{Name: \"http\", Protocol: v1.Protocol(\"TCP\"), Port: 80, TargetPort: intstr.IntOrString{Type: intstr.Type(1), StrVal: \"queue-port\"}}}\n\t+: []v1.ServicePort(nil)\n{v1.ServiceSpec}.Selector:\n\t-: map[string]string{\"serving.knative.dev/revision\": \"update-user-svc-failure\"}\n\t+: map[string]string(nil)\n"}
I1210 08:06:11.760] {"level":"error","ts":1544429164.8976414,"logger":"fallback","caller":"revision/reconcile_resources.go:157","msg":"Error updating Service \"update-user-svc-failure-service\": inducing failure for update services","knative.dev/k8sservice":"update-user-svc-failure-service","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcileService\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/reconcile_resources.go:157\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).(github.com/knative/serving/pkg/reconciler/v1alpha1/revision.reconcileService)-fm\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:373\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:384\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.761] {"level":"error","ts":1544429164.8981555,"logger":"fallback","caller":"revision/revision.go:385","msg":"Failed to reconcile user k8s service: {error 25 0  inducing failure for update services}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:385\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.761] === RUN   TestReconcile/surface_deployment_timeout
I1210 08:06:11.761] {"level":"info","ts":1544429164.9492962,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.761] === RUN   TestReconcile/build_missing
I1210 08:06:11.761] {"level":"info","ts":1544429164.993245,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.762] {"level":"error","ts":1544429165.098587,"logger":"fallback","caller":"revision/revision.go:298","msg":"Error fetching Build \"the-build\" for Revision \"missing-build\": builds.testing.build.knative.dev \"the-build\" not found","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcileBuild\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:298\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:354\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.762] === RUN   TestReconcile/build_running
I1210 08:06:11.762] {"level":"info","ts":1544429165.1239877,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.762] === RUN   TestReconcile/build_newly_done
I1210 08:06:11.763] {"level":"info","ts":1544429165.2655063,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.763] {"level":"info","ts":1544429165.3679192,"logger":"fallback","caller":"revision/reconcile_resources.go:57","msg":"Created deployment \"done-build-deployment\"","knative.dev/deployment":"done-build-deployment"}
I1210 08:06:11.763] {"level":"info","ts":1544429165.3682675,"logger":"fallback","caller":"revision/reconcile_resources.go:84","msg":"Created image cache \"done-build-cache\"","knative.dev/deployment":"done-build-deployment"}
... skipping 6 lines ...
I1210 08:06:11.764] === RUN   TestReconcile/build_newly_failed
I1210 08:06:11.764] {"level":"info","ts":1544429165.5935633,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.765] === RUN   TestReconcile/build_failed_stable
I1210 08:06:11.765] {"level":"info","ts":1544429165.7435935,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.765] --- PASS: TestReconcile (1.68s)
I1210 08:06:11.765]     --- PASS: TestReconcile/bad_workqueue_key (0.02s)
I1210 08:06:11.765]     	logger.go:130: 2018-12-10T08:06:04.208Z	ERROR	TestReconcile/bad_workqueue_key.revision-controller	revision/revision.go:232	invalid resource key: too/many/parts	{"knative.dev/controller": "revision-controller"}
I1210 08:06:11.765]     --- PASS: TestReconcile/key_not_found (0.02s)
I1210 08:06:11.765]     --- PASS: TestReconcile/first_revision_reconciliation (0.05s)
I1210 08:06:11.766]     --- PASS: TestReconcile/failure_updating_revision_status (0.05s)
I1210 08:06:11.766]     --- PASS: TestReconcile/failure_creating_kpa (0.09s)
I1210 08:06:11.766]     --- PASS: TestReconcile/failure_creating_user_deployment (0.05s)
I1210 08:06:11.766]     --- PASS: TestReconcile/failure_creating_user_service (0.06s)
... skipping 25 lines ...
I1210 08:06:11.770] === RUN   TestReconcileWithVarLogEnabled/failure_creating_fluentd_configmap
I1210 08:06:11.770] {"level":"info","ts":1544429165.959629,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.770] {"level":"info","ts":1544429165.9606247,"logger":"fallback","caller":"revision/reconcile_resources.go:57","msg":"Created deployment \"create-configmap-failure-deployment\"","knative.dev/deployment":"create-configmap-failure-deployment"}
I1210 08:06:11.771] {"level":"info","ts":1544429165.9609525,"logger":"fallback","caller":"revision/reconcile_resources.go:84","msg":"Created image cache \"create-configmap-failure-cache\"","knative.dev/deployment":"create-configmap-failure-deployment"}
I1210 08:06:11.771] {"level":"info","ts":1544429165.9695761,"logger":"fallback","caller":"revision/reconcile_resources.go:145","msg":"Created Service \"create-configmap-failure-service\"","knative.dev/k8sservice":"create-configmap-failure-service"}
I1210 08:06:11.771] {"level":"info","ts":1544429165.9697576,"logger":"fallback","caller":"revision/reconcile_resources.go:173","msg":"Endpoints not created yet \"create-configmap-failure-service\"","knative.dev/k8sservice":"create-configmap-failure-service"}
I1210 08:06:11.772] {"level":"error","ts":1544429165.9700627,"logger":"fallback","caller":"revision/reconcile_resources.go:222","msg":"Error creating fluentd configmap{error 25 0  inducing failure for create configmaps}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcileFluentdConfigMap\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/reconcile_resources.go:222\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).(github.com/knative/serving/pkg/reconciler/v1alpha1/revision.reconcileFluentdConfigMap)-fm\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:377\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:384\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.773] {"level":"error","ts":1544429165.970441,"logger":"fallback","caller":"revision/revision.go:385","msg":"Failed to reconcile fluentd configmap: {error 25 0  inducing failure for create configmaps}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:385\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.773] === RUN   TestReconcileWithVarLogEnabled/steady_state_after_initial_creation
I1210 08:06:11.773] {"level":"info","ts":1544429166.0439804,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.773] {"level":"info","ts":1544429166.0444527,"logger":"fallback","caller":"revision/reconcile_resources.go:173","msg":"Endpoints not created yet \"steady-state-service\"","knative.dev/k8sservice":"steady-state-service"}
I1210 08:06:11.773] === RUN   TestReconcileWithVarLogEnabled/update_a_bad_fluentd_configmap
I1210 08:06:11.774] {"level":"info","ts":1544429166.1183064,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.774] {"level":"info","ts":1544429166.1187682,"logger":"fallback","caller":"revision/reconcile_resources.go:173","msg":"Endpoints not created yet \"update-fluentd-config-service\"","knative.dev/k8sservice":"update-fluentd-config-service"}
I1210 08:06:11.775] {"level":"info","ts":1544429166.1196606,"logger":"fallback","caller":"revision/reconcile_resources.go:236","msg":"Reconciling fluentd configmap diff (-desired, +observed): {map[string]string}[\"bad key\"]:\n\t-: <non-existent>\n\t+: \"bad value\"\n{map[string]string}[\"varlog.conf\"]:\n\t-: \"\\n<source>\\n\\t@type tail\\n\\tpath /var/log/revisions/**/*.*\\n\\tpos_file /var/log/varlog.log.pos\\n\\ttag raw.*\\n\\tformat none\\n\\tmessage_key log\\n\\tread_from_head true\\n</source>\\n\\n<filter raw.var.log.**>\\n\\t@type record_transformer\\n\\tenable_ruby true\\n\\t<record>\\n\\t  kubernetes ${ {\\\"container_name\\\": \\\"#{ENV['SERVING_CONTAINER_NAME']}\\\", \\\"namespace_name\\\": \\\"#{ENV['SERVING_NAMESPACE']}\\\", \\\"pod_name\\\": \\\"#{ENV['SERVING_POD_NAME']}\\\", \\\"labels\\\": {\\\"knative_dev/configuration\\\": \\\"#{ENV['SERVING_CONFIGURATION']}\\\", \\\"knative_dev/revision\\\": \\\"#{ENV['SERVING_REVISION']}\\\"} } }\\n\\t\\tstream varlog\\n\\t\\t# Line breaks may be trimmed when collecting from files. Add them back so that\\n\\t\\t# multi line logs are still in multi line after combined by detect_exceptions.\\n\\t\\t# Remove this if https://github.com/GoogleCloudPlatform/fluent-plugin-detect-exceptions/pull/10 is released\\n\\t\\tlog ${ if record[\\\"log\\\"].end_with?(\\\"\\\\n\\\") then record[\\\"log\\\"] else record[\\\"log\\\"] + \\\"\\\\n\\\" end }\\n\\t</record>\\n</filter>\\n\\n<match raw.var.log.**>\\n\\t@id raw.var.log\\n\\t@type detect_exceptions\\n\\tremove_tag_prefix raw\\n\\tmessage log\\n\\tstream stream\\n\\tmultiline_flush_interval 5\\n\\tmax_bytes 500000\\n\\tmax_lines 1000\\n</match>\\n\\n\"\n\t+: <non-existent>\n"}
I1210 08:06:11.775] === RUN   TestReconcileWithVarLogEnabled/failure_updating_fluentd_configmap
I1210 08:06:11.775] {"level":"info","ts":1544429166.162816,"logger":"fallback","caller":"revision/revision.go:236","msg":"Running reconcile Revision"}
I1210 08:06:11.775] {"level":"info","ts":1544429166.1632721,"logger":"fallback","caller":"revision/reconcile_resources.go:173","msg":"Endpoints not created yet \"update-configmap-failure-service\"","knative.dev/k8sservice":"update-configmap-failure-service"}
I1210 08:06:11.776] {"level":"info","ts":1544429166.1640384,"logger":"fallback","caller":"revision/reconcile_resources.go:236","msg":"Reconciling fluentd configmap diff (-desired, +observed): {map[string]string}[\"bad key\"]:\n\t-: <non-existent>\n\t+: \"bad value\"\n{map[string]string}[\"varlog.conf\"]:\n\t-: \"\\n<source>\\n\\t@type tail\\n\\tpath /var/log/revisions/**/*.*\\n\\tpos_file /var/log/varlog.log.pos\\n\\ttag raw.*\\n\\tformat none\\n\\tmessage_key log\\n\\tread_from_head true\\n</source>\\n\\n<filter raw.var.log.**>\\n\\t@type record_transformer\\n\\tenable_ruby true\\n\\t<record>\\n\\t  kubernetes ${ {\\\"container_name\\\": \\\"#{ENV['SERVING_CONTAINER_NAME']}\\\", \\\"namespace_name\\\": \\\"#{ENV['SERVING_NAMESPACE']}\\\", \\\"pod_name\\\": \\\"#{ENV['SERVING_POD_NAME']}\\\", \\\"labels\\\": {\\\"knative_dev/configuration\\\": \\\"#{ENV['SERVING_CONFIGURATION']}\\\", \\\"knative_dev/revision\\\": \\\"#{ENV['SERVING_REVISION']}\\\"} } }\\n\\t\\tstream varlog\\n\\t\\t# Line breaks may be trimmed when collecting from files. Add them back so that\\n\\t\\t# multi line logs are still in multi line after combined by detect_exceptions.\\n\\t\\t# Remove this if https://github.com/GoogleCloudPlatform/fluent-plugin-detect-exceptions/pull/10 is released\\n\\t\\tlog ${ if record[\\\"log\\\"].end_with?(\\\"\\\\n\\\") then record[\\\"log\\\"] else record[\\\"log\\\"] + \\\"\\\\n\\\" end }\\n\\t</record>\\n</filter>\\n\\n<match raw.var.log.**>\\n\\t@id raw.var.log\\n\\t@type detect_exceptions\\n\\tremove_tag_prefix raw\\n\\tmessage log\\n\\tstream stream\\n\\tmultiline_flush_interval 5\\n\\tmax_bytes 500000\\n\\tmax_lines 1000\\n</match>\\n\\n\"\n\t+: <non-existent>\n"}
I1210 08:06:11.777] {"level":"error","ts":1544429166.16445,"logger":"fallback","caller":"revision/reconcile_resources.go:243","msg":"Error updating fluentd configmap{error 25 0  inducing failure for update configmaps}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcileFluentdConfigMap\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/reconcile_resources.go:243\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).(github.com/knative/serving/pkg/reconciler/v1alpha1/revision.reconcileFluentdConfigMap)-fm\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:377\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:384\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.778] {"level":"error","ts":1544429166.1648169,"logger":"fallback","caller":"revision/revision.go:385","msg":"Failed to reconcile fluentd configmap: {error 25 0  inducing failure for update configmaps}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:385\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/revision.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/revision/revision.go:254\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.778] --- PASS: TestReconcileWithVarLogEnabled (0.33s)
I1210 08:06:11.778]     --- PASS: TestReconcileWithVarLogEnabled/first_revision_reconciliation_(with_/var/log_enabled) (0.07s)
I1210 08:06:11.779]     --- PASS: TestReconcileWithVarLogEnabled/failure_creating_fluentd_configmap (0.08s)
I1210 08:06:11.779]     --- PASS: TestReconcileWithVarLogEnabled/steady_state_after_initial_creation (0.02s)
I1210 08:06:11.779]     --- PASS: TestReconcileWithVarLogEnabled/update_a_bad_fluentd_configmap (0.05s)
I1210 08:06:11.779]     --- PASS: TestReconcileWithVarLogEnabled/failure_updating_fluentd_configmap (0.03s)
... skipping 286 lines ...
I1210 08:06:11.812] 	logger.go:130: 2018-12-10T08:05:47.658Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:119	Setting up event handlers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.812] 	logger.go:130: 2018-12-10T08:05:47.658Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:158	Setting up ConfigMap receivers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.813] 	logger.go:130: 2018-12-10T08:05:47.659Z	INFO	TestNewRouteCallsSyncHandler.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[test-domain.dev:0xc4204640b8 prod-domain.com:0xc4204640c8]}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.813] 	logger.go:130: 2018-12-10T08:05:47.659Z	INFO	TestNewRouteCallsSyncHandler.route-controller.config-store	configmap/store.go:166	route config "config-gc" config was added or updated: &{24h0m0s 15h0m0s 1 5h0m0s}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.813] 	logger.go:130: 2018-12-10T08:05:47.661Z	INFO	TestNewRouteCallsSyncHandler.route-controller	controller/controller.go:215	Starting controller and workers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.813] 	logger.go:130: 2018-12-10T08:05:47.662Z	INFO	TestNewRouteCallsSyncHandler.route-controller	controller/controller.go:223	Started workers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.814] 	logger.go:130: 2018-12-10T08:05:47.687Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:225	Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[route:test-route] map[] [] nil [] } {0 [{ test-rev  100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:47.686973794 +0000 UTC m=+0.140737056}  } {IngressReady Unknown Error {2018-12-10 08:05:47.686983806 +0000 UTC m=+0.140747044}  } {Ready Unknown Error {2018-12-10 08:05:47.687060164 +0000 UTC m=+0.140823405}  }] 0}}	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.814] 	logger.go:130: 2018-12-10T08:05:47.688Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:307	All referred targets are routable, marking AllTrafficAssigned with traffic information.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.814] 	logger.go:130: 2018-12-10T08:05:47.688Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:233	Updating targeted revisions.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.814] 	logger.go:130: 2018-12-10T08:05:47.703Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:247	Creating ClusterIngress.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.814] 	queueing_test.go:113: ingress created: ""
I1210 08:06:11.815] 	logger.go:130: 2018-12-10T08:05:47.704Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:254	Creating/Updating placeholder k8s services	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.815] 	logger.go:130: 2018-12-10T08:05:47.704Z	WARN	TestNewRouteCallsSyncHandler.route-controller	route/reconcile_resources.go:106	Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.815] 	logger.go:130: 2018-12-10T08:05:47.704Z	INFO	TestNewRouteCallsSyncHandler.route-controller	route/route.go:259	Route successfully synced	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.815] 	logger.go:130: 2018-12-10T08:05:47.705Z	INFO	TestNewRouteCallsSyncHandler.route-controller	controller/controller.go:275	Reconcile succeeded. Time taken: 18.430135ms.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.816] 	logger.go:130: 2018-12-10T08:05:47.705Z	INFO	TestNewRouteCallsSyncHandler.route-controller	controller/controller.go:225	Shutting down workers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.816] === RUN   TestReconcileClusterIngress_Insert
I1210 08:06:11.816] E1210 08:05:47.724523   11455 event.go:259] Could not construct reference to: '&v1alpha1.Route{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route", GenerateName:"", Namespace:"test-ns", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, Spec:v1alpha1.RouteSpec{Generation:0, Traffic:[]v1alpha1.TrafficTarget(nil)}, Status:v1alpha1.RouteStatus{Domain:"", DomainInternal:"", Address:(*v1alpha1.Addressable)(nil), Traffic:[]v1alpha1.TrafficTarget(nil), Conditions:v1alpha1.Conditions(nil), ObservedGeneration:0}}' due to: 'selfLink was empty, can't make reference'. Will not report event: 'Normal' 'Created' 'Created ClusterIngress ""'
I1210 08:06:11.816] --- PASS: TestReconcileClusterIngress_Insert (0.02s)
... skipping 21 lines ...
I1210 08:06:11.822] 	logger.go:130: 2018-12-10T08:05:47.751Z	INFO	TestReconcileTargetRevisions.route-controller.config-store	configmap/store.go:166	route config "config-gc" config was added or updated: &{24h0m0s 15h0m0s 1 5h0m0s}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.822] 	logger.go:130: 2018-12-10T08:05:47.752Z	INFO	TestReconcileTargetRevisions.route-controller	route/reconcile_resources.go:172	Unable to update lastPinned for missing revision "revision"	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.822]     --- PASS: TestReconcileTargetRevisions/Valid_target_revision (0.00s)
I1210 08:06:11.822] 	logger.go:130: 2018-12-10T08:05:47.754Z	INFO	TestReconcileTargetRevisions.route-controller	route/reconcile_resources.go:172	Unable to update lastPinned for missing revision "inal-revision"	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.822]     --- PASS: TestReconcileTargetRevisions/invalid_target_revision (0.00s)
I1210 08:06:11.823] === RUN   TestCreateRouteForOneReserveRevision
I1210 08:06:11.823] {"level":"info","ts":1544429147.7597077,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[route:test-route] map[] [] nil [] } {0 [{ test-rev test-config 100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:47.75942258 +0000 UTC m=+0.213185846}  } {IngressReady Unknown Error {2018-12-10 08:05:47.759436303 +0000 UTC m=+0.213199577}  } {Ready Unknown Error {2018-12-10 08:05:47.759446937 +0000 UTC m=+0.213210236}  }] 0}}"}
I1210 08:06:11.823] {"level":"info","ts":1544429147.7601306,"logger":"fallback","caller":"route/route.go:285","msg":"Revision test/test-rev is inactive"}
I1210 08:06:11.823] {"level":"info","ts":1544429147.760488,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.823] {"level":"info","ts":1544429147.7606454,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.824] {"level":"info","ts":1544429147.7634306,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.824] {"level":"info","ts":1544429147.7643847,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.824] {"level":"warn","ts":1544429147.7664435,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.824] {"level":"info","ts":1544429147.7666607,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.825] {"level":"info","ts":1544429147.7688353,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[route:test-route] map[] [] nil [] } {0 [{ test-rev test-config 100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:47.768513795 +0000 UTC m=+0.222277089}  } {IngressReady Unknown Error {2018-12-10 08:05:47.768522479 +0000 UTC m=+0.222285840}  } {Ready Unknown Error {2018-12-10 08:05:47.768533896 +0000 UTC m=+0.222297270}  }] 0}}"}
I1210 08:06:11.825] E1210 08:05:47.765629   11455 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.156eea208d3e16b7", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created ClusterIngress \"\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbefba576ed8c48b7, ext:217931692, loc:(*time.Location)(0x23f7860)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbefba576ed8c48b7, ext:217931692, loc:(*time.Location)(0x23f7860)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I1210 08:06:11.826] {"level":"info","ts":1544429147.769289,"logger":"fallback","caller":"route/route.go:285","msg":"Revision test/test-rev is inactive"}
I1210 08:06:11.826] {"level":"info","ts":1544429147.7695768,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.826] {"level":"info","ts":1544429147.7697866,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.826] {"level":"info","ts":1544429147.772676,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.826] {"level":"info","ts":1544429147.7733147,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
... skipping 8 lines ...
I1210 08:06:11.829] 	logger.go:130: 2018-12-10T08:05:47.758Z	INFO	TestCreateRouteForOneReserveRevision.route-controller.config-store	configmap/store.go:166	route config "config-gc" config was added or updated: &{24h0m0s 15h0m0s 1 5h0m0s}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.829] 	hooks.go:101: Got an event message matching "^Created ClusterIngress.*": "Created ClusterIngress \"\""
I1210 08:06:11.829] 	logger.go:130: 2018-12-10T08:05:47.766Z	INFO	TestCreateRouteForOneReserveRevision.route-controller.event-broadcaster	reconciler/reconciler.go:107	Event(v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Created' Created ClusterIngress ""	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.829] 	logger.go:130: 2018-12-10T08:05:47.774Z	INFO	TestCreateRouteForOneReserveRevision.route-controller.event-broadcaster	reconciler/reconciler.go:107	Event(v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Created' Created service "test-route"	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.829] 	hooks.go:101: Got an event message matching "Created service \"test-route\"": "Created service \"test-route\""
I1210 08:06:11.830] === RUN   TestCreateRouteWithMultipleTargets
I1210 08:06:11.830] {"level":"info","ts":1544429147.7813737,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[route:test-route] map[] [] nil [] } {0 [{  test-config 90} { test-rev  10}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:47.781095238 +0000 UTC m=+0.234858500}  } {IngressReady Unknown Error {2018-12-10 08:05:47.781102313 +0000 UTC m=+0.234865543}  } {Ready Unknown Error {2018-12-10 08:05:47.781111933 +0000 UTC m=+0.234875171}  }] 0}}"}
I1210 08:06:11.830] {"level":"info","ts":1544429147.78243,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.830] {"level":"info","ts":1544429147.7826138,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.830] {"level":"info","ts":1544429147.7965071,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.831] {"level":"info","ts":1544429147.8001394,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.831] {"level":"warn","ts":1544429147.801509,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.831] {"level":"info","ts":1544429147.8016896,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.832] E1210 08:05:47.801057   11455 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.156eea208f5f911b", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created ClusterIngress \"\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbefba576efadc31b, ext:253680071, loc:(*time.Location)(0x23f7860)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbefba576efadc31b, ext:253680071, loc:(*time.Location)(0x23f7860)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I1210 08:06:11.832] --- PASS: TestCreateRouteWithMultipleTargets (0.03s)
I1210 08:06:11.832] 	logger.go:130: 2018-12-10T08:05:47.776Z	DEBUG	TestCreateRouteWithMultipleTargets.route-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.832] 	logger.go:130: 2018-12-10T08:05:47.777Z	INFO	TestCreateRouteWithMultipleTargets.route-controller	route/route.go:119	Setting up event handlers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.832] 	logger.go:130: 2018-12-10T08:05:47.778Z	INFO	TestCreateRouteWithMultipleTargets.route-controller	route/route.go:158	Setting up ConfigMap receivers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.833] 	logger.go:130: 2018-12-10T08:05:47.779Z	INFO	TestCreateRouteWithMultipleTargets.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[prod-domain.com:0xc4204102a8 test-domain.dev:0xc4204102b8]}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.833] 	logger.go:130: 2018-12-10T08:05:47.780Z	INFO	TestCreateRouteWithMultipleTargets.route-controller.config-store	configmap/store.go:166	route config "config-gc" config was added or updated: &{24h0m0s 15h0m0s 1 5h0m0s}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.833] 	logger.go:130: 2018-12-10T08:05:47.800Z	INFO	TestCreateRouteWithMultipleTargets.route-controller.event-broadcaster	reconciler/reconciler.go:107	Event(v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Created' Created ClusterIngress ""	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.833] === RUN   TestCreateRouteWithOneTargetReserve
I1210 08:06:11.834] {"level":"info","ts":1544429147.808679,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[route:test-route] map[] [] nil [] } {0 [{  test-config 90} { test-rev test-config 10}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:47.808396871 +0000 UTC m=+0.262160115}  } {IngressReady Unknown Error {2018-12-10 08:05:47.808404258 +0000 UTC m=+0.262167496}  } {Ready Unknown Error {2018-12-10 08:05:47.808413384 +0000 UTC m=+0.262176617}  }] 0}}"}
I1210 08:06:11.834] {"level":"info","ts":1544429147.8093407,"logger":"fallback","caller":"route/route.go:285","msg":"Revision test/test-rev is inactive"}
I1210 08:06:11.834] {"level":"info","ts":1544429147.8096092,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.834] {"level":"info","ts":1544429147.809826,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.834] {"level":"info","ts":1544429147.816068,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.835] E1210 08:05:47.817427   11455 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.156eea209060b51c", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created ClusterIngress \"\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbefba576f0aee71c, ext:270532036, loc:(*time.Location)(0x23f7860)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbefba576f0aee71c, ext:270532036, loc:(*time.Location)(0x23f7860)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I1210 08:06:11.835] {"level":"info","ts":1544429147.8170092,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.836] {"level":"warn","ts":1544429147.8184187,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.836] {"level":"info","ts":1544429147.818575,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.836] --- PASS: TestCreateRouteWithOneTargetReserve (0.02s)
I1210 08:06:11.836] 	logger.go:130: 2018-12-10T08:05:47.804Z	DEBUG	TestCreateRouteWithOneTargetReserve.route-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.836] 	logger.go:130: 2018-12-10T08:05:47.805Z	INFO	TestCreateRouteWithOneTargetReserve.route-controller	route/route.go:119	Setting up event handlers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.836] 	logger.go:130: 2018-12-10T08:05:47.806Z	INFO	TestCreateRouteWithOneTargetReserve.route-controller	route/route.go:158	Setting up ConfigMap receivers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.837] 	logger.go:130: 2018-12-10T08:05:47.806Z	INFO	TestCreateRouteWithOneTargetReserve.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[test-domain.dev:0xc420464170 prod-domain.com:0xc420464178]}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.837] 	logger.go:130: 2018-12-10T08:05:47.807Z	INFO	TestCreateRouteWithOneTargetReserve.route-controller.config-store	configmap/store.go:166	route config "config-gc" config was added or updated: &{24h0m0s 15h0m0s 1 5h0m0s}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.837] 	logger.go:130: 2018-12-10T08:05:47.818Z	INFO	TestCreateRouteWithOneTargetReserve.route-controller.event-broadcaster	reconciler/reconciler.go:107	Event(v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Created' Created ClusterIngress ""	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.837] === RUN   TestCreateRouteWithDuplicateTargets
I1210 08:06:11.838] {"level":"info","ts":1544429147.8253374,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[route:test-route] map[] [] nil [] } {0 [{  test-config 30} {  test-config 20} { test-rev  10} { test-rev  5} {test-revision-1 test-rev  10} {test-revision-1 test-rev  10} {test-revision-2 test-rev  15}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:47.825001691 +0000 UTC m=+0.278764963}  } {IngressReady Unknown Error {2018-12-10 08:05:47.82500876 +0000 UTC m=+0.278772000}  } {Ready Unknown Error {2018-12-10 08:05:47.82501855 +0000 UTC m=+0.278781784}  }] 0}}"}
I1210 08:06:11.838] {"level":"info","ts":1544429147.8262837,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.838] {"level":"info","ts":1544429147.8265126,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.838] {"level":"info","ts":1544429147.8376133,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.839] E1210 08:05:47.838925   11455 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.156eea2091aa81c9", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created ClusterIngress \"\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbefba576f1f8b3c9, ext:292145813, loc:(*time.Location)(0x23f7860)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbefba576f1f8b3c9, ext:292145813, loc:(*time.Location)(0x23f7860)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I1210 08:06:11.839] {"level":"info","ts":1544429147.839756,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.840] {"level":"warn","ts":1544429147.8399267,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.840] {"level":"info","ts":1544429147.8400755,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.840] --- PASS: TestCreateRouteWithDuplicateTargets (0.02s)
I1210 08:06:11.840] 	logger.go:130: 2018-12-10T08:05:47.820Z	DEBUG	TestCreateRouteWithDuplicateTargets.route-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.840] 	logger.go:130: 2018-12-10T08:05:47.822Z	INFO	TestCreateRouteWithDuplicateTargets.route-controller	route/route.go:119	Setting up event handlers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.840] 	logger.go:130: 2018-12-10T08:05:47.822Z	INFO	TestCreateRouteWithDuplicateTargets.route-controller	route/route.go:158	Setting up ConfigMap receivers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.841] 	logger.go:130: 2018-12-10T08:05:47.823Z	INFO	TestCreateRouteWithDuplicateTargets.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[test-domain.dev:0xc4204642a8 prod-domain.com:0xc4204642b0]}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.841] 	logger.go:130: 2018-12-10T08:05:47.824Z	INFO	TestCreateRouteWithDuplicateTargets.route-controller.config-store	configmap/store.go:166	route config "config-gc" config was added or updated: &{24h0m0s 15h0m0s 1 5h0m0s}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.841] 	logger.go:130: 2018-12-10T08:05:47.839Z	INFO	TestCreateRouteWithDuplicateTargets.route-controller.event-broadcaster	reconciler/reconciler.go:107	Event(v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Created' Created ClusterIngress ""	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.841] === RUN   TestCreateRouteWithNamedTargets
I1210 08:06:11.842] {"level":"info","ts":1544429147.8474915,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[route:test-route] map[] [] nil [] } {0 [{foo test-rev  50} {bar  test-config 50}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:47.847196777 +0000 UTC m=+0.300960081}  } {IngressReady Unknown Error {2018-12-10 08:05:47.847206197 +0000 UTC m=+0.300969445}  } {Ready Unknown Error {2018-12-10 08:05:47.847216474 +0000 UTC m=+0.300979707}  }] 0}}"}
I1210 08:06:11.842] {"level":"info","ts":1544429147.8482776,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.842] {"level":"info","ts":1544429147.8484933,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.842] {"level":"info","ts":1544429147.861155,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.842] {"level":"info","ts":1544429147.8621392,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.843] {"level":"warn","ts":1544429147.8635497,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.843] {"level":"info","ts":1544429147.8637626,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.844] E1210 08:05:47.862767   11455 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.156eea20931282eb", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created ClusterIngress \"\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbefba576f360b4eb, ext:315739036, loc:(*time.Location)(0x23f7860)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbefba576f360b4eb, ext:315739036, loc:(*time.Location)(0x23f7860)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I1210 08:06:11.844] --- PASS: TestCreateRouteWithNamedTargets (0.02s)
I1210 08:06:11.844] 	logger.go:130: 2018-12-10T08:05:47.842Z	DEBUG	TestCreateRouteWithNamedTargets.route-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.844] 	logger.go:130: 2018-12-10T08:05:47.844Z	INFO	TestCreateRouteWithNamedTargets.route-controller	route/route.go:119	Setting up event handlers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.844] 	logger.go:130: 2018-12-10T08:05:47.844Z	INFO	TestCreateRouteWithNamedTargets.route-controller	route/route.go:158	Setting up ConfigMap receivers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.845] 	logger.go:130: 2018-12-10T08:05:47.845Z	INFO	TestCreateRouteWithNamedTargets.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[test-domain.dev:0xc4200d0208 prod-domain.com:0xc4200d0248]}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.845] 	logger.go:130: 2018-12-10T08:05:47.845Z	INFO	TestCreateRouteWithNamedTargets.route-controller.config-store	configmap/store.go:166	route config "config-gc" config was added or updated: &{24h0m0s 15h0m0s 1 5h0m0s}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.845] 	logger.go:130: 2018-12-10T08:05:47.863Z	INFO	TestCreateRouteWithNamedTargets.route-controller.event-broadcaster	reconciler/reconciler.go:107	Event(v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Created' Created ClusterIngress ""	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.845] === RUN   TestUpdateDomainConfigMap
I1210 08:06:11.846] {"level":"info","ts":1544429147.8705368,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[route:test-route] map[] [] nil [] } {0 []} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:47.87026032 +0000 UTC m=+0.324023597}  } {IngressReady Unknown Error {2018-12-10 08:05:47.870269226 +0000 UTC m=+0.324032474}  } {Ready Unknown Error {2018-12-10 08:05:47.870292394 +0000 UTC m=+0.324055691}  }] 0}}"}
I1210 08:06:11.846] {"level":"info","ts":1544429147.8711033,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.846] {"level":"info","ts":1544429147.871297,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.846] {"level":"info","ts":1544429147.8714995,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.846] {"level":"info","ts":1544429147.8722315,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.847] {"level":"warn","ts":1544429147.8735957,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.847] E1210 08:05:47.872904   11455 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.156eea2093ac8095", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created ClusterIngress \"\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbefba576f3fab295, ext:325830988, loc:(*time.Location)(0x23f7860)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbefba576f3fab295, ext:325830988, loc:(*time.Location)(0x23f7860)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I1210 08:06:11.848] {"level":"info","ts":1544429147.8738978,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.848] {"level":"info","ts":1544429147.8757825,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[app:prod] map[] [] nil [] } {0 []} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:47.875514729 +0000 UTC m=+0.329278001}  } {IngressReady Unknown Error {2018-12-10 08:05:47.875522996 +0000 UTC m=+0.329286233}  } {Ready Unknown Error {2018-12-10 08:05:47.875535314 +0000 UTC m=+0.329298599}  }] 0}}"}
I1210 08:06:11.848] {"level":"info","ts":1544429147.8761244,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.848] {"level":"info","ts":1544429147.8762798,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.849] {"level":"info","ts":1544429147.876486,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.849] {"level":"info","ts":1544429147.8768575,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.849] {"level":"warn","ts":1544429147.8770077,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.849] {"level":"info","ts":1544429147.8771415,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.849] {"level":"info","ts":1544429147.8798444,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[app:prod] map[] [] nil [] } {0 []} {test-route.test.prod-domain.com test-route.test.svc.cluster.local 0xc420076d50 [] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.876252752 +0000 UTC m=+0.330016010}  } {IngressReady Unknown Error {2018-12-10 08:05:47.875522996 +0000 UTC m=+0.329286233}  } {Ready Unknown Error {2018-12-10 08:05:47.875535314 +0000 UTC m=+0.329298599}  }] 0}}"}
I1210 08:06:11.850] {"level":"info","ts":1544429147.8803291,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.850] {"level":"info","ts":1544429147.8805065,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.850] {"level":"info","ts":1544429147.8806834,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.850] {"level":"info","ts":1544429147.881127,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.850] {"level":"warn","ts":1544429147.8812475,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.851] {"level":"info","ts":1544429147.8813825,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.851] {"level":"info","ts":1544429147.8843105,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 []} {test-route.test.mytestdomain.com test-route.test.svc.cluster.local 0xc420077570 [] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.876252752 +0000 UTC m=+0.330016010}  } {IngressReady Unknown Error {2018-12-10 08:05:47.875522996 +0000 UTC m=+0.329286233}  } {Ready Unknown Error {2018-12-10 08:05:47.875535314 +0000 UTC m=+0.329298599}  }] 0}}"}
I1210 08:06:11.851] {"level":"info","ts":1544429147.8845432,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.851] {"level":"info","ts":1544429147.8847215,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.852] {"level":"info","ts":1544429147.8848927,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.852] {"level":"info","ts":1544429147.8852894,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.852] {"level":"warn","ts":1544429147.8854046,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.852] {"level":"info","ts":1544429147.8855312,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.852] {"level":"info","ts":1544429147.8879793,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 []} {test-route.test.newdefault.net test-route.test.svc.cluster.local 0xc420077d70 [] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.876252752 +0000 UTC m=+0.330016010}  } {IngressReady Unknown Error {2018-12-10 08:05:47.875522996 +0000 UTC m=+0.329286233}  } {Ready Unknown Error {2018-12-10 08:05:47.875535314 +0000 UTC m=+0.329298599}  }] 0}}"}
I1210 08:06:11.853] {"level":"info","ts":1544429147.8881915,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.853] {"level":"info","ts":1544429147.8883612,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.853] {"level":"info","ts":1544429147.8885138,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.853] {"level":"info","ts":1544429147.888906,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.853] {"level":"warn","ts":1544429147.8890352,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.853] {"level":"info","ts":1544429147.8891811,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.854] --- PASS: TestUpdateDomainConfigMap (0.02s)
I1210 08:06:11.854] 	logger.go:130: 2018-12-10T08:05:47.866Z	DEBUG	TestUpdateDomainConfigMap.route-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.854] 	logger.go:130: 2018-12-10T08:05:47.867Z	INFO	TestUpdateDomainConfigMap.route-controller	route/route.go:119	Setting up event handlers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.854] 	logger.go:130: 2018-12-10T08:05:47.868Z	INFO	TestUpdateDomainConfigMap.route-controller	route/route.go:158	Setting up ConfigMap receivers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.854] 	logger.go:130: 2018-12-10T08:05:47.869Z	INFO	TestUpdateDomainConfigMap.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[test-domain.dev:0xc4204101a8 prod-domain.com:0xc4204101b0]}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.855] 	logger.go:130: 2018-12-10T08:05:47.869Z	INFO	TestUpdateDomainConfigMap.route-controller.config-store	configmap/store.go:166	route config "config-gc" config was added or updated: &{24h0m0s 15h0m0s 1 5h0m0s}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.855] 	logger.go:130: 2018-12-10T08:05:47.873Z	INFO	TestUpdateDomainConfigMap.route-controller.event-broadcaster	reconciler/reconciler.go:107	Event(v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Created' Created ClusterIngress ""	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.855] 	logger.go:130: 2018-12-10T08:05:47.879Z	INFO	TestUpdateDomainConfigMap.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[test-domain.dev:0xc420410358 mytestdomain.com:0xc420410360]}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.855] 	logger.go:130: 2018-12-10T08:05:47.883Z	INFO	TestUpdateDomainConfigMap.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[newdefault.net:0xc4204103b8 mytestdomain.com:0xc4204103c0]}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.856] 	logger.go:130: 2018-12-10T08:05:47.887Z	ERROR	TestUpdateDomainConfigMap.route-controller.config-store	configmap/store.go:159	Error updating route config "config-domain": "Config map[string]string{\"mytestdomain.com\":\"selector:\\n  app: prod\"} must have a default domain"	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.856] === RUN   TestGlobalResyncOnUpdateDomainConfigMap
I1210 08:06:11.856] === RUN   TestGlobalResyncOnUpdateDomainConfigMap/prod-domain.com
I1210 08:06:11.856] === RUN   TestGlobalResyncOnUpdateDomainConfigMap/mytestdomain.com
I1210 08:06:11.857] E1210 08:05:47.934564   11455 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"test-route.156eea20972efb5a", GenerateName:"", Namespace:"test", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}, Reason:"Created", Message:"Created ClusterIngress \"\"", Source:v1.EventSource{Component:"route-controller", Host:""}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbefba576f77d2d5a, ext:384713733, loc:(*time.Location)(0x23f7860)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbefba576f77d2d5a, ext:384713733, loc:(*time.Location)(0x23f7860)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'request namespace does not match object namespace, request: "" object: "test"' (will not retry!)
I1210 08:06:11.857] === RUN   TestGlobalResyncOnUpdateDomainConfigMap/newprod.net
I1210 08:06:11.857] === RUN   TestGlobalResyncOnUpdateDomainConfigMap/test-domain.dev
I1210 08:06:11.857] --- FAIL: TestGlobalResyncOnUpdateDomainConfigMap (0.07s)
I1210 08:06:11.857] 	logger.go:130: 2018-12-10T08:05:47.891Z	DEBUG	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	reconciler/reconciler.go:105	Creating event broadcaster	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.858] 	logger.go:130: 2018-12-10T08:05:47.897Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:119	Setting up event handlers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.858] 	logger.go:130: 2018-12-10T08:05:47.898Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:158	Setting up ConfigMap receivers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.858] 	logger.go:130: 2018-12-10T08:05:47.898Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[prod-domain.com:0xc420464488 test-domain.dev:0xc420464480]}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.858] 	logger.go:130: 2018-12-10T08:05:47.901Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller.config-store	configmap/store.go:166	route config "config-gc" config was added or updated: &{24h0m0s 15h0m0s 1 5h0m0s}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.859] 	logger.go:130: 2018-12-10T08:05:47.913Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	controller/controller.go:215	Starting controller and workers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.859] 	logger.go:130: 2018-12-10T08:05:47.914Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	controller/controller.go:223	Started workers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.859] 	logger.go:130: 2018-12-10T08:05:47.929Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:225	Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[app:prod] map[] [] nil [] } {0 []} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:47.929424653 +0000 UTC m=+0.383187903}  } {IngressReady Unknown Error {2018-12-10 08:05:47.929434361 +0000 UTC m=+0.383197618}  } {Ready Unknown Error {2018-12-10 08:05:47.929504762 +0000 UTC m=+0.383268047}  }] 0}}	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.859] 	logger.go:130: 2018-12-10T08:05:47.930Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:307	All referred targets are routable, marking AllTrafficAssigned with traffic information.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.860] 	logger.go:130: 2018-12-10T08:05:47.930Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:233	Updating targeted revisions.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.860] 	logger.go:130: 2018-12-10T08:05:47.930Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:247	Creating ClusterIngress.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.860] 	logger.go:130: 2018-12-10T08:05:47.931Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:254	Creating/Updating placeholder k8s services	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.860] 	logger.go:130: 2018-12-10T08:05:47.931Z	WARN	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/reconcile_resources.go:106	Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.861] 	logger.go:130: 2018-12-10T08:05:47.931Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:259	Route successfully synced	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.861] 	logger.go:130: 2018-12-10T08:05:47.931Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	controller/controller.go:275	Reconcile succeeded. Time taken: 2.499454ms.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.861]     --- PASS: TestGlobalResyncOnUpdateDomainConfigMap/prod-domain.com (0.01s)
I1210 08:06:11.861] 	logger.go:130: 2018-12-10T08:05:47.933Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[test-domain.dev:0xc42000e058 mytestdomain.com:0xc42000e078]}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.862] 	logger.go:130: 2018-12-10T08:05:47.935Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller.event-broadcaster	reconciler/reconciler.go:107	Event(v1.ObjectReference{Kind:"Route", Namespace:"test", Name:"test-route", UID:"", APIVersion:"serving/v1alpha1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'Created' Created ClusterIngress ""	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.862] 	logger.go:130: 2018-12-10T08:05:47.937Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:225	Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[app:prod] map[] [] nil [] } {0 []} {test-route.test.prod-domain.com test-route.test.svc.cluster.local 0xc4203de640 [] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.930146359 +0000 UTC m=+0.383909600}  } {IngressReady Unknown Error {2018-12-10 08:05:47.929434361 +0000 UTC m=+0.383197618}  } {Ready Unknown Error {2018-12-10 08:05:47.929504762 +0000 UTC m=+0.383268047}  }] 0}}	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.862] 	logger.go:130: 2018-12-10T08:05:47.937Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:307	All referred targets are routable, marking AllTrafficAssigned with traffic information.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.863] 	logger.go:130: 2018-12-10T08:05:47.938Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:233	Updating targeted revisions.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.863] 	logger.go:130: 2018-12-10T08:05:47.938Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:247	Creating ClusterIngress.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.863] 	logger.go:130: 2018-12-10T08:05:47.938Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:254	Creating/Updating placeholder k8s services	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.863] 	logger.go:130: 2018-12-10T08:05:47.938Z	WARN	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/reconcile_resources.go:106	Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.864] 	logger.go:130: 2018-12-10T08:05:47.938Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:259	Route successfully synced	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.864] 	logger.go:130: 2018-12-10T08:05:47.939Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	controller/controller.go:275	Reconcile succeeded. Time taken: 1.932683ms.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.864]     --- PASS: TestGlobalResyncOnUpdateDomainConfigMap/mytestdomain.com (0.01s)
I1210 08:06:11.864] 	logger.go:130: 2018-12-10T08:05:47.940Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[test-domain.dev:0xc420464020 newprod.net:0xc420464028]}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.865] 	logger.go:130: 2018-12-10T08:05:47.951Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:225	Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[app:prod] map[] [] nil [] } {0 []} {test-route.test.mytestdomain.com test-route.test.svc.cluster.local 0xc4203df0b0 [] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.930146359 +0000 UTC m=+0.383909600}  } {IngressReady Unknown Error {2018-12-10 08:05:47.929434361 +0000 UTC m=+0.383197618}  } {Ready Unknown Error {2018-12-10 08:05:47.929504762 +0000 UTC m=+0.383268047}  }] 0}}	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.865] 	logger.go:130: 2018-12-10T08:05:47.951Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:307	All referred targets are routable, marking AllTrafficAssigned with traffic information.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.865] 	logger.go:130: 2018-12-10T08:05:47.952Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:233	Updating targeted revisions.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.866] 	logger.go:130: 2018-12-10T08:05:47.952Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:247	Creating ClusterIngress.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.867] 	logger.go:130: 2018-12-10T08:05:47.952Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:254	Creating/Updating placeholder k8s services	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.867] 	logger.go:130: 2018-12-10T08:05:47.952Z	WARN	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/reconcile_resources.go:106	Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.867] 	logger.go:130: 2018-12-10T08:05:47.953Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:259	Route successfully synced	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.867] 	logger.go:130: 2018-12-10T08:05:47.953Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	controller/controller.go:275	Reconcile succeeded. Time taken: 2.361489ms.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.868] 	logger.go:130: 2018-12-10T08:05:47.954Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:225	Reconciling route :&{{ } {test-route  test /apis/serving/v1alpha1/namespaces/test/Routes/test-route   0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[app:prod] map[] [] nil [] } {0 []} {test-route.test.mytestdomain.com test-route.test.svc.cluster.local 0xc4203df890 [] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.930146359 +0000 UTC m=+0.383909600}  } {IngressReady Unknown Error {2018-12-10 08:05:47.929434361 +0000 UTC m=+0.383197618}  } {Ready Unknown Error {2018-12-10 08:05:47.929504762 +0000 UTC m=+0.383268047}  }] 0}}	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.868] 	logger.go:130: 2018-12-10T08:05:47.954Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:307	All referred targets are routable, marking AllTrafficAssigned with traffic information.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.869] 	logger.go:130: 2018-12-10T08:05:47.954Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:233	Updating targeted revisions.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.869] 	logger.go:130: 2018-12-10T08:05:47.954Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:247	Creating ClusterIngress.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.869] 	logger.go:130: 2018-12-10T08:05:47.954Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:254	Creating/Updating placeholder k8s services	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.869] 	logger.go:130: 2018-12-10T08:05:47.955Z	WARN	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/reconcile_resources.go:106	Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.870] 	logger.go:130: 2018-12-10T08:05:47.955Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	route/route.go:259	Route successfully synced	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.870] 	logger.go:130: 2018-12-10T08:05:47.955Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	controller/controller.go:275	Reconcile succeeded. Time taken: 1.714526ms.	{"knative.dev/controller": "route-controller", "knative.dev/key": "test/test-route"}
I1210 08:06:11.870]     --- PASS: TestGlobalResyncOnUpdateDomainConfigMap/newprod.net (0.02s)
I1210 08:06:11.870] 	logger.go:130: 2018-12-10T08:05:47.956Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller.config-store	configmap/store.go:166	route config "config-domain" config was added or updated: &{map[test-domain.dev:0xc42000e3c0]}	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.870]     --- FAIL: TestGlobalResyncOnUpdateDomainConfigMap/test-domain.dev (0.00s)
I1210 08:06:11.871]     	route_test.go:978: Expected domain "test-route.test.test-domain.dev" but saw "test-route.test.newprod.net"
I1210 08:06:11.871] 	logger.go:130: 2018-12-10T08:05:47.958Z	INFO	TestGlobalResyncOnUpdateDomainConfigMap.route-controller	controller/controller.go:225	Shutting down workers	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.871] === RUN   TestReconcile
I1210 08:06:11.871] === RUN   TestReconcile/bad_workqueue_key
I1210 08:06:11.871] === RUN   TestReconcile/key_not_found
I1210 08:06:11.872] {"level":"error","ts":1544429148.0702868,"logger":"fallback","caller":"route/route.go:189","msg":"route \"foo/not-found\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/route.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/route/route.go:189\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.872] === RUN   TestReconcile/configuration_not_yet_ready
I1210 08:06:11.872] {"level":"info","ts":1544429148.1004367,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {first-reconcile  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  not-ready 100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:48.100152392 +0000 UTC m=+0.553915779}  } {IngressReady Unknown Error {2018-12-10 08:05:48.100163035 +0000 UTC m=+0.553926267}  } {Ready Unknown Error {2018-12-10 08:05:48.10017428 +0000 UTC m=+0.553937513}  }] 0}}"}
I1210 08:06:11.872] === RUN   TestReconcile/configuration_permanently_failed
I1210 08:06:11.873] {"level":"info","ts":1544429148.1590087,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {first-reconcile  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  permanently-failed 100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:48.158667632 +0000 UTC m=+0.612430952}  } {IngressReady Unknown Error {2018-12-10 08:05:48.158678665 +0000 UTC m=+0.612441906}  } {Ready Unknown Error {2018-12-10 08:05:48.158689093 +0000 UTC m=+0.612452325}  }] 0}}"}
I1210 08:06:11.873] === RUN   TestReconcile/failure_updating_route_status
I1210 08:06:11.873] {"level":"info","ts":1544429148.2301059,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {first-reconcile  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  not-ready 100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:48.229804469 +0000 UTC m=+0.683567773}  } {IngressReady Unknown Error {2018-12-10 08:05:48.229814762 +0000 UTC m=+0.683578006}  } {Ready Unknown Error {2018-12-10 08:05:48.229828344 +0000 UTC m=+0.683591575}  }] 0}}"}
I1210 08:06:11.874] {"level":"warn","ts":1544429148.2382011,"logger":"fallback","caller":"route/route.go:206","msg":"Failed to update route status{error 25 0  inducing failure for update routes}"}
I1210 08:06:11.874] === RUN   TestReconcile/simple_route_becomes_ready,_ingress_unknown
I1210 08:06:11.874] {"level":"info","ts":1544429148.3384225,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {becomes-ready  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:48.338140153 +0000 UTC m=+0.791903477}  } {IngressReady Unknown Error {2018-12-10 08:05:48.33815048 +0000 UTC m=+0.791913719}  } {Ready Unknown Error {2018-12-10 08:05:48.338160217 +0000 UTC m=+0.791923458}  }] 0}}"}
I1210 08:06:11.874] {"level":"info","ts":1544429148.338842,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.874] {"level":"info","ts":1544429148.3390262,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.875] {"level":"info","ts":1544429148.3395603,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.875] {"level":"info","ts":1544429148.34358,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.875] {"level":"warn","ts":1544429148.343787,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.875] {"level":"info","ts":1544429148.343955,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.875] === RUN   TestReconcile/simple_route_becomes_ready
I1210 08:06:11.876] {"level":"info","ts":1544429148.3968666,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {becomes-ready  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:48.396575236 +0000 UTC m=+0.850338569}  } {IngressReady Unknown Error {2018-12-10 08:05:48.396585399 +0000 UTC m=+0.850348649}  } {Ready Unknown Error {2018-12-10 08:05:48.39659732 +0000 UTC m=+0.850360556}  }] 0}}"}
I1210 08:06:11.876] {"level":"info","ts":1544429148.409111,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.876] {"level":"info","ts":1544429148.409434,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.876] {"level":"info","ts":1544429148.4099884,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.876] {"level":"info","ts":1544429148.410796,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.876] {"level":"info","ts":1544429148.4111264,"logger":"fallback","caller":"route/reconcile_resources.go:120","msg":"Created service becomes-ready"}
I1210 08:06:11.877] {"level":"info","ts":1544429148.411307,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.877] === RUN   TestReconcile/failure_creating_k8s_placeholder_service
I1210 08:06:11.877] {"level":"info","ts":1544429148.4659846,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {create-svc-failure  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:48.465687904 +0000 UTC m=+0.919451209}  } {IngressReady Unknown Error {2018-12-10 08:05:48.465697848 +0000 UTC m=+0.919461084}  } {Ready Unknown Error {2018-12-10 08:05:48.465707787 +0000 UTC m=+0.919471112}  }] 0}}"}
I1210 08:06:11.877] {"level":"info","ts":1544429148.4663782,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.877] {"level":"info","ts":1544429148.4665487,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.878] {"level":"info","ts":1544429148.4670625,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.878] {"level":"info","ts":1544429148.467697,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.878] {"level":"error","ts":1544429148.4680188,"logger":"fallback","caller":"route/reconcile_resources.go:115","msg":"Failed to create service{error 25 0  inducing failure for create services}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/route.(*Reconciler).reconcilePlaceholderService\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/route/reconcile_resources.go:115\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/route.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/route/route.go:255\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/route.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/route/route.go:199\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.879] === RUN   TestReconcile/failure_creating_cluster_ingress
I1210 08:06:11.879] {"level":"info","ts":1544429148.5192778,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {ingress-create-failure  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:48.519017779 +0000 UTC m=+0.972781079}  } {IngressReady Unknown Error {2018-12-10 08:05:48.519027283 +0000 UTC m=+0.972790518}  } {Ready Unknown Error {2018-12-10 08:05:48.519037448 +0000 UTC m=+0.972800686}  }] 0}}"}
I1210 08:06:11.879] {"level":"info","ts":1544429148.519635,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.879] {"level":"info","ts":1544429148.5198216,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.879] {"level":"info","ts":1544429148.5203028,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.880] {"level":"error","ts":1544429148.5209723,"logger":"fallback","caller":"route/reconcile_resources.go:70","msg":"Failed to create ClusterIngress{error 25 0  inducing failure for create clusteringresses}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/route.(*Reconciler).reconcileClusterIngress\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/route/reconcile_resources.go:70\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/route.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/route/route.go:248\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/route.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/route/route.go:199\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.880] === RUN   TestReconcile/steady_state
I1210 08:06:11.881] {"level":"info","ts":1544429148.557465,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {steady-state  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {steady-state.default.example.com steady-state.default.svc.cluster.local 0xc420775560 [{ config-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.96372109 +0000 UTC m=+0.417484360}  } {IngressReady True Error {2018-12-10 08:05:47.963765396 +0000 UTC m=+0.417528651}  } {Ready True Error {2018-12-10 08:05:47.963780537 +0000 UTC m=+0.417543774}  }] 0}}"}
I1210 08:06:11.881] {"level":"info","ts":1544429148.5578494,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.881] {"level":"info","ts":1544429148.5580442,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.881] {"level":"info","ts":1544429148.558506,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.881] {"level":"info","ts":1544429148.5591416,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.881] {"level":"info","ts":1544429148.5593631,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.882] === RUN   TestReconcile/different_labels,_different_domain_-_steady_state
I1210 08:06:11.882] {"level":"info","ts":1544429148.590835,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {different-domain  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[app:prod] map[] [] nil [] } {0 [{  config 100}]} {different-domain.default.another-example.com different-domain.default.svc.cluster.local 0xc420a20660 [{ config-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.964453881 +0000 UTC m=+0.418217171}  } {IngressReady True Error {2018-12-10 08:05:47.96447608 +0000 UTC m=+0.418239395}  } {Ready True Error {2018-12-10 08:05:47.964490068 +0000 UTC m=+0.418253312}  }] 0}}"}
I1210 08:06:11.882] {"level":"info","ts":1544429148.5912125,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.882] {"level":"info","ts":1544429148.5914044,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.883] {"level":"info","ts":1544429148.5919838,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.883] {"level":"info","ts":1544429148.5926397,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.883] {"level":"info","ts":1544429148.5930164,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.883] === RUN   TestReconcile/new_latest_created_revision
I1210 08:06:11.883] {"level":"info","ts":1544429148.6458228,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {new-latest-created  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {new-latest-created.default.example.com new-latest-created.default.svc.cluster.local 0xc4208b94a0 [{ config-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.96511465 +0000 UTC m=+0.418877890}  } {IngressReady True Error {2018-12-10 08:05:47.965137447 +0000 UTC m=+0.418900690}  } {Ready True Error {2018-12-10 08:05:47.965155929 +0000 UTC m=+0.418919169}  }] 0}}"}
I1210 08:06:11.884] {"level":"info","ts":1544429148.6462204,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.884] {"level":"info","ts":1544429148.6464276,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.884] {"level":"info","ts":1544429148.6468885,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.884] {"level":"info","ts":1544429148.6475265,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.884] {"level":"info","ts":1544429148.6477094,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.884] === RUN   TestReconcile/new_latest_ready_revision
I1210 08:06:11.885] {"level":"info","ts":1544429148.68341,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {new-latest-ready  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {new-latest-ready.default.example.com new-latest-ready.default.svc.cluster.local 0xc4204aab50 [{ config-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.965850008 +0000 UTC m=+0.419613248}  } {IngressReady True Error {2018-12-10 08:05:47.965875202 +0000 UTC m=+0.419638442}  } {Ready True Error {2018-12-10 08:05:47.965890257 +0000 UTC m=+0.419653493}  }] 0}}"}
I1210 08:06:11.885] {"level":"info","ts":1544429148.6838357,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.885] {"level":"info","ts":1544429148.6840239,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.885] {"level":"info","ts":1544429148.684535,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.886] {"level":"info","ts":1544429148.6853237,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.886] {"level":"info","ts":1544429148.6855004,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.886] === RUN   TestReconcile/failure_updating_cluster_ingress
I1210 08:06:11.886] {"level":"info","ts":1544429148.738017,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {update-ci-failure  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {update-ci-failure.default.example.com update-ci-failure.default.svc.cluster.local 0xc420784230 [{ config-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.966978517 +0000 UTC m=+0.420741761}  } {IngressReady True Error {2018-12-10 08:05:47.966995567 +0000 UTC m=+0.420758801}  } {Ready True Error {2018-12-10 08:05:47.967007671 +0000 UTC m=+0.420770911}  }] 0}}"}
I1210 08:06:11.887] {"level":"info","ts":1544429148.7385433,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.887] {"level":"info","ts":1544429148.7387998,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.887] {"level":"info","ts":1544429148.7394931,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.888] {"level":"error","ts":1544429148.7403934,"logger":"fallback","caller":"route/reconcile_resources.go:88","msg":"Failed to update ClusterIngress{error 25 0  inducing failure for update clusteringresses}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/route.(*Reconciler).reconcileClusterIngress\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/route/reconcile_resources.go:88\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/route.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/route/route.go:248\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/route.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/route/route.go:199\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.888] === RUN   TestReconcile/reconcile_service_mutation
I1210 08:06:11.888] {"level":"info","ts":1544429148.8040202,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {svc-mutation  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {svc-mutation.default.example.com svc-mutation.default.svc.cluster.local 0xc420920080 [{ config-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.968018188 +0000 UTC m=+0.421781428}  } {IngressReady True Error {2018-12-10 08:05:47.968039433 +0000 UTC m=+0.421802673}  } {Ready True Error {2018-12-10 08:05:47.968052744 +0000 UTC m=+0.421815984}  }] 0}}"}
I1210 08:06:11.888] {"level":"info","ts":1544429148.8044612,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.889] {"level":"info","ts":1544429148.8046894,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.889] {"level":"info","ts":1544429148.8062894,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.889] {"level":"info","ts":1544429148.8070388,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.889] {"level":"info","ts":1544429148.8073099,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.889] === RUN   TestReconcile/failure_updating_k8s_service
I1210 08:06:11.890] {"level":"info","ts":1544429148.8469224,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {svc-mutation  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {svc-mutation.default.example.com svc-mutation.default.svc.cluster.local 0xc42089f820 [{ config-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.968704809 +0000 UTC m=+0.422468047}  } {IngressReady True Error {2018-12-10 08:05:47.968725207 +0000 UTC m=+0.422488505}  } {Ready True Error {2018-12-10 08:05:47.968757558 +0000 UTC m=+0.422520798}  }] 0}}"}
I1210 08:06:11.890] {"level":"info","ts":1544429148.8474016,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.890] {"level":"info","ts":1544429148.8476057,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.890] {"level":"info","ts":1544429148.8480713,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.890] {"level":"info","ts":1544429148.8486123,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.890] === RUN   TestReconcile/drop_cluster_ip
I1210 08:06:11.891] {"level":"info","ts":1544429148.883728,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {cluster-ip  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {cluster-ip.default.example.com cluster-ip.default.svc.cluster.local 0xc4201290f0 [{ config-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.969464842 +0000 UTC m=+0.423228082}  } {IngressReady True Error {2018-12-10 08:05:47.96948625 +0000 UTC m=+0.423249626}  } {Ready True Error {2018-12-10 08:05:47.969506366 +0000 UTC m=+0.423269608}  }] 0}}"}
I1210 08:06:11.891] {"level":"info","ts":1544429148.8841481,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.891] {"level":"info","ts":1544429148.8843176,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.891] {"level":"info","ts":1544429148.8848174,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.891] {"level":"info","ts":1544429148.8854277,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.892] {"level":"info","ts":1544429148.8857226,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.892] === RUN   TestReconcile/fix_external_name
I1210 08:06:11.892] {"level":"info","ts":1544429148.9227934,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {external-name  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {external-name.default.example.com external-name.default.svc.cluster.local 0xc4209ffe20 [{ config-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.970242521 +0000 UTC m=+0.424005764}  } {IngressReady True Error {2018-12-10 08:05:47.970262993 +0000 UTC m=+0.424026249}  } {Ready True Error {2018-12-10 08:05:47.970283255 +0000 UTC m=+0.424046495}  }] 0}}"}
I1210 08:06:11.892] {"level":"info","ts":1544429148.92318,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.893] {"level":"info","ts":1544429148.923345,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.893] {"level":"info","ts":1544429148.9238203,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.893] {"level":"info","ts":1544429148.9244542,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.893] {"level":"info","ts":1544429148.9246867,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.893] === RUN   TestReconcile/reconcile_cluster_ingress_mutation
I1210 08:06:11.894] {"level":"info","ts":1544429148.9822824,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {ingress-mutation  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {ingress-mutation.default.example.com ingress-mutation.default.svc.cluster.local 0xc4203f8570 [{ config-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.971050347 +0000 UTC m=+0.424813590}  } {IngressReady True Error {2018-12-10 08:05:47.971076398 +0000 UTC m=+0.424839745}  } {Ready True Error {2018-12-10 08:05:47.971095848 +0000 UTC m=+0.424859087}  }] 0}}"}
I1210 08:06:11.894] {"level":"info","ts":1544429148.9826884,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.894] {"level":"info","ts":1544429148.9829466,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.894] {"level":"info","ts":1544429148.983423,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.894] {"level":"info","ts":1544429148.9842668,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.895] {"level":"info","ts":1544429148.984519,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.895] === RUN   TestReconcile/switch_to_a_different_config
I1210 08:06:11.895] {"level":"info","ts":1544429149.0251336,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {change-configs  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  newconfig 100}]} {change-configs.default.example.com change-configs.default.svc.cluster.local 0xc420849890 [{ oldconfig-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.971896647 +0000 UTC m=+0.425659882}  } {IngressReady True Error {2018-12-10 08:05:47.971914796 +0000 UTC m=+0.425678048}  } {Ready True Error {2018-12-10 08:05:47.971926731 +0000 UTC m=+0.425689971}  }] 0}}"}
I1210 08:06:11.895] {"level":"info","ts":1544429149.0255723,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.896] {"level":"info","ts":1544429149.0258389,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.896] {"level":"info","ts":1544429149.0263925,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.896] {"level":"info","ts":1544429149.0273252,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.896] {"level":"info","ts":1544429149.0275738,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.896] === RUN   TestReconcile/configuration_missing
I1210 08:06:11.897] {"level":"info","ts":1544429149.0752556,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {config-missing  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  not-found 100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:49.07497816 +0000 UTC m=+1.528741467}  } {IngressReady Unknown Error {2018-12-10 08:05:49.074988829 +0000 UTC m=+1.528752092}  } {Ready Unknown Error {2018-12-10 08:05:49.074999695 +0000 UTC m=+1.528762943}  }] 0}}"}
I1210 08:06:11.897] === RUN   TestReconcile/revision_missing_(direct)
I1210 08:06:11.897] {"level":"info","ts":1544429149.1527193,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {missing-revision-direct  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{ not-found  100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:49.152416514 +0000 UTC m=+1.606179826}  } {IngressReady Unknown Error {2018-12-10 08:05:49.152426859 +0000 UTC m=+1.606190117}  } {Ready Unknown Error {2018-12-10 08:05:49.152436374 +0000 UTC m=+1.606199618}  }] 0}}"}
I1210 08:06:11.897] === RUN   TestReconcile/revision_missing_(indirect)
I1210 08:06:11.898] {"level":"info","ts":1544429149.2126539,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {missing-revision-indirect  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:49.212431943 +0000 UTC m=+1.666195239}  } {IngressReady Unknown Error {2018-12-10 08:05:49.212440329 +0000 UTC m=+1.666203566}  } {Ready Unknown Error {2018-12-10 08:05:49.212448741 +0000 UTC m=+1.666211978}  }] 0}}"}
I1210 08:06:11.898] === RUN   TestReconcile/pinned_route_becomes_ready
I1210 08:06:11.898] {"level":"info","ts":1544429149.2471545,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {pinned-becomes-ready  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{ config-00001  100}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:49.246904107 +0000 UTC m=+1.700667406}  } {IngressReady Unknown Error {2018-12-10 08:05:49.246912608 +0000 UTC m=+1.700675839}  } {Ready Unknown Error {2018-12-10 08:05:49.246921148 +0000 UTC m=+1.700684384}  }] 0}}"}
I1210 08:06:11.898] {"level":"info","ts":1544429149.247443,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.899] {"level":"info","ts":1544429149.2475886,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.899] {"level":"info","ts":1544429149.24832,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.899] {"level":"info","ts":1544429149.2488136,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.899] {"level":"info","ts":1544429149.2489214,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.899] === RUN   TestReconcile/traffic_split_becomes_ready
I1210 08:06:11.900] {"level":"info","ts":1544429149.3544698,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {named-traffic-split  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  blue 50} {  green 50}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:49.354068282 +0000 UTC m=+1.807831638}  } {IngressReady Unknown Error {2018-12-10 08:05:49.354082415 +0000 UTC m=+1.807845717}  } {Ready Unknown Error {2018-12-10 08:05:49.354098762 +0000 UTC m=+1.807862057}  }] 0}}"}
I1210 08:06:11.900] {"level":"info","ts":1544429149.354919,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.900] {"level":"info","ts":1544429149.3550832,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.900] {"level":"info","ts":1544429149.3555999,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.900] {"level":"info","ts":1544429149.356387,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.901] {"level":"warn","ts":1544429149.356508,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.901] {"level":"info","ts":1544429149.3565927,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.901] === RUN   TestReconcile/same_revision_targets
I1210 08:06:11.901] {"level":"info","ts":1544429149.4633083,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {same-revision-targets  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{gray  gray 50} {also-gray gray-00001  50}]} {  <nil> [] [{AllTrafficAssigned Unknown Error {2018-12-10 08:05:49.462918797 +0000 UTC m=+1.916682149}  } {IngressReady Unknown Error {2018-12-10 08:05:49.462928786 +0000 UTC m=+1.916692057}  } {Ready Unknown Error {2018-12-10 08:05:49.46296254 +0000 UTC m=+1.916725789}  }] 0}}"}
I1210 08:06:11.902] {"level":"info","ts":1544429149.4636767,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.902] {"level":"info","ts":1544429149.4638448,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.902] {"level":"info","ts":1544429149.4694545,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.902] {"level":"info","ts":1544429149.4706004,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.902] {"level":"warn","ts":1544429149.470795,"logger":"fallback","caller":"route/reconcile_resources.go:106","msg":"Failed to construct placeholder k8s service: failed to fetch loadbalancer domain/IP from ingress status"}
I1210 08:06:11.902] {"level":"info","ts":1544429149.470955,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.903] === RUN   TestReconcile/change_route_configuration
I1210 08:06:11.903] {"level":"info","ts":1544429149.5161421,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {switch-configs  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  green 100}]} {switch-configs.default.example.com switch-configs.default.svc.cluster.local 0xc4208493c0 [{blue blue-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.975360595 +0000 UTC m=+0.429123839}  } {IngressReady True Error {2018-12-10 08:05:47.975380825 +0000 UTC m=+0.429144066}  } {Ready True Error {2018-12-10 08:05:47.975400731 +0000 UTC m=+0.429163971}  }] 0}}"}
I1210 08:06:11.903] {"level":"info","ts":1544429149.5165477,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.903] {"level":"info","ts":1544429149.516763,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.904] {"level":"info","ts":1544429149.5172784,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.904] {"level":"info","ts":1544429149.5181139,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.904] {"level":"info","ts":1544429149.5183218,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.904] === RUN   TestReconcile/Update_stale_lastPinned
I1210 08:06:11.905] {"level":"info","ts":1544429149.567829,"logger":"fallback","caller":"route/route.go:225","msg":"Reconciling route :&{{ } {stale-lastpinned  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] nil [] } {0 [{  config 100}]} {stale-lastpinned.default.example.com stale-lastpinned.default.svc.cluster.local 0xc420a2a560 [{ config-00001  100}] [{AllTrafficAssigned True Error {2018-12-10 08:05:47.986671344 +0000 UTC m=+0.440434584}  } {IngressReady True Error {2018-12-10 08:05:47.986689032 +0000 UTC m=+0.440452339}  } {Ready True Error {2018-12-10 08:05:47.986702095 +0000 UTC m=+0.440465335}  }] 0}}"}
I1210 08:06:11.905] {"level":"info","ts":1544429149.5681975,"logger":"fallback","caller":"route/route.go:307","msg":"All referred targets are routable, marking AllTrafficAssigned with traffic information."}
I1210 08:06:11.905] {"level":"info","ts":1544429149.5683954,"logger":"fallback","caller":"route/route.go:233","msg":"Updating targeted revisions."}
I1210 08:06:11.905] {"level":"info","ts":1544429149.576131,"logger":"fallback","caller":"route/route.go:247","msg":"Creating ClusterIngress."}
I1210 08:06:11.905] {"level":"info","ts":1544429149.576836,"logger":"fallback","caller":"route/route.go:254","msg":"Creating/Updating placeholder k8s services"}
I1210 08:06:11.905] {"level":"info","ts":1544429149.5770988,"logger":"fallback","caller":"route/route.go:259","msg":"Route successfully synced"}
I1210 08:06:11.906] --- PASS: TestReconcile (1.63s)
I1210 08:06:11.906]     --- PASS: TestReconcile/bad_workqueue_key (0.03s)
I1210 08:06:11.906]     	logger.go:130: 2018-12-10T08:05:48.015Z	ERROR	TestReconcile/bad_workqueue_key.route-controller	route/route.go:178	invalid resource key: too/many/parts	{"knative.dev/controller": "route-controller"}
I1210 08:06:11.906]     --- PASS: TestReconcile/key_not_found (0.05s)
I1210 08:06:11.906]     --- PASS: TestReconcile/configuration_not_yet_ready (0.03s)
I1210 08:06:11.906]     --- PASS: TestReconcile/configuration_permanently_failed (0.05s)
I1210 08:06:11.906]     --- PASS: TestReconcile/failure_updating_route_status (0.07s)
I1210 08:06:11.907]     --- PASS: TestReconcile/simple_route_becomes_ready,_ingress_unknown (0.09s)
I1210 08:06:11.907]     --- PASS: TestReconcile/simple_route_becomes_ready (0.06s)
... skipping 15 lines ...
I1210 08:06:11.909]     --- PASS: TestReconcile/revision_missing_(indirect) (0.05s)
I1210 08:06:11.909]     --- PASS: TestReconcile/pinned_route_becomes_ready (0.03s)
I1210 08:06:11.909]     --- PASS: TestReconcile/traffic_split_becomes_ready (0.09s)
I1210 08:06:11.909]     --- PASS: TestReconcile/same_revision_targets (0.08s)
I1210 08:06:11.909]     --- PASS: TestReconcile/change_route_configuration (0.03s)
I1210 08:06:11.910]     --- PASS: TestReconcile/Update_stale_lastPinned (0.03s)
I1210 08:06:11.910] FAIL
I1210 08:06:11.910] FAIL	github.com/knative/serving/pkg/reconciler/v1alpha1/route	2.402s
I1210 08:06:11.910] === RUN   TestSelectorMatches
I1210 08:06:11.910] --- PASS: TestSelectorMatches (0.00s)
I1210 08:06:11.910] === RUN   TestNewConfigNoEntry
I1210 08:06:11.910] --- PASS: TestNewConfigNoEntry (0.00s)
I1210 08:06:11.910] === RUN   TestNewConfigBadYaml
I1210 08:06:11.910] --- PASS: TestNewConfigBadYaml (0.00s)
... skipping 103 lines ...
I1210 08:06:11.923] --- PASS: TestRoundTripping (0.00s)
I1210 08:06:11.923] PASS
I1210 08:06:11.923] ok  	github.com/knative/serving/pkg/reconciler/v1alpha1/route/traffic	1.485s
I1210 08:06:11.923] === RUN   TestReconcile
I1210 08:06:11.923] === RUN   TestReconcile/bad_workqueue_key
I1210 08:06:11.924] === RUN   TestReconcile/key_not_found
I1210 08:06:11.924] {"level":"error","ts":1544429158.9138844,"logger":"fallback","caller":"service/service.go:117","msg":"service \"foo/not-found\" in work queue no longer exists","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:117\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.924] === RUN   TestReconcile/incomplete_service
I1210 08:06:11.925] {"level":"error","ts":1544429158.9419122,"logger":"fallback","caller":"service/service.go:169","msg":"Failed to create Configuration \"incomplete\": malformed Service: MakeConfiguration requires one of runLatest, pinned, or release must be present","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:169\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:134\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.925] === RUN   TestReconcile/runLatest_-_create_route_and_service
I1210 08:06:11.925] === RUN   TestReconcile/pinned_-_create_route_and_service
I1210 08:06:11.925] === RUN   TestReconcile/pinned_-_create_route_and_service_-_via_release
I1210 08:06:11.925] === RUN   TestReconcile/pinned_-_with_ready_config_and_route
I1210 08:06:11.925] === RUN   TestReconcile/release_-_create_route_and_service
I1210 08:06:11.925] === RUN   TestReconcile/release_-_create_route_and_service_and_percentage
I1210 08:06:11.926] === RUN   TestReconcile/manual-_no_creates
I1210 08:06:11.926] === RUN   TestReconcile/runLatest_-_no_updates
I1210 08:06:11.926] === RUN   TestReconcile/runLatest_-_update_route_and_service
I1210 08:06:11.926] {"level":"info","ts":1544429159.349244,"logger":"fallback","caller":"service/service.go:256","msg":"Reconciling configuration diff (-desired, +observed): {v1alpha1.ConfigurationSpec}.RevisionTemplate.Spec.ConcurrencyModel:\n\t-: v1alpha1.RevisionRequestConcurrencyModelType(\"\")\n\t+: v1alpha1.RevisionRequestConcurrencyModelType(\"Single\")\n"}
I1210 08:06:11.926] {"level":"info","ts":1544429159.3500452,"logger":"fallback","caller":"service/service.go:297","msg":"Reconciling route diff (-desired, +observed): {v1alpha1.RouteSpec}.Traffic:\n\t-: []v1alpha1.TrafficTarget{{ConfigurationName: \"update-route-and-config\", Percent: 100}}\n\t+: []v1alpha1.TrafficTarget(nil)\n"}
I1210 08:06:11.926] === RUN   TestReconcile/runLatest_-_bad_config_update
I1210 08:06:11.927] {"level":"error","ts":1544429159.3915575,"logger":"fallback","caller":"service/service.go:178","msg":"Failed to reconcile Service: \"bad-config-update\" failed to reconcile Configuration: \"bad-config-update\"; {error 25 0  malformed Service: MakeConfiguration requires one of runLatest, pinned, or release must be present}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:178\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:134\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.927] === RUN   TestReconcile/runLatest_-_route_creation_failure
I1210 08:06:11.928] {"level":"error","ts":1544429159.4171078,"logger":"fallback","caller":"service/service.go:190","msg":"Failed to create Route \"create-route-failure\": inducing failure for create routes","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:190\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:134\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.928] === RUN   TestReconcile/runLatest_-_configuration_creation_failure
I1210 08:06:11.929] {"level":"error","ts":1544429159.460344,"logger":"fallback","caller":"service/service.go:169","msg":"Failed to create Configuration \"create-config-failure\": inducing failure for create configurations","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:169\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:134\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.929] === RUN   TestReconcile/runLatest_-_update_route_failure
I1210 08:06:11.929] {"level":"info","ts":1544429159.5172825,"logger":"fallback","caller":"service/service.go:297","msg":"Reconciling route diff (-desired, +observed): {v1alpha1.RouteSpec}.Traffic:\n\t-: []v1alpha1.TrafficTarget{{ConfigurationName: \"update-route-failure\", Percent: 100}}\n\t+: []v1alpha1.TrafficTarget(nil)\n"}
I1210 08:06:11.930] {"level":"error","ts":1544429159.5176427,"logger":"fallback","caller":"service/service.go:199","msg":"Failed to reconcile Service: \"update-route-failure\" failed to reconcile Route: \"update-route-failure\"","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:199\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:134\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.930] === RUN   TestReconcile/runLatest_-_update_config_failure
I1210 08:06:11.930] {"level":"info","ts":1544429159.5505295,"logger":"fallback","caller":"service/service.go:256","msg":"Reconciling configuration diff (-desired, +observed): {v1alpha1.ConfigurationSpec}.RevisionTemplate.Spec.ConcurrencyModel:\n\t-: v1alpha1.RevisionRequestConcurrencyModelType(\"\")\n\t+: v1alpha1.RevisionRequestConcurrencyModelType(\"Single\")\n"}
I1210 08:06:11.931] {"level":"error","ts":1544429159.5510643,"logger":"fallback","caller":"service/service.go:178","msg":"Failed to reconcile Service: \"update-config-failure\" failed to reconcile Configuration: \"update-config-failure\"; {error 25 0  inducing failure for update configurations}","stacktrace":"github.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:178\ngithub.com/knative/serving/pkg/reconciler/v1alpha1/service.(*Reconciler).Reconcile\n\t/go/src/github.com/knative/serving/pkg/reconciler/v1alpha1/service/service.go:134\ngithub.com/knative/serving/pkg/reconciler/testing.(*TableRow).Test\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:92\ngithub.com/knative/serving/pkg/reconciler/testing.TableTest.Test.func1\n\t/go/src/github.com/knative/serving/pkg/reconciler/testing/table.go:233\ntesting.tRunner\n\t/usr/local/go/src/testing/testing.go:777"}
I1210 08:06:11.931] === RUN   TestReconcile/runLatest_-_failure_updating_service_status
I1210 08:06:11.931] {"level":"warn","ts":1544429159.599008,"logger":"fallback","caller":"service/service.go:142","msg":"Failed to update service status{error 25 0  inducing failure for update services}"}
I1210 08:06:11.931] === RUN   TestReconcile/runLatest_-_route_and_config_ready,_propagate_ready
I1210 08:06:11.931] === RUN   TestReconcile/runLatest_-_config_fails,_propagate_failure
I1210 08:06:11.931] === RUN   TestReconcile/runLatest_-_route_fails,_propagate_failure
I1210 08:06:11.931] --- PASS: TestReconcile (0.87s)
I1210 08:06:11.932]     --- PASS: TestReconcile/bad_workqueue_key (0.02s)
I1210 08:06:11.932]     	logger.go:130: 2018-12-10T08:05:58.896Z	ERROR	TestReconcile/bad_workqueue_key.service-controller	service/service.go:108	invalid resource key: too/many/parts	{"knative.dev/controller": "service-controller"}
I1210 08:06:11.932]     --- PASS: TestReconcile/key_not_found (0.02s)
I1210 08:06:11.932]     --- PASS: TestReconcile/incomplete_service (0.03s)
I1210 08:06:11.932]     --- PASS: TestReconcile/runLatest_-_create_route_and_service (0.05s)
I1210 08:06:11.932]     --- PASS: TestReconcile/pinned_-_create_route_and_service (0.04s)
I1210 08:06:11.932]     --- PASS: TestReconcile/pinned_-_create_route_and_service_-_via_release (0.06s)
I1210 08:06:11.933]     --- PASS: TestReconcile/pinned_-_with_ready_config_and_route (0.03s)
... skipping 732 lines ...
I1210 08:25:38.838] - TestHelloWorldFromShell :PASS:
I1210 08:25:38.847] - TestHelloWorld :PASS:
I1210 08:25:38.863] - TestCustomResourcesLimits :PASS:
I1210 08:25:38.936] - TestScaleTo10 :PASS:
I1210 08:25:38.959] - TestServiceToServiceCall :PASS:
I1210 08:25:38.962] - ok github.com/knative/serving/test/e2e
I1210 08:25:38.969] Done parsing 20 tests, 0 tests failed
I1210 08:25:44.134] **************************************
I1210 08:25:44.135] ***        E2E TESTS PASSED        ***
I1210 08:25:44.135] **************************************
I1210 08:25:44.138] =======================================
I1210 08:25:44.138] ==== TEARING DOWN TEST ENVIRONMENT ====
I1210 08:25:44.138] =======================================
... skipping 144 lines ...
I1210 08:25:58.159] deployment.extensions "istio-galley" deleted
I1210 08:25:59.259] deployment.extensions "istio-egressgateway" deleted
I1210 08:26:00.422] mutatingwebhookconfiguration.admissionregistration.k8s.io "istio-sidecar-injector" deleted
I1210 08:26:00.632] clusterrolebinding.rbac.authorization.k8s.io "cluster-admin-binding" deleted
W1210 08:26:00.764] 2018/12/10 08:26:00 process.go:155: Step '/go/src/github.com/knative/serving/test/e2e-tests.sh --run-tests' finished in 14m57.610357833s
W1210 08:26:00.765] 2018/12/10 08:26:00 process.go:153: Running: gcloud container clusters delete -q kserving-e2e-cls1072038636494524417 --project=knative-boskos-15 --region=us-central1
W1210 08:26:00.765] sh: 0: getcwd() failed: No such file or directory
W1210 08:26:00.904] sh: 0: getcwd() failed: No such file or directory
W1210 08:26:01.028] sh: 0: getcwd() failed: No such file or directory
W1210 08:26:01.396] Deleting cluster kserving-e2e-cls1072038636494524417...
W1210 08:29:38.735] .........................................................................................................................................................................................................................done.
W1210 08:29:39.671] Deleted [https://container.googleapis.com/v1/projects/knative-boskos-15/zones/us-central1/clusters/kserving-e2e-cls1072038636494524417].
W1210 08:29:39.762] 2018/12/10 08:29:39 process.go:155: Step 'gcloud container clusters delete -q kserving-e2e-cls1072038636494524417 --project=knative-boskos-15 --region=us-central1' finished in 3m38.998607958s
W1210 08:29:39.763] 2018/12/10 08:29:39 process.go:153: Running: gcloud compute firewall-rules describe e2e-ports-84b55602 --project=knative-boskos-15 --format=value(name)
W1210 08:29:40.491] 2018/12/10 08:29:40 process.go:155: Step 'gcloud compute firewall-rules describe e2e-ports-84b55602 --project=knative-boskos-15 --format=value(name)' finished in 728.791353ms
W1210 08:29:40.492] 2018/12/10 08:29:40 gke.go:599: Found no rules for firewall 'e2e-ports-84b55602', assuming resources are clean
W1210 08:29:41.240] 2018/12/10 08:29:41 gke.go:565: Network kserving-e2e-net1072038636494524417 has 10 undeleted firewall rules [k8s-f176fc742f609236-node-http-hc k8s-fw-a4db61acffc5311e8bdd242010a80008 kserving-e2e-net1072038636494524417-2wnao3jebww7ldrn463stwke kserving-e2e-net1072038636494524417-7mzjmae3tlidh4yoidvnpe53 kserving-e2e-net1072038636494524417-knsku4qwwbtr3bhcf3y6vcmu kserving-e2e-net1072038636494524417-pjf5geul3rfwfyd5mynbasya kserving-e2e-net1072038636494524417-rpeifunzrsxxfwyacvtmctpr kserving-e2e-net1072038636494524417-uuaca3r2wn7yqlbdyzue5lrn kserving-e2e-net1072038636494524417-x233wi3sx7onq4enxk4rf6mk kserving-e2e-net1072038636494524417-yieefqzg6fev2ygounhzgoee]
W1210 08:29:41.241] 2018/12/10 08:29:41 process.go:153: Running: gcloud compute firewall-rules delete -q k8s-f176fc742f609236-node-http-hc k8s-fw-a4db61acffc5311e8bdd242010a80008 kserving-e2e-net1072038636494524417-2wnao3jebww7ldrn463stwke kserving-e2e-net1072038636494524417-7mzjmae3tlidh4yoidvnpe53 kserving-e2e-net1072038636494524417-knsku4qwwbtr3bhcf3y6vcmu kserving-e2e-net1072038636494524417-pjf5geul3rfwfyd5mynbasya kserving-e2e-net1072038636494524417-rpeifunzrsxxfwyacvtmctpr kserving-e2e-net1072038636494524417-uuaca3r2wn7yqlbdyzue5lrn kserving-e2e-net1072038636494524417-x233wi3sx7onq4enxk4rf6mk kserving-e2e-net1072038636494524417-yieefqzg6fev2ygounhzgoee --project=knative-boskos-15
W1210 08:29:41.241] sh: 0: getcwd() failed: No such file or directory
W1210 08:29:41.365] sh: 0: getcwd() failed: No such file or directory
W1210 08:29:41.498] sh: 0: getcwd() failed: No such file or directory
W1210 08:29:54.512] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-15/global/firewalls/kserving-e2e-net1072038636494524417-x233wi3sx7onq4enxk4rf6mk].
W1210 08:29:59.948] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-15/global/firewalls/k8s-f176fc742f609236-node-http-hc].
W1210 08:29:59.948] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-15/global/firewalls/kserving-e2e-net1072038636494524417-pjf5geul3rfwfyd5mynbasya].
W1210 08:30:05.225] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-15/global/firewalls/k8s-fw-a4db61acffc5311e8bdd242010a80008].
W1210 08:30:05.225] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-15/global/firewalls/kserving-e2e-net1072038636494524417-2wnao3jebww7ldrn463stwke].
W1210 08:30:05.225] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-15/global/firewalls/kserving-e2e-net1072038636494524417-7mzjmae3tlidh4yoidvnpe53].
W1210 08:30:05.225] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-15/global/firewalls/kserving-e2e-net1072038636494524417-knsku4qwwbtr3bhcf3y6vcmu].
W1210 08:30:05.226] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-15/global/firewalls/kserving-e2e-net1072038636494524417-rpeifunzrsxxfwyacvtmctpr].
W1210 08:30:05.226] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-15/global/firewalls/kserving-e2e-net1072038636494524417-uuaca3r2wn7yqlbdyzue5lrn].
W1210 08:30:05.226] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-15/global/firewalls/kserving-e2e-net1072038636494524417-yieefqzg6fev2ygounhzgoee].
W1210 08:30:05.344] 2018/12/10 08:30:05 process.go:155: Step 'gcloud compute firewall-rules delete -q k8s-f176fc742f609236-node-http-hc k8s-fw-a4db61acffc5311e8bdd242010a80008 kserving-e2e-net1072038636494524417-2wnao3jebww7ldrn463stwke kserving-e2e-net1072038636494524417-7mzjmae3tlidh4yoidvnpe53 kserving-e2e-net1072038636494524417-knsku4qwwbtr3bhcf3y6vcmu kserving-e2e-net1072038636494524417-pjf5geul3rfwfyd5mynbasya kserving-e2e-net1072038636494524417-rpeifunzrsxxfwyacvtmctpr kserving-e2e-net1072038636494524417-uuaca3r2wn7yqlbdyzue5lrn kserving-e2e-net1072038636494524417-x233wi3sx7onq4enxk4rf6mk kserving-e2e-net1072038636494524417-yieefqzg6fev2ygounhzgoee --project=knative-boskos-15' finished in 24.10456856s
W1210 08:30:05.345] 2018/12/10 08:30:05 process.go:153: Running: gcloud compute networks delete -q kserving-e2e-net1072038636494524417 --project=knative-boskos-15
W1210 08:30:05.345] sh: 0: getcwd() failed: No such file or directory
W1210 08:30:05.462] sh: 0: getcwd() failed: No such file or directory
W1210 08:30:05.586] sh: 0: getcwd() failed: No such file or directory
W1210 08:31:04.080] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-15/global/networks/kserving-e2e-net1072038636494524417].
W1210 08:31:04.243] 2018/12/10 08:31:04 process.go:155: Step 'gcloud compute networks delete -q kserving-e2e-net1072038636494524417 --project=knative-boskos-15' finished in 58.898237803s
W1210 08:31:05.250] 2018/12/10 08:31:05 main.go:309: Something went wrong: encountered 1 errors: [leaked firewall rules]
I1210 08:31:05.351] Test subprocess exited with code 1
I1210 08:31:07.092] Test result code is 0
I1210 08:31:07.093] Running integration test ./test/e2e-upgrade-tests.sh
... skipping 535 lines ...
I1210 08:39:14.889] ==================================
I1210 08:39:14.889] Running tests with 'go test -race -v  -count=1 -tags=preupgrade -timeout=10m ./test/upgrade '
I1210 08:39:37.080] Finished run, return code is 0
I1210 08:39:37.082] Start parsing results, summary:
I1210 08:39:37.092] - TestRunLatestServicePreUpgrade :PASS:
I1210 08:39:37.095] - ok github.com/knative/serving/test/upgrade
I1210 08:39:37.101] Done parsing 1 tests, 0 tests failed
I1210 08:39:41.606] =========================================
I1210 08:39:41.606] ==== INSTALLING KNATIVE HEAD RELEASE ====
I1210 08:39:41.606] =========================================
W1210 08:39:54.320] 2018/12/10 08:39:54 Using base gcr.io/distroless/base:latest for github.com/knative/serving/cmd/webhook
W1210 08:39:54.819] 2018/12/10 08:39:54 Using base gcr.io/distroless/base:latest for github.com/knative/serving/cmd/queue
W1210 08:39:54.997] 2018/12/10 08:39:54 Using base gcr.io/distroless/base:latest for github.com/knative/serving/cmd/queue
... skipping 350 lines ...
I1210 08:40:59.590] ===================================
I1210 08:40:59.590] Running tests with 'go test -race -v  -count=1 -tags=postupgrade -timeout=10m ./test/upgrade '
I1210 08:41:18.284] Finished run, return code is 0
I1210 08:41:18.286] Start parsing results, summary:
I1210 08:41:18.300] - TestRunLatestServicePostUpgrade :PASS:
I1210 08:41:18.304] - ok github.com/knative/serving/test/upgrade
I1210 08:41:18.313] Done parsing 1 tests, 0 tests failed
I1210 08:41:23.063] ==================================================
I1210 08:41:23.063] ==== INSTALLING KNATIVE LATEST PUBLIC RELEASE ====
I1210 08:41:23.064] ==================================================
I1210 08:41:23.064] >> Installing Knative serving
I1210 08:41:23.064] Istio CRD YAML: https://github.com/knative/serving/releases/download/v0.2.2/istio-crds.yaml
I1210 08:41:23.064] Istio YAML: https://github.com/knative/serving/releases/download/v0.2.2/istio.yaml
... skipping 283 lines ...
I1210 08:42:28.557] =====================================
I1210 08:42:28.558] Running tests with 'go test -race -v  -count=1 -tags=postdowngrade -timeout=10m ./test/upgrade '
I1210 08:42:41.699] Finished run, return code is 0
I1210 08:42:41.700] Start parsing results, summary:
I1210 08:42:41.712] - TestRunLatestServicePostDowngrade :PASS:
I1210 08:42:41.716] - ok github.com/knative/serving/test/upgrade
I1210 08:42:41.723] Done parsing 1 tests, 0 tests failed
I1210 08:42:46.426] **************************************
I1210 08:42:46.426] ***        E2E TESTS PASSED        ***
I1210 08:42:46.426] **************************************
I1210 08:42:46.429] =======================================
I1210 08:42:46.430] ==== TEARING DOWN TEST ENVIRONMENT ====
I1210 08:42:46.430] =======================================
... skipping 147 lines ...
I1210 08:43:06.710] deployment.extensions "istio-ingressgateway" deleted
I1210 08:43:07.865] horizontalpodautoscaler.autoscaling "istio-pilot" deleted
I1210 08:43:07.878] mutatingwebhookconfiguration.admissionregistration.k8s.io "istio-sidecar-injector" deleted
I1210 08:43:08.094] clusterrolebinding.rbac.authorization.k8s.io "cluster-admin-binding" deleted
W1210 08:43:08.237] 2018/12/10 08:43:08 process.go:155: Step '/go/src/github.com/knative/serving/test/e2e-upgrade-tests.sh --run-tests' finished in 6m59.031377494s
W1210 08:43:08.237] 2018/12/10 08:43:08 process.go:153: Running: gcloud container clusters delete -q kserving-e2e-cls1072038636494524417 --project=knative-boskos-14 --region=us-central1
W1210 08:43:08.238] sh: 0: getcwd() failed: No such file or directory
W1210 08:43:08.376] sh: 0: getcwd() failed: No such file or directory
W1210 08:43:08.504] sh: 0: getcwd() failed: No such file or directory
W1210 08:43:08.863] Deleting cluster kserving-e2e-cls1072038636494524417...
W1210 08:47:11.307] ..................................................................................................................................................................................................................................................done.
W1210 08:47:12.161] Deleted [https://container.googleapis.com/v1/projects/knative-boskos-14/zones/us-central1/clusters/kserving-e2e-cls1072038636494524417].
W1210 08:47:12.234] 2018/12/10 08:47:12 process.go:155: Step 'gcloud container clusters delete -q kserving-e2e-cls1072038636494524417 --project=knative-boskos-14 --region=us-central1' finished in 4m3.99744696s
W1210 08:47:12.234] 2018/12/10 08:47:12 process.go:153: Running: gcloud compute firewall-rules describe e2e-ports-8fe60700 --project=knative-boskos-14 --format=value(name)
W1210 08:47:12.960] 2018/12/10 08:47:12 process.go:155: Step 'gcloud compute firewall-rules describe e2e-ports-8fe60700 --project=knative-boskos-14 --format=value(name)' finished in 725.372381ms
W1210 08:47:12.960] 2018/12/10 08:47:12 gke.go:595: Found rules for firewall 'e2e-ports-8fe60700', deleting them
W1210 08:47:12.960] 2018/12/10 08:47:12 process.go:153: Running: gcloud compute firewall-rules delete -q e2e-ports-8fe60700 --project=knative-boskos-14
W1210 08:47:12.961] sh: 0: getcwd() failed: No such file or directory
W1210 08:47:13.086] sh: 0: getcwd() failed: No such file or directory
W1210 08:47:13.228] sh: 0: getcwd() failed: No such file or directory
W1210 08:47:13.675] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W1210 08:47:13.675]  - The resource 'projects/knative-boskos-14/global/firewalls/e2e-ports-8fe60700' is not ready
W1210 08:47:13.675] 
W1210 08:47:13.754] 2018/12/10 08:47:13 process.go:155: Step 'gcloud compute firewall-rules delete -q e2e-ports-8fe60700 --project=knative-boskos-14' finished in 794.002485ms
W1210 08:47:14.668] 2018/12/10 08:47:14 gke.go:565: Network kserving-e2e-net1072038636494524417 has 11 undeleted firewall rules [e2e-ports-8fe60700 k8s-fc1a7b7923dc5898-node-http-hc k8s-fw-ada5f9a79fc5611e8be8a42010a80004 kserving-e2e-net1072038636494524417-2wnao3jebww7ldrn463stwke kserving-e2e-net1072038636494524417-7mzjmae3tlidh4yoidvnpe53 kserving-e2e-net1072038636494524417-knsku4qwwbtr3bhcf3y6vcmu kserving-e2e-net1072038636494524417-pjf5geul3rfwfyd5mynbasya kserving-e2e-net1072038636494524417-rpeifunzrsxxfwyacvtmctpr kserving-e2e-net1072038636494524417-uuaca3r2wn7yqlbdyzue5lrn kserving-e2e-net1072038636494524417-x233wi3sx7onq4enxk4rf6mk kserving-e2e-net1072038636494524417-yieefqzg6fev2ygounhzgoee]
W1210 08:47:14.669] 2018/12/10 08:47:14 process.go:153: Running: gcloud compute firewall-rules delete -q e2e-ports-8fe60700 k8s-fc1a7b7923dc5898-node-http-hc k8s-fw-ada5f9a79fc5611e8be8a42010a80004 kserving-e2e-net1072038636494524417-2wnao3jebww7ldrn463stwke kserving-e2e-net1072038636494524417-7mzjmae3tlidh4yoidvnpe53 kserving-e2e-net1072038636494524417-knsku4qwwbtr3bhcf3y6vcmu kserving-e2e-net1072038636494524417-pjf5geul3rfwfyd5mynbasya kserving-e2e-net1072038636494524417-rpeifunzrsxxfwyacvtmctpr kserving-e2e-net1072038636494524417-uuaca3r2wn7yqlbdyzue5lrn kserving-e2e-net1072038636494524417-x233wi3sx7onq4enxk4rf6mk kserving-e2e-net1072038636494524417-yieefqzg6fev2ygounhzgoee --project=knative-boskos-14
W1210 08:47:14.669] sh: 0: getcwd() failed: No such file or directory
W1210 08:47:14.793] sh: 0: getcwd() failed: No such file or directory
W1210 08:47:14.925] sh: 0: getcwd() failed: No such file or directory
W1210 08:47:27.435] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-14/global/firewalls/k8s-fc1a7b7923dc5898-node-http-hc].
W1210 08:47:27.435] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-14/global/firewalls/kserving-e2e-net1072038636494524417-x233wi3sx7onq4enxk4rf6mk].
W1210 08:47:32.617] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-14/global/firewalls/k8s-fw-ada5f9a79fc5611e8be8a42010a80004].
W1210 08:47:32.617] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-14/global/firewalls/kserving-e2e-net1072038636494524417-2wnao3jebww7ldrn463stwke].
W1210 08:47:32.617] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-14/global/firewalls/kserving-e2e-net1072038636494524417-7mzjmae3tlidh4yoidvnpe53].
W1210 08:47:32.617] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-14/global/firewalls/kserving-e2e-net1072038636494524417-knsku4qwwbtr3bhcf3y6vcmu].
W1210 08:47:32.618] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-14/global/firewalls/kserving-e2e-net1072038636494524417-pjf5geul3rfwfyd5mynbasya].
W1210 08:47:32.618] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-14/global/firewalls/kserving-e2e-net1072038636494524417-rpeifunzrsxxfwyacvtmctpr].
W1210 08:47:32.618] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-14/global/firewalls/kserving-e2e-net1072038636494524417-uuaca3r2wn7yqlbdyzue5lrn].
W1210 08:47:32.618] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-14/global/firewalls/kserving-e2e-net1072038636494524417-yieefqzg6fev2ygounhzgoee].
W1210 08:47:32.620] ERROR: (gcloud.compute.firewall-rules.delete) Could not fetch resource:
W1210 08:47:32.620]  - The resource 'projects/knative-boskos-14/global/firewalls/e2e-ports-8fe60700' is not ready
W1210 08:47:32.620] 
W1210 08:47:32.709] 2018/12/10 08:47:32 process.go:155: Step 'gcloud compute firewall-rules delete -q e2e-ports-8fe60700 k8s-fc1a7b7923dc5898-node-http-hc k8s-fw-ada5f9a79fc5611e8be8a42010a80004 kserving-e2e-net1072038636494524417-2wnao3jebww7ldrn463stwke kserving-e2e-net1072038636494524417-7mzjmae3tlidh4yoidvnpe53 kserving-e2e-net1072038636494524417-knsku4qwwbtr3bhcf3y6vcmu kserving-e2e-net1072038636494524417-pjf5geul3rfwfyd5mynbasya kserving-e2e-net1072038636494524417-rpeifunzrsxxfwyacvtmctpr kserving-e2e-net1072038636494524417-uuaca3r2wn7yqlbdyzue5lrn kserving-e2e-net1072038636494524417-x233wi3sx7onq4enxk4rf6mk kserving-e2e-net1072038636494524417-yieefqzg6fev2ygounhzgoee --project=knative-boskos-14' finished in 18.041019497s
W1210 08:47:32.709] 2018/12/10 08:47:32 process.go:153: Running: gcloud compute networks delete -q kserving-e2e-net1072038636494524417 --project=knative-boskos-14
W1210 08:47:32.710] sh: 0: getcwd() failed: No such file or directory
W1210 08:47:32.837] sh: 0: getcwd() failed: No such file or directory
W1210 08:47:32.974] sh: 0: getcwd() failed: No such file or directory
W1210 08:48:40.565] Deleted [https://www.googleapis.com/compute/v1/projects/knative-boskos-14/global/networks/kserving-e2e-net1072038636494524417].
W1210 08:48:40.668] 2018/12/10 08:48:40 process.go:155: Step 'gcloud compute networks delete -q kserving-e2e-net1072038636494524417 --project=knative-boskos-14' finished in 1m7.959200325s
W1210 08:48:41.472] 2018/12/10 08:48:41 main.go:309: Something went wrong: encountered 1 errors: [error deleting firewall: error during gcloud compute firewall-rules delete -q e2e-ports-8fe60700 --project=knative-boskos-14: exit status 1]
I1210 08:48:41.574] Test subprocess exited with code 1
I1210 08:48:43.416] Test result code is 0
I1210 08:48:43.419] @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
I1210 08:48:43.420] @@@@ Release validation tests failed, aborting @@@@
I1210 08:48:43.420] @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
W1210 08:48:43.520] Run: ('/workspace/./test-infra/jenkins/../scenarios/../hack/coalesce.py',)
E1210 08:48:43.558] Command failed
I1210 08:48:43.558] process 464 exited with code 1 after 46.7m
E1210 08:48:43.559] FAIL: ci-knative-serving-release
I1210 08:48:43.559] Call:  gcloud auth activate-service-account --key-file=/etc/service-account/service-account.json
W1210 08:48:43.981] Activated service account credentials for: [knative-tests@appspot.gserviceaccount.com]
I1210 08:48:44.044] process 8707 exited with code 0 after 0.0m
I1210 08:48:44.044] Call:  gcloud config get-value account
I1210 08:48:44.333] process 8720 exited with code 0 after 0.0m
I1210 08:48:44.334] Will upload results to gs://knative-prow/logs using knative-tests@appspot.gserviceaccount.com
... skipping 23 lines ...