Observability: StackDriver Integration

[nachocano]

Problem
High-level issue for Observability related tasks.
TL'DR we should be able to integrate with SD metrics, tracing, and logging.

There has been worked done already in this space. We are mainly lacking Source metrics, as it requires integration with SD backend so that users are not charged. But we need to verify traces and logging are actually working as expected. And maybe move away from span-based tracing if it will simplify things. E2E tests need to be added. Our new Broker impl should also support our current metrics (present in the channel-based one, in the Broker ingress and filter pods), as well as tracing

• Metrics

  • Broker/Trigger metrics for new Broker impl Broker/Trigger metrics for new Broker impl #649
  • E2E tests
    • Tests for Trigger metrics E2E test for Trigger metrics #647
    • Tests for Broker metrics E2E test for Broker metrics #648
    • Fix e2e test problem in Prow StackDriver metrics e2e test does not work in PROW  #317
    • Test for channel E2E test for Channel #287

• Tracing

  • Tracing through new Broker impl Tracing through new Broker Covered by E2E Test #650
  • Tracing through channel Tracing through Channel #226
  • E2E tests
    • Re-enable tests Enable tracing tests when assertions are more lenient #652
    • Tests more lenient Tracing tests need to be more lenient knative/eventing#2046 (release/1)
    • Trace context propagation Tracecontext propagation should be used instead of B3 knative/eventing#2559 (release/2?)

• Logging

  • E2E test E2E test for Logging #651

Persona:
Developer

Exit Criteria
Integration with SD metrics in sources, tracing, and logging.

Time Estimate (optional):
???

[nachocano]

fyi @liu-cong @nlopezgi

[nachocano]

/assign @ian-mi as I know you have started working on some tracing stuff.
This can be considered an umbrella issue, where you can start putting your findings on... Together with the openCensus patching one in eventing knative/eventing#2052

[nachocano]

We should scope this down to multiple issues

[nachocano]

We should make sure that the new Broker implementation support our current SD metrics

[nachocano]

re: the metris list in eventing https://github.com/knative/eventing/issues?q=is%3Aopen+metrics+author%3Anachocano+label%3Aarea%2Fobservability+. IMO we can safely skip it for now, as they were mainly targeting prometheus backends, and we need to explicitly test our SD integration.

[Harwayne]

/close

Closing as all the release/1, priority/1 issues are closed. All remaining work items still have their own issues that can be prioritized independently.

[knative-prow-robot]

@Harwayne: Closing this issue.

In response to this:

/close

Closing as all the release/1, priority/1 issues are closed. All remaining work items still have their own issues that can be prioritized independently.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.