Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor tail-sampling processor - Move to OTel metrics instead of OpenCensus metrics #31581

Closed
Tracked by #31580
, #29867
...
jpkrohling opened this issue Mar 5, 2024 · 3 comments · Fixed by #33426
Closed
Tracked by #31580
, #29867
...

Refactor tail-sampling processor - Move to OTel metrics instead of OpenCensus metrics #31581

jpkrohling opened this issue Mar 5, 2024 · 3 comments · Fixed by #33426
Assignees
@jpkrohling
Labels
enhancement New feature or request processor/tailsampling Tail sampling processor

Comments

@jpkrohling
Copy link
Member

No description provided.

@jpkrohling jpkrohling mentioned this issue Mar 5, 2024
Open
4 tasks
@jpkrohling jpkrohling added the processor/tailsampling Tail sampling processor label Mar 5, 2024
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Mar 5, 2024

Pinging code owners for processor/tailsampling: @jpkrohling. See Adding Labels via Comments if you do not have permissions to add labels yourself.

@github-actions github-actions bot mentioned this issue Mar 12, 2024
Closed
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented May 6, 2024

This issue has been inactive for 60 days. It will be closed in 60 days if there is no activity. To ping code owners by adding a component label, see Adding Labels via Comments, or if you are unsure of which component this issue relates to, please ping @open-telemetry/collector-contrib-triagers. If this issue is still relevant, please ping the code owners or leave a comment explaining why it is still relevant. Otherwise, please close it.

Pinging code owners:

See Adding Labels via Comments if you do not have permissions to add labels yourself.

@github-actions github-actions bot added the Stale label May 6, 2024
@jpkrohling jpkrohling removed the Stale label May 7, 2024
@jpkrohling jpkrohling self-assigned this May 7, 2024
@jpkrohling jpkrohling added the enhancement New feature or request label May 7, 2024
@jpkrohling jpkrohling mentioned this issue Jun 7, 2024
Merged
@codeboten codeboten mentioned this issue Jun 10, 2024
Closed
@codeboten
Copy link
Contributor

Related to #29867

@codeboten codeboten mentioned this issue Jun 10, 2024
Closed
16 tasks
codeboten pushed a commit that referenced this issue Jun 11, 2024
@jpkrohling
[processor/tailsampling] Move from OpenCensus to OTel API (#33426)
e5d4b7e 
This PR migrates the internal telemetry for the tail sampling processor
to OpenTelemetry. All metric names were kept, as well as their labels
and other properties, such as bucket boundaries, so that this change
should not cause disruptions to current users of this component.

One thing that I did notice was that, previously, metrics for the
probabilistic sampler were included as if that component was used.
However, the probabilistic sampling _policy_ was used:
`otelcol_processor_probabilistic_sampler_count_traces_sampled`. This PR
corrects that. Users relying on that should rely on
`otelcol_processor_tail_sampling_global_count_traces_sampled` instead.

Here's how the metrics looked like before this change (I'm copying all
metrics, in case I'm missing something):

```
# HELP otelcol_process_cpu_seconds Total CPU user and system time in seconds
# TYPE otelcol_process_cpu_seconds counter
otelcol_process_cpu_seconds{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 0.2
# HELP otelcol_process_memory_rss Total physical memory (resident set size)
# TYPE otelcol_process_memory_rss gauge
otelcol_process_memory_rss{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 2.61861376e+08
# HELP otelcol_process_runtime_heap_alloc_bytes Bytes of allocated heap objects (see 'go doc runtime.MemStats.HeapAlloc')
# TYPE otelcol_process_runtime_heap_alloc_bytes gauge
otelcol_process_runtime_heap_alloc_bytes{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 5.0452184e+07
# HELP otelcol_process_runtime_total_alloc_bytes Cumulative bytes allocated for heap objects (see 'go doc runtime.MemStats.TotalAlloc')
# TYPE otelcol_process_runtime_total_alloc_bytes counter
otelcol_process_runtime_total_alloc_bytes{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 5.3426448e+07
# HELP otelcol_process_runtime_total_sys_memory_bytes Total bytes of memory obtained from the OS (see 'go doc runtime.MemStats.Sys')
# TYPE otelcol_process_runtime_total_sys_memory_bytes gauge
otelcol_process_runtime_total_sys_memory_bytes{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 6.6475272e+07
# HELP otelcol_process_uptime Uptime of the process
# TYPE otelcol_process_uptime counter
otelcol_process_uptime{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 10.717029141
# HELP otelcol_processor_probabilistic_sampler_count_traces_sampled Count of traces that were sampled or not
# TYPE otelcol_processor_probabilistic_sampler_count_traces_sampled counter
otelcol_processor_probabilistic_sampler_count_traces_sampled{policy="everything",sampled="true",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
otelcol_processor_probabilistic_sampler_count_traces_sampled{policy="only-10-percent",sampled="false",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_processor_tail_sampling_count_traces_sampled Count of traces that were sampled or not
# TYPE otelcol_processor_tail_sampling_count_traces_sampled counter
otelcol_processor_tail_sampling_count_traces_sampled{policy="everything",sampled="true",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
otelcol_processor_tail_sampling_count_traces_sampled{policy="only-10-percent",sampled="false",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_processor_tail_sampling_global_count_traces_sampled Global count of traces that were sampled or not by at least one policy
# TYPE otelcol_processor_tail_sampling_global_count_traces_sampled counter
otelcol_processor_tail_sampling_global_count_traces_sampled{sampled="true",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_processor_tail_sampling_new_trace_id_received Counts the arrival of new traces
# TYPE otelcol_processor_tail_sampling_new_trace_id_received counter
otelcol_processor_tail_sampling_new_trace_id_received{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_processor_tail_sampling_sampling_decision_latency Latency (in microseconds) of a given sampling policy
# TYPE otelcol_processor_tail_sampling_sampling_decision_latency histogram
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="1"} 76
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="2"} 99
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="5"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="10"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="25"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="50"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="75"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="100"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="150"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="200"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="300"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="400"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="500"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="750"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="1000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="2000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="3000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="4000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="5000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="10000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="20000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="30000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="50000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="+Inf"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_sum{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 24.999999999999993
otelcol_processor_tail_sampling_sampling_decision_latency_count{policy="everything",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="1"} 56
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="2"} 85
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="5"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="10"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="25"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="50"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="75"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="100"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="150"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="200"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="300"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="400"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="500"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="750"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="1000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="2000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="3000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="4000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="5000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="10000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="20000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="30000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="50000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="+Inf"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_sum{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 60.00000000000006
otelcol_processor_tail_sampling_sampling_decision_latency_count{policy="only-10-percent",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_processor_tail_sampling_sampling_decision_timer_latency Latency (in microseconds) of each run of the sampling decision timer
# TYPE otelcol_processor_tail_sampling_sampling_decision_timer_latency histogram
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="1"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="2"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="5"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="10"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="25"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="50"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="75"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="100"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="150"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="200"} 1
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="300"} 2
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="400"} 4
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="500"} 6
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="750"} 11
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="1000"} 15
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="2000"} 31
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="3000"} 73
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="4000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="5000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="10000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="20000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="30000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="50000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",le="+Inf"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_sum{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 229918.00000000003
otelcol_processor_tail_sampling_sampling_decision_timer_latency_count{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_processor_tail_sampling_sampling_policy_evaluation_error Count of sampling policy evaluation errors
# TYPE otelcol_processor_tail_sampling_sampling_policy_evaluation_error counter
otelcol_processor_tail_sampling_sampling_policy_evaluation_error{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 0
# HELP otelcol_processor_tail_sampling_sampling_trace_dropped_too_early Count of traces that needed to be dropped before the configured wait time
# TYPE otelcol_processor_tail_sampling_sampling_trace_dropped_too_early counter
otelcol_processor_tail_sampling_sampling_trace_dropped_too_early{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 0
# HELP otelcol_processor_tail_sampling_sampling_traces_on_memory Tracks the number of traces current on memory
# TYPE otelcol_processor_tail_sampling_sampling_traces_on_memory gauge
otelcol_processor_tail_sampling_sampling_traces_on_memory{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_receiver_accepted_spans Number of spans successfully pushed into the pipeline.
# TYPE otelcol_receiver_accepted_spans counter
otelcol_receiver_accepted_spans{receiver="otlp",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",transport="grpc"} 200
# HELP otelcol_receiver_refused_spans Number of spans that could not be pushed into the pipeline.
# TYPE otelcol_receiver_refused_spans counter
otelcol_receiver_refused_spans{receiver="otlp",service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev",transport="grpc"} 0
# HELP target_info Target metadata
# TYPE target_info gauge
target_info{service_instance_id="7ef12d07-375c-4bd3-90a0-f7801f88e3ba",service_name="otelcontribcol",service_version="0.102.0-dev"} 1
```

And here are the new metrics:

```
# HELP otelcol_process_cpu_seconds Total CPU user and system time in seconds
# TYPE otelcol_process_cpu_seconds counter
otelcol_process_cpu_seconds{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 0.19
# HELP otelcol_process_memory_rss Total physical memory (resident set size)
# TYPE otelcol_process_memory_rss gauge
otelcol_process_memory_rss{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 2.58588672e+08
# HELP otelcol_process_runtime_heap_alloc_bytes Bytes of allocated heap objects (see 'go doc runtime.MemStats.HeapAlloc')
# TYPE otelcol_process_runtime_heap_alloc_bytes gauge
otelcol_process_runtime_heap_alloc_bytes{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 5.0090704e+07
# HELP otelcol_process_runtime_total_alloc_bytes Cumulative bytes allocated for heap objects (see 'go doc runtime.MemStats.TotalAlloc')
# TYPE otelcol_process_runtime_total_alloc_bytes counter
otelcol_process_runtime_total_alloc_bytes{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 5.288944e+07
# HELP otelcol_process_runtime_total_sys_memory_bytes Total bytes of memory obtained from the OS (see 'go doc runtime.MemStats.Sys')
# TYPE otelcol_process_runtime_total_sys_memory_bytes gauge
otelcol_process_runtime_total_sys_memory_bytes{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 6.6213128e+07
# HELP otelcol_process_uptime Uptime of the process
# TYPE otelcol_process_uptime counter
otelcol_process_uptime{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 5.057603581
# HELP otelcol_processor_tail_sampling_count_traces_sampled Count of traces that were sampled or not per sampling policy
# TYPE otelcol_processor_tail_sampling_count_traces_sampled counter
otelcol_processor_tail_sampling_count_traces_sampled{policy="everything",sampled="true",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
otelcol_processor_tail_sampling_count_traces_sampled{policy="only-10-percent",sampled="false",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_processor_tail_sampling_global_count_traces_sampled Global count of traces that were sampled or not by at least one policy
# TYPE otelcol_processor_tail_sampling_global_count_traces_sampled counter
otelcol_processor_tail_sampling_global_count_traces_sampled{sampled="true",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_processor_tail_sampling_new_trace_id_received Counts the arrival of new traces
# TYPE otelcol_processor_tail_sampling_new_trace_id_received counter
otelcol_processor_tail_sampling_new_trace_id_received{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_processor_tail_sampling_sampling_decision_latency Latency (in microseconds) of a given sampling policy
# TYPE otelcol_processor_tail_sampling_sampling_decision_latency histogram
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="1"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="2"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="5"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="10"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="25"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="50"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="75"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="100"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="150"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="200"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="300"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="400"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="500"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="750"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="1000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="2000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="3000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="4000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="5000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="10000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="20000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="30000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="50000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="+Inf"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_sum{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 1
otelcol_processor_tail_sampling_sampling_decision_latency_count{policy="everything",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="1"} 99
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="2"} 99
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="5"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="10"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="25"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="50"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="75"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="100"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="150"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="200"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="300"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="400"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="500"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="750"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="1000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="2000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="3000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="4000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="5000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="10000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="20000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="30000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="50000"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_bucket{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="+Inf"} 100
otelcol_processor_tail_sampling_sampling_decision_latency_sum{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 5
otelcol_processor_tail_sampling_sampling_decision_latency_count{policy="only-10-percent",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_processor_tail_sampling_sampling_decision_timer_latency Latency (in microseconds) of each run of the sampling decision timer
# TYPE otelcol_processor_tail_sampling_sampling_decision_timer_latency histogram
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="1"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="2"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="5"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="10"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="25"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="50"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="75"} 0
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="100"} 1
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="150"} 3
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="200"} 5
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="300"} 11
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="400"} 16
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="500"} 21
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="750"} 35
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="1000"} 49
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="2000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="3000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="4000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="5000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="10000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="20000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="30000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="50000"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_bucket{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",le="+Inf"} 100
otelcol_processor_tail_sampling_sampling_decision_timer_latency_sum{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 102290
otelcol_processor_tail_sampling_sampling_decision_timer_latency_count{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_processor_tail_sampling_sampling_policy_evaluation_error Count of sampling policy evaluation errors
# TYPE otelcol_processor_tail_sampling_sampling_policy_evaluation_error counter
otelcol_processor_tail_sampling_sampling_policy_evaluation_error{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 0
# HELP otelcol_processor_tail_sampling_sampling_trace_dropped_too_early Count of traces that needed to be dropped before the configured wait time
# TYPE otelcol_processor_tail_sampling_sampling_trace_dropped_too_early counter
otelcol_processor_tail_sampling_sampling_trace_dropped_too_early{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 0
# HELP otelcol_processor_tail_sampling_sampling_traces_on_memory Tracks the number of traces current on memory
# TYPE otelcol_processor_tail_sampling_sampling_traces_on_memory gauge
otelcol_processor_tail_sampling_sampling_traces_on_memory{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 100
# HELP otelcol_receiver_accepted_spans Number of spans successfully pushed into the pipeline.
# TYPE otelcol_receiver_accepted_spans counter
otelcol_receiver_accepted_spans{receiver="otlp",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",transport="grpc"} 200
# HELP otelcol_receiver_refused_spans Number of spans that could not be pushed into the pipeline.
# TYPE otelcol_receiver_refused_spans counter
otelcol_receiver_refused_spans{receiver="otlp",service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev",transport="grpc"} 0
# HELP target_info Target metadata
# TYPE target_info gauge
target_info{service_instance_id="91db1477-b500-4671-bc32-2cbe7d9eb64b",service_name="otelcontribcol",service_version="0.102.0-dev"} 1
```

They were generated by making a telemetrygen call for 100 traces to a
Collector with this configuration:

```
receivers:
  otlp:
    protocols:
      grpc:
        endpoint: localhost:4317

processors:
  tail_sampling:
    decision_wait: 1s
    num_traces: 100
    expected_new_traces_per_sec: 10
    policies:
      [
        { name: everything, type: always_sample },
        {
          name: only-10-percent,
          type: probabilistic,
          probabilistic: { sampling_percentage: 0.1 },
        },
      ]

exporters:
  nop:

service:
  pipelines:
    traces:
      receivers: [otlp]
      processors: [tail_sampling]
      exporters: [nop]
```

Closes #31581 

Signed-off-by: Juraci Paixão Kröhling <juraci@kroehling.de>

---------

Signed-off-by: Juraci Paixão Kröhling <juraci@kroehling.de>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jpkrohling jpkrohling

Labels
enhancement New feature or request processor/tailsampling Tail sampling processor
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[processor/tailsampling] Move from OpenCensus to OTel API jpkrohling/opentelemetry-collector-contrib
2 participants
@jpkrohling @codeboten