Skip to content

Conversation

@Aaalibaba42
Copy link
Contributor

What does this PR do?

Add a ci step to check ffi-examples in a maintainable way.

Motivation

Realizing after the fact that some examples don't build (let alone pass the tests) on certain platforms.

Additional Notes

I don't know much about github actions, AI did the thing.

How to test the change?

cargo ffi-test locally, or the pipeline of the PR I guess.

@Aaalibaba42 Aaalibaba42 changed the title Test FFI examples feat: test FFI examples Jan 26, 2026
@Aaalibaba42 Aaalibaba42 force-pushed the jwiriath/test-ffi-examples branch from b935b0a to 31e384a Compare January 26, 2026 14:27
@pr-commenter
Copy link

pr-commenter bot commented Jan 26, 2026

Benchmarks

Comparison

Benchmark execution time: 2026-01-26 15:05:08

Comparing candidate commit 8cacf0b in PR branch jwiriath/test-ffi-examples with baseline commit 5aa2b36 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.385µs 2.439µs ± 0.021µs 2.433µs ± 0.007µs 2.445µs 2.471µs 2.479µs 2.583µs 6.14% 1.596 9.347 0.88% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.436µs; 2.441µs] or [-0.122%; +0.122%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.552ms 14.642ms ± 0.035ms 14.638ms ± 0.017ms 14.655ms 14.703ms 14.763ms 14.814ms 1.20% 1.202 3.615 0.24% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.637ms; 14.647ms] or [-0.034%; +0.034%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.596µs 25.576µs ± 9.699µs 18.082µs ± 0.300µs 34.278µs 42.492µs 51.325µs 71.009µs 292.72% 1.072 1.337 37.83% 0.686µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.231µs; 26.920µs] or [-5.256%; +5.256%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 189.413ns 191.835ns ± 2.065ns 191.514ns ± 1.302ns 192.737ns 195.474ns 197.934ns 202.811ns 5.90% 1.650 4.696 1.07% 0.146ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [191.549ns; 192.121ns] or [-0.149%; +0.149%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 144.115µs 145.819µs ± 1.716µs 145.557µs ± 0.527µs 146.036µs 147.643µs 152.352µs 162.461µs 11.61% 5.795 47.288 1.17% 0.121µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [145.582µs; 146.057µs] or [-0.163%; +0.163%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.734µs 206.325µs ± 0.388µs 206.301µs ± 0.198µs 206.487µs 206.814µs 207.188µs 209.922µs 1.76% 4.192 35.460 0.19% 0.027µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4763681.486op/s 4846733.191op/s ± 9036.021op/s 4847294.185op/s ± 4662.426op/s 4852191.271op/s 4856898.573op/s 4859349.549op/s 4860654.877op/s 0.28% -4.082 34.109 0.19% 638.943op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.556µs 18.625µs ± 0.042µs 18.619µs ± 0.024µs 18.648µs 18.700µs 18.757µs 18.787µs 0.90% 1.016 1.520 0.23% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53229016.490op/s 53690771.953op/s ± 121325.120op/s 53707819.469op/s ± 69974.573op/s 53773277.737op/s 53860349.254op/s 53885075.101op/s 53890506.365op/s 0.34% -0.999 1.467 0.23% 8578.982op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.866µs 10.925µs ± 0.027µs 10.923µs ± 0.016µs 10.940µs 10.970µs 10.996µs 11.045µs 1.11% 0.622 1.370 0.25% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 90541270.923op/s 91533625.292op/s ± 229494.691op/s 91547477.329op/s ± 134323.837op/s 91678913.869op/s 91903601.402op/s 91967847.640op/s 92030832.436op/s 0.53% -0.600 1.306 0.25% 16227.725op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [206.272µs; 206.379µs] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4845480.885op/s; 4847985.497op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.619µs; 18.631µs] or [-0.031%; +0.031%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53673957.458op/s; 53707586.448op/s] or [-0.031%; +0.031%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.921µs; 10.929µs] or [-0.035%; +0.035%] None None None
normalization/normalize_name/normalize_name/good throughput [91501819.535op/s; 91565431.049op/s] or [-0.035%; +0.035%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 12.675ms 13.054ms ± 0.092ms 13.062ms ± 0.043ms 13.101ms 13.183ms 13.266ms 13.386ms 2.48% -0.698 3.544 0.70% 0.007ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [13.042ms; 13.067ms] or [-0.098%; +0.098%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.611ms 10.634ms ± 0.014ms 10.633ms ± 0.008ms 10.641ms 10.654ms 10.685ms 10.730ms 0.91% 2.340 11.475 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.632ms; 10.636ms] or [-0.019%; +0.019%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.473µs 34.117µs ± 0.999µs 33.680µs ± 0.054µs 33.743µs 36.214µs 36.269µs 38.057µs 13.00% 1.777 1.513 2.92% 0.071µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.978µs; 34.255µs] or [-0.406%; +0.406%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.161µs 3.192µs ± 1.385µs 2.986µs ± 0.028µs 3.011µs 3.666µs 13.608µs 14.670µs 391.36% 7.334 55.112 43.28% 0.098µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.000µs; 3.384µs] or [-6.013%; +6.013%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 534.304µs 535.410µs ± 0.591µs 535.368µs ± 0.271µs 535.669µs 536.276µs 536.714µs 540.082µs 0.88% 2.474 18.220 0.11% 0.042µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [535.328µs; 535.491µs] or [-0.015%; +0.015%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 241.704ns 254.714ns ± 14.610ns 248.250ns ± 3.806ns 267.942ns 283.708ns 290.754ns 293.311ns 18.15% 1.205 -0.001 5.72% 1.033ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [252.689ns; 256.739ns] or [-0.795%; +0.795%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.891µs 3.912µs ± 0.003µs 3.912µs ± 0.001µs 3.913µs 3.916µs 3.918µs 3.920µs 0.20% -1.934 16.306 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255114878.579op/s 255619820.646op/s ± 175565.897op/s 255616701.816op/s ± 95001.904op/s 255719727.176op/s 255847513.841op/s 255930596.318op/s 256972167.852op/s 0.53% 1.964 16.562 0.07% 12414.384op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.063µs 77.612µs ± 0.388µs 77.533µs ± 0.242µs 77.809µs 78.275µs 78.705µs 79.118µs 2.04% 0.919 0.602 0.50% 0.027µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12639359.966op/s 12884895.955op/s ± 64152.285op/s 12897711.947op/s ± 40156.613op/s 12930889.960op/s 12964893.181op/s 12973930.633op/s 12976419.432op/s 0.61% -0.893 0.520 0.50% 4536.252op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 70.628µs 71.110µs ± 0.280µs 71.061µs ± 0.154µs 71.249µs 71.616µs 71.975µs 72.298µs 1.74% 0.924 1.544 0.39% 0.020µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13831728.101op/s 14063007.251op/s ± 55097.675op/s 14072355.566op/s ± 30575.431op/s 14097695.732op/s 14142345.861op/s 14150148.837op/s 14158682.074op/s 0.61% -0.892 1.440 0.39% 3895.994op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.894µs 3.913µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.918µs 3.921µs 3.930µs 0.45% 0.200 10.158 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254451685.476op/s 255577736.143op/s ± 204788.627op/s 255594184.031op/s ± 100344.116op/s 255701425.540op/s 255808121.142op/s 255857480.295op/s 256827163.053op/s 0.48% -0.171 10.211 0.08% 14480.743op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 67.418µs 67.834µs ± 0.318µs 67.760µs ± 0.232µs 68.026µs 68.450µs 68.953µs 69.059µs 1.92% 1.170 1.561 0.47% 0.023µs 1 200
credit_card/is_card_number/378282246310005 throughput 14480268.433op/s 14742217.553op/s ± 68837.151op/s 14758054.699op/s ± 50604.159op/s 14800720.526op/s 14819271.964op/s 14831264.498op/s 14832746.254op/s 0.51% -1.140 1.447 0.47% 4867.522op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 44.701µs 45.214µs ± 0.198µs 45.222µs ± 0.125µs 45.340µs 45.489µs 45.528µs 46.346µs 2.49% 0.635 4.369 0.44% 0.014µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21576828.818op/s 22117349.231op/s ± 96517.220op/s 22113260.761op/s ± 61187.173op/s 22183668.384op/s 22265467.118op/s 22358598.012op/s 22370715.403op/s 1.16% -0.559 3.973 0.44% 6824.798op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.026µs 6.037µs ± 0.008µs 6.036µs ± 0.003µs 6.038µs 6.045µs 6.078µs 6.104µs 1.13% 5.088 34.407 0.13% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 163818317.280op/s 165642833.339op/s ± 222516.861op/s 165670204.220op/s ± 70543.144op/s 165747030.723op/s 165823442.314op/s 165870368.324op/s 165937240.473op/s 0.16% -5.046 33.953 0.13% 15734.318op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.916µs 3.918µs 3.920µs 3.922µs 0.22% -1.271 8.589 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254971724.174op/s 255528614.846op/s ± 198968.690op/s 255534940.853op/s ± 131885.961op/s 255658449.913op/s 255775793.550op/s 255917522.757op/s 256858942.736op/s 0.52% 1.292 8.742 0.08% 14069.211op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.266µs 65.608µs ± 0.085µs 65.615µs ± 0.055µs 65.660µs 65.733µs 65.820µs 65.948µs 0.51% 0.102 1.920 0.13% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15163386.981op/s 15242018.766op/s ± 19807.785op/s 15240338.647op/s ± 12844.695op/s 15255254.052op/s 15273533.487op/s 15282646.740op/s 15321965.570op/s 0.54% -0.086 1.916 0.13% 1400.622op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 52.960µs 53.029µs ± 0.034µs 53.023µs ± 0.022µs 53.046µs 53.098µs 53.121µs 53.147µs 0.23% 0.761 0.551 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18815789.932op/s 18857625.621op/s ± 11990.235op/s 18859749.523op/s ± 7681.518op/s 18866857.064op/s 18873515.834op/s 18877507.885op/s 18882226.161op/s 0.12% -0.758 0.543 0.06% 847.838op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.893µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.917µs 3.921µs 3.925µs 0.30% -0.686 8.823 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254807878.747op/s 255564078.614op/s ± 197291.353op/s 255581291.463op/s ± 115168.396op/s 255673621.221op/s 255815129.037op/s 255886244.583op/s 256844049.840op/s 0.49% 0.710 8.951 0.08% 13950.605op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 49.754µs 49.819µs ± 0.035µs 49.818µs ± 0.027µs 49.843µs 49.878µs 49.900µs 49.911µs 0.19% 0.277 -0.503 0.07% 0.002µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 20035697.433op/s 20072646.435op/s ± 13976.174op/s 20072888.555op/s ± 10930.916op/s 20084113.968op/s 20093264.738op/s 20097812.675op/s 20098890.541op/s 0.13% -0.274 -0.506 0.07% 988.265op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 44.767µs 45.216µs ± 0.174µs 45.218µs ± 0.115µs 45.341µs 45.482µs 45.558µs 45.570µs 0.78% -0.401 -0.086 0.38% 0.012µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21944363.526op/s 22116439.822op/s ± 85192.164op/s 22114959.144op/s ± 56002.618op/s 22166894.851op/s 22282951.078op/s 22334215.551op/s 22337855.844op/s 1.01% 0.421 -0.065 0.38% 6023.996op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.027µs 6.037µs ± 0.011µs 6.036µs ± 0.002µs 6.038µs 6.045µs 6.104µs 6.119µs 1.38% 5.622 36.592 0.18% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163425412.425op/s 165632475.611op/s ± 288469.703op/s 165678635.740op/s ± 64747.065op/s 165742123.361op/s 165829807.433op/s 165880715.605op/s 165918348.547op/s 0.14% -5.585 36.211 0.17% 20397.888op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255595488.901op/s; 255644152.391op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [77.558µs; 77.666µs] or [-0.069%; +0.069%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12876005.065op/s; 12893786.845op/s] or [-0.069%; +0.069%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.071µs; 71.148µs] or [-0.054%; +0.054%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14055371.244op/s; 14070643.259op/s] or [-0.054%; +0.054%] None None None
credit_card/is_card_number/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255549354.409op/s; 255606117.877op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [67.790µs; 67.878µs] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/378282246310005 throughput [14732677.386op/s; 14751757.721op/s] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.187µs; 45.242µs] or [-0.061%; +0.061%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [22103972.872op/s; 22130725.589op/s] or [-0.060%; +0.060%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.036µs; 6.038µs] or [-0.019%; +0.019%] None None None
credit_card/is_card_number/x371413321323331 throughput [165611994.642op/s; 165673672.036op/s] or [-0.019%; +0.019%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.913µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255501039.700op/s; 255556189.993op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.596µs; 65.620µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15239273.597op/s; 15244763.934op/s] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.024µs; 53.034µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18855963.890op/s; 18859287.352op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255536735.930op/s; 255591421.298op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [49.814µs; 49.824µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [20070709.472op/s; 20074583.399op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.192µs; 45.240µs] or [-0.053%; +0.053%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [22104633.008op/s; 22128246.637op/s] or [-0.053%; +0.053%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.036µs; 6.039µs] or [-0.024%; +0.024%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165592496.485op/s; 165672454.738op/s] or [-0.024%; +0.024%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 48.722ms 49.090ms ± 1.402ms 48.877ms ± 0.049ms 48.926ms 49.103ms 55.253ms 64.596ms 32.16% 8.463 80.534 2.85% 0.099ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [48.896ms; 49.284ms] or [-0.396%; +0.396%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 89.693µs 89.956µs ± 0.252µs 89.905µs ± 0.109µs 90.068µs 90.255µs 90.335µs 92.752µs 3.17% 6.979 74.105 0.28% 0.018µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.921µs; 89.991µs] or [-0.039%; +0.039%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.042µs 5.100µs ± 0.040µs 5.075µs ± 0.019µs 5.150µs 5.158µs 5.161µs 5.162µs 1.72% 0.397 -1.578 0.78% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.094µs; 5.106µs] or [-0.109%; +0.109%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 161.656µs 162.316µs ± 0.640µs 162.211µs ± 0.135µs 162.386µs 162.900µs 163.235µs 169.942µs 4.77% 9.079 101.291 0.39% 0.045µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [162.227µs; 162.404µs] or [-0.055%; +0.055%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 535.081µs 536.784µs ± 1.263µs 536.420µs ± 0.564µs 537.094µs 539.410µs 540.639µs 542.281µs 1.09% 1.553 2.456 0.23% 0.089µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1844061.596op/s 1862956.549op/s ± 4368.503op/s 1864210.164op/s ± 1961.813op/s 1866052.092op/s 1867432.340op/s 1868147.473op/s 1868877.160op/s 0.25% -1.539 2.390 0.23% 308.900op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.202µs 380.914µs ± 0.398µs 380.886µs ± 0.217µs 381.056µs 381.547µs 382.418µs 382.846µs 0.51% 1.725 5.180 0.10% 0.028µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2612014.837op/s 2625264.675op/s ± 2736.557op/s 2625457.486op/s ± 1492.943op/s 2627064.395op/s 2628728.371op/s 2629766.512op/s 2630182.904op/s 0.18% -1.712 5.119 0.10% 193.504op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.397µs 189.855µs ± 0.185µs 189.849µs ± 0.125µs 189.986µs 190.138µs 190.256µs 190.481µs 0.33% 0.135 0.212 0.10% 0.013µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5249869.561op/s 5267191.294op/s ± 5144.461op/s 5267356.141op/s ± 3471.127op/s 5270649.900op/s 5275622.390op/s 5279065.444op/s 5279921.110op/s 0.24% -0.129 0.206 0.10% 363.768op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.449µs 36.571µs ± 0.069µs 36.561µs ± 0.035µs 36.599µs 36.692µs 36.838µs 36.856µs 0.81% 1.444 3.176 0.19% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 27132773.257op/s 27344222.442op/s ± 51340.552op/s 27351536.107op/s ± 26364.973op/s 27375739.605op/s 27407357.689op/s 27428806.186op/s 27435653.187op/s 0.31% -1.427 3.108 0.19% 3630.325op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.874µs 46.059µs ± 0.134µs 46.038µs ± 0.046µs 46.092µs 46.201µs 46.270µs 47.639µs 3.48% 8.353 95.533 0.29% 0.009µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20990984.372op/s 21711549.660op/s ± 61618.018op/s 21721383.435op/s ± 21683.339op/s 21739089.740op/s 21759870.642op/s 21772974.596op/s 21798671.347op/s 0.36% -8.113 91.734 0.28% 4357.052op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [536.609µs; 536.959µs] or [-0.033%; +0.033%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1862351.116op/s; 1863561.981op/s] or [-0.032%; +0.032%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [380.859µs; 380.970µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2624885.414op/s; 2625643.935op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [189.829µs; 189.880µs] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5266478.321op/s; 5267904.266op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.561µs; 36.580µs] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27337107.136op/s; 27351337.749op/s] or [-0.026%; +0.026%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.040µs; 46.077µs] or [-0.040%; +0.040%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21703009.995op/s; 21720089.324op/s] or [-0.039%; +0.039%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 8cacf0b 1769438942 jwiriath/test-ffi-examples
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.863ms 3.879ms ± 0.008ms 3.878ms ± 0.003ms 3.881ms 3.889ms 3.893ms 3.975ms 2.49% 7.263 80.218 0.22% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.878ms; 3.880ms] or [-0.030%; +0.030%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

Codecov Report

❌ Patch coverage is 0% with 415 lines in your changes missing coverage. Please review.
✅ Project coverage is 70.73%. Comparing base (fa16176) to head (8cacf0b).
⚠️ Report is 5 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1473      +/-   ##
==========================================
- Coverage   71.16%   70.73%   -0.44%     
==========================================
  Files         419      420       +1     
  Lines       67165    67594     +429     
==========================================
+ Hits        47798    47810      +12     
- Misses      19367    19784     +417     
Components Coverage Δ
libdd-crashtracker 61.41% <ø> (ø)
libdd-crashtracker-ffi 16.50% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.28% <ø> (ø)
libdd-data-pipeline-ffi 78.57% <ø> (ø)
libdd-common 80.84% <ø> (ø)
libdd-common-ffi 74.19% <ø> (ø)
libdd-telemetry 59.82% <ø> (ø)
libdd-telemetry-ffi 21.17% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.60% <ø> (-0.11%) ⬇️
libdd-profiling 80.68% <ø> (+0.02%) ⬆️
libdd-profiling-ffi 62.46% <ø> (ø)
datadog-sidecar 34.94% <ø> (-0.08%) ⬇️
datdog-sidecar-ffi 10.25% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 93.43% <ø> (ø)
libdd-trace-normalization 82.33% <ø> (ø)
libdd-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 61.18% <ø> (ø)
libdd-trace-utils 89.45% <ø> (ø)
datadog-tracer-flare 63.49% <ø> (ø)
libdd-log 75.57% <ø> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@Aaalibaba42 Aaalibaba42 marked this pull request as ready for review January 26, 2026 15:12
@Aaalibaba42 Aaalibaba42 requested review from a team as code owners January 26, 2026 15:12
@dd-octo-sts
Copy link

dd-octo-sts bot commented Jan 26, 2026

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 8.38 MB 8.38 MB 0% (0 B) 👌
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 91.22 MB 91.22 MB 0% (0 B) 👌
aarch64-apple-darwin
Artifact Baseline Commit Change
/aarch64-apple-darwin/lib/libdatadog_profiling.a 62.36 MB 62.36 MB 0% (0 B) 👌
/aarch64-apple-darwin/lib/libdatadog_profiling.dylib 9.41 MB 9.41 MB 0% (0 B) 👌
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 10.67 MB 10.67 MB 0% (0 B) 👌
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 105.54 MB 105.54 MB 0% (0 B) 👌
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 25.08 MB 25.06 MB --.07% (-19.00 KB) 💪
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 73.49 KB 73.49 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 165.93 MB 165.89 MB --.02% (-40.00 KB) 💪
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 827.93 MB 830.11 MB +.26% (+2.17 MB) 🔍
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 9.54 MB 9.54 MB --.01% (-1.50 KB) 💪
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 73.49 KB 73.49 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 22.94 MB 22.91 MB --.10% (-24.00 KB) 💪
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 47.90 MB 48.01 MB +.21% (+104.55 KB) 🔍
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 21.15 MB 21.14 MB --.02% (-4.50 KB) 💪
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 74.62 KB 74.62 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 169.90 MB 169.92 MB +.01% (+24.00 KB) 🔍
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 814.90 MB 816.94 MB +.25% (+2.03 MB) 🔍
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 7.22 MB 7.21 MB -0% (-512 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 74.62 KB 74.62 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 24.51 MB 24.50 MB --.06% (-16.00 KB) 💪
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 43.62 MB 43.72 MB +.23% (+104.27 KB) 🔍
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 79.72 MB 79.72 MB 0% (0 B) 👌
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 9.85 MB 9.85 MB 0% (0 B) 👌
x86_64-apple-darwin
Artifact Baseline Commit Change
/x86_64-apple-darwin/lib/libdatadog_profiling.a 64.25 MB 64.25 MB 0% (0 B) 👌
/x86_64-apple-darwin/lib/libdatadog_profiling.dylib 10.44 MB 10.44 MB 0% (0 B) 👌
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 99.56 MB 99.56 MB 0% (0 B) 👌
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 11.41 MB 11.41 MB 0% (0 B) 👌

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants