Skip to content

Alpine musl experiment #1495

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
gyuheon0h wants to merge 4 commits into
base: main
Choose a base branch
from
Draft

Alpine musl experiment #1495

gyuheon0h wants to merge 4 commits into from

Conversation

@gyuheon0h
Copy link
Contributor

@gyuheon0h gyuheon0h commented Jan 30, 2026 •
edited
Loading

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

thread 'test_crash_tracking_bin_runtime_callback_frame_invalid_utf8' (70277) panicked at bin_tests/tests/crashtracker_bin_test.rs:255:9:
{"counters":{"profiler_collecting_sample":1,"profiler_inactive":0,"profiler_serializing":0,"profiler_unwinding":0},"data_schema_version":"1.4","error":{"is_crash":true,"kind":"UnixSignal","message":"Process terminated with SEGV_MAPERR (SIGSEGV)","source_type":"Crashtracking","stack":{"format":"Datadog Crashtracker 1.0","frames":[{"bp":"0x0","ip":"0x55555555f044","sp":"0x7ffffff57a10"},{"bp":"0x0","ip":"0x55555556672f","sp":"0x7ffffff57a50"},{"bp":"0xffffffff","ip":"0x555555566be3","sp":"0x7ffffff57f50"},{"bp":"0xffffffff","ip":"0x555555567c95","sp":"0x7ffffff57f60"},{"bp":"0x7ffffff580c8","ip":"0x7ffffff9aa30","sp":"0x7ffffff58090"},{"bp":"0x7ffffff5853e","ip":"0x7ffffff5857a","sp":"0x7ffffff580d8"}],"incomplete":false}},"experimental":{"runtime_stack":{"format":"Datadog Runtime Callback 1.0","frames":[{"column":15,"file":"valid_file.py","function":"runtime_function_�_invalid","line":42,"type_name":"ValidType"},{"column":8,"file":"valid_file.py","function":"valid_function","line":100,"type_name":"TestModule.�.TestClass"},{"column":1,"file":"script_�.py","function":"valid_function","line":200,"type_name":"ValidType"},{"column":5,"file":"valid_script.py","function":"valid_runtime_function","line":300,"type_name":"ValidType"},{"column":10,"file":"mixed_file.py","function":"func_��_invalid_overlong","line":400,"type_name":"Class���Name"},{"column":2,"file":"file_\u0000_null.py","function":"func_with_\u0000_null_byte","line":500,"type_name":"Type\u0000WithNull"},{}]},"ucontext":"ucontext_t { uc_flags: 0, uc_link: 0x0, uc_stack: stack_t { ss_sp: 0x7fffff6ed000, ss_flags: 0, ss_size: 65536 }, uc_mcontext: mcontext_t { gregs: [93824992878936, 140737488341696, 14, -1, 0, 140737488354000, 93824992744072, 9223372036854775806, 1, 140737488354592, 0, 8, 93824992634312, 0, 0, 140737487665680, 93824992276548, 514, 51, 4, 14, 0, 0], __private: [140737478905344, 140737488354592, 1, 93824992878936, 140737488341696, 14, 18446744073709551615, 0, 140737488354000] }, uc_sigmask: sigset_t { __val: [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] }, __private: [11, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 127, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 128, 31, 0, 0, 255, 255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 192, 255, 255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 192, 255, 255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 192, 255, 255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 192, 255, 255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 192, 255, 255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 192, 255, 255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 192, 255, 255, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 192, 255, 255, 0, 0, 0, 0, 0, 0, 88, 33, 95, 85, 85, 85, 0, 0, 88, 33, 95, 85, 85, 85, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16, 40, 95, 85, 85, 85, 0, 0, 16, 40, 95, 85, 85, 85, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0] }"},"files":{"/proc/self/maps":["555555554000-55555555f000 r--p 00000000 00:2d 841407                     /workspaces/libdatadog/target/release/crashtracker_bin_test","55555555f000-5555555b6000 r-xp 0000b000 00:2d 841407                     /workspaces/libdatadog/target/release/crashtracker_bin_test","5555555b6000-5555555d0000 r--p 00062000 00:2d 841407                     /workspaces/libdatadog/target/release/crashtracker_bin_test","5555555d0000-5555555d7000 r--p 0007b000 00:2d 841407                     /workspaces/libdatadog/target/release/crashtracker_bin_test","5555555d7000-5555555d8000 rw-p 00082000 00:2d 841407                     /workspaces/libdatadog/target/release/crashtracker_bin_test","5555555d8000-5555555f1000 rw-p 00000000 00:00 0 ","5555555f1000-5555555f2000 ---p 00000000 00:00 0 ","5555555f2000-5555555f3000 rw-p 00000000 00:00 0 ","7fffff6ec000-7fffff6ed000 ---p 00000000 00:00 0 ","7fffff6ed000-7fffff702000 rw-p 00000000 00:00 0 ","7fffff702000-7fffff703000 ---p 00000000 00:00 0 ","7fffff703000-7fffff705000 rw-p 00000000 00:00 0 ","7fffff705000-7fffff708000 r--p 00000000 00:3e 886821                     /usr/lib/liblzma.so.5.8.2","7fffff708000-7fffff72f000 r-xp 00003000 00:3e 886821                     /usr/lib/liblzma.so.5.8.2","7fffff72f000-7fffff73c000 r--p 0002a000 00:3e 886821                     /usr/lib/liblzma.so.5.8.2","7fffff73c000-7fffff73d000 r--p 00036000 00:3e 886821                     /usr/lib/liblzma.so.5.8.2","7fffff73d000-7fffff73e000 rw-p 00037000 00:3e 886821                     /usr/lib/liblzma.so.5.8.2","7fffff73e000-7fffff741000 r--p 00000000 00:3e 863661                     /usr/lib/libunwind.so.8.1.0","7fffff741000-7fffff749000 r-xp 00003000 00:3e 863661                     /usr/lib/libunwind.so.8.1.0","7fffff749000-7fffff74c000 r--p 0000b000 00:3e 863661                     /usr/lib/libunwind.so.8.1.0","7fffff74c000-7fffff74d000 r--p 0000d000 00:3e 863661                     /usr/lib/libunwind.so.8.1.0","7fffff74d000-7fffff74e000 rw-p 0000e000 00:3e 863661                     /usr/lib/libunwind.so.8.1.0","7fffff74e000-7fffff758000 rw-p 00000000 00:00 0 ","7fffff758000-7fffff759000 ---p 00000000 00:00 0 ","7fffff759000-7ffffff59000 rw-p 00000000 00:00 0 ","7ffffff59000-7ffffff6d000 r--p 00000000 00:3e 883767                     /lib/ld-musl-x86_64.so.1","7ffffff6d000-7ffffffc5000 r-xp 00014000 00:3e 883767                     /lib/ld-musl-x86_64.so.1","7ffffffc5000-7fffffffb000 r--p 0006c000 00:3e 883767                     /lib/ld-musl-x86_64.so.1","7fffffffb000-7fffffffc000 r--p 000a1000 00:3e 883767                     /lib/ld-musl-x86_64.so.1","7fffffffc000-7fffffffd000 rw-p 000a2000 00:3e 883767                     /lib/ld-musl-x86_64.so.1","7fffffffd000-800000000000 rw-p 00000000 00:00 0 ","800000000000-800000026000 r--p 00000000 00:3a 2                          /run/rosetta/rosetta","800000026000-800000097000 r-xp 00026000 00:3a 2                          /run/rosetta/rosetta","8000000a0000-8000001a6000 rw-p 000a0000 00:3a 2                          /run/rosetta/rosetta","effff7dcf000-effff7dd3000 rw-p 00000000 00:00 0 ","effff7dd3000-effff7de7000 rw-p 00000000 00:00 0 ","effff7de7000-effff7de8000 ---p 00000000 00:00 0 ","effff7de8000-effff7dec000 rw-p 00000000 00:00 0 ","effff7dec000-effff7ded000 ---p 00000000 00:00 0 ","effff7ded000-effff7ff8000 rw-p 00000000 00:00 0 ","effff7ff8000-efffffff8000 rwxp 00000000 00:00 0 ","efffffff8000-f00008a70000 rw-p 00000000 00:00 0 ","ffffa92a0000-ffffa92a2000 r--p 00000000 00:00 0                          [vvar]","ffffa92a2000-ffffa92a4000 r-xp 00000000 00:00 0                          [vdso]","ffffc987a000-ffffc989b000 rw-p 00000000 00:00 0                          [stack]",""]},"incomplete":false,"metadata":{"family":"native","library_name":"libdatadog","library_version":"1.0.0","tags":["service:foo","service_version:bar","runtime-id:xyz","language:native"]},"os_info":{"architecture":"x86_64","bitness":"64-bit","os_type":"Alpine Linux","version":"3.23.3"},"proc_info":{"pid":70449},"sig_info":{"si_addr":"0x0000000000000000","si_code":1,"si_code_human_readable":"SEGV_MAPERR","si_signo":11,"si_signo_human_readable":"SIGSEGV"},"timestamp":"2026-02-02 22:35:48.477862255 UTC","uuid":"cfb1ed3a-6fc9-426a-ae2e-2da6f1beccf2"}
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
test test_crash_tracking_bin_runtime_callback_frame_invalid_utf8 ... FAILED

failures:

failures:
    test_crash_tracking_bin_runtime_callback_frame_invalid_utf8

test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 32 filtered out; finished in 57.36s

error: test failed, to rerun pass `-p bin_tests --test crashtracker_bin_test`
$ cd /workspaces/libdatadog && objdump -d target/release/crashtracker_bin_test 2>/dev/null | grep -A2 "b044:" | head -5
    b044:       8b 04 25 00 00 00 00    mov    0x0,%eax
    b04b:       48 8d 05 e6 17 07 00    lea    0x717e6(%rip),%rax        # 7c838 <__do_global_dtors_aux_fini_array_entry+0x20>
    b052:       48 8d 7c 24 08          lea    0x8(%rsp),%rdi
--
   3b044:       41 57                   push   %r15
$ cd /workspaces/libdatadog && objdump -d target/release/crashtracker_bin_test 2>/dev/null | grep -B5 "1272f:" | head -10
   1271c:       48 09 c8                or     %rcx,%rax
   1271f:       0f 85 1a 01 00 00       jne    1283f <_ZN21crashtracker_bin_test4main17h645cf264da7ea2a3E+0xee1>
   12725:       45 31 e4                xor    %r12d,%r12d
   12728:       31 ed                   xor    %ebp,%ebp
   1272a:       e8 11 89 ff ff          call   b040 <_ZN21crashtracker_bin_test4unix14cause_segfault17h806e8bb83a833ef9E>
   1272f:       e9 ec 01 00 00          jmp    12920 <_ZN21crashtracker_bin_test4main17h645cf264da7ea2a3E+0xfc2>

How to test the change?

Describe here in detail how the change can be validated.

@gyuheon0h Graphite App
Copy link
Contributor Author

gyuheon0h commented Jan 30, 2026

This stack of pull requests is managed by Graphite. Learn more about stacking.

@gyuheon0h gyuheon0h changed the title first commit Alpine musl experiment Jan 30, 2026
@github-actions
Copy link

github-actions bot commented Jan 30, 2026

📚 Documentation Check Results

⚠️ 996 documentation warning(s) found

📦 libdd-crashtracker - 996 warning(s)

Updated: 2026-01-30 21:11:01 UTC | Commit: a8b3aa5 | missing-docs job results

@github-actions
Copy link

github-actions bot commented Jan 30, 2026

🔒 Cargo Deny Results

⚠️ 1 issue(s) found, showing only errors (advisories, bans, sources)

📦 libdd-crashtracker - 1 error(s)

Show output 
error[vulnerability]: Logging user input may result in poisoning logs with ANSI escape sequences
    ┌─ /home/runner/work/libdatadog/libdatadog/Cargo.lock:200:1
    │
200 │ tracing-subscriber 0.3.19 registry+https://github.com/rust-lang/crates.io-index
    │ ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ security vulnerability detected
    │
    ├ ID: RUSTSEC-2025-0055
    ├ Advisory: https://rustsec.org/advisories/RUSTSEC-2025-0055
    ├ Previous versions of tracing-subscriber were vulnerable to ANSI escape sequence injection attacks. Untrusted user input containing ANSI escape sequences could be injected into terminal output when logged, potentially allowing attackers to:
      
      - Manipulate terminal title bars
      - Clear screens or modify terminal display
      - Potentially mislead users through terminal manipulation
      
      In isolation, impact is minimal, however security issues have been found in terminal emulators that enabled an attacker to use ANSI escape sequences via logs to exploit vulnerabilities in the terminal emulator.
      
      This was patched in [PR #3368](https://github.com/tokio-rs/tracing/pull/3368) to escape ANSI control characters from user input.
    ├ Announcement: https://github.com/advisories/GHSA-xwfj-jgwm-7wp5
    ├ Solution: Upgrade to >=0.3.20 (try `cargo update -p tracing-subscriber`)
    ├ tracing-subscriber v0.3.19
      └── (dev) libdd-telemetry v2.0.0
          └── libdd-crashtracker v1.0.0

advisories FAILED, bans ok, sources ok

Updated: 2026-01-30 21:14:05 UTC | Commit: a8b3aa5 | dependency-check job results

@datadog-official
Copy link

datadog-official bot commented Jan 30, 2026 •
edited by datadog-datadog-prod-us1 bot
Loading

⚠️ Tests

✨ Fix all issues with Cursor

⚠️ Warnings

🧪 2 Tests failed

test_crash_tracking_bin_runtime_callback_frame_invalid_utf8 from bin_tests::crashtracker_bin_test (Datadog) (Fix with Cursor) 
Test has failed
crash_info::tests::test_schema_matches_rfc from libdd-crashtracker (Datadog) (Fix with Cursor) 
Test has failed

ℹ️ Info

❄️ No new flaky tests detected

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 1dd18a7 | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Jan 30, 2026 •
edited
Loading

Benchmarks

Comparison

Benchmark execution time: 2026-02-02 22:58:02

Comparing candidate commit 1dd18a7 in PR branch gyuheon0h/alpine-musl-experiment with baseline commit c89b6df in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 12.686ms 13.136ms ± 0.100ms 13.138ms ± 0.041ms 13.185ms 13.276ms 13.358ms 13.550ms 3.13% -0.767 4.613 0.76% 0.007ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [13.122ms; 13.149ms] or [-0.106%; +0.106%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 241.318ns 253.867ns ± 14.646ns 247.036ns ± 4.262ns 254.260ns 287.948ns 290.599ns 296.879ns 20.18% 1.439 0.681 5.75% 1.036ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [251.837ns; 255.897ns] or [-0.800%; +0.800%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 162.306µs 162.913µs ± 0.327µs 162.857µs ± 0.133µs 163.004µs 163.486µs 164.229µs 164.711µs 1.14% 2.437 9.430 0.20% 0.023µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [162.868µs; 162.958µs] or [-0.028%; +0.028%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 89.014µs 89.230µs ± 0.184µs 89.197µs ± 0.081µs 89.291µs 89.432µs 89.733µs 90.968µs 1.99% 5.210 42.012 0.21% 0.013µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [89.205µs; 89.256µs] or [-0.029%; +0.029%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 33.396µs 33.978µs ± 1.045µs 33.495µs ± 0.046µs 33.607µs 36.240µs 36.264µs 37.178µs 10.99% 1.716 1.025 3.07% 0.074µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.833µs; 34.122µs] or [-0.426%; +0.426%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 143.964µs 145.964µs ± 1.840µs 145.670µs ± 0.480µs 146.227µs 147.446µs 152.229µs 165.278µs 13.46% 6.938 63.750 1.26% 0.130µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [145.709µs; 146.219µs] or [-0.175%; +0.175%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.979µs 5.071µs ± 0.069µs 5.035µs ± 0.027µs 5.125µs 5.202µs 5.205µs 5.207µs 3.41% 0.740 -0.949 1.36% 0.005µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.062µs; 5.081µs] or [-0.189%; +0.189%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.214µs 3.163µs ± 1.422µs 2.988µs ± 0.029µs 3.016µs 3.390µs 13.649µs 15.058µs 404.00% 7.481 56.687 44.86% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.966µs; 3.360µs] or [-6.232%; +6.232%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 204.679µs 205.625µs ± 0.559µs 205.535µs ± 0.361µs 205.940µs 206.656µs 207.109µs 207.686µs 1.05% 0.940 0.974 0.27% 0.040µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4814957.914op/s 4863253.788op/s ± 13182.267op/s 4865340.225op/s ± 8558.513op/s 4873566.033op/s 4879685.840op/s 4884359.465op/s 4885706.812op/s 0.42% -0.923 0.920 0.27% 932.127op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.585µs 18.746µs ± 0.106µs 18.709µs ± 0.058µs 18.810µs 18.951µs 19.035µs 19.138µs 2.29% 1.040 0.533 0.56% 0.007µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 52252157.300op/s 53345007.849op/s ± 299418.826op/s 53449478.663op/s ± 166440.646op/s 53574574.650op/s 53665821.690op/s 53746639.111op/s 53805423.035op/s 0.67% -1.016 0.454 0.56% 21172.108op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.859µs 10.939µs ± 0.039µs 10.936µs ± 0.029µs 10.967µs 11.000µs 11.020µs 11.034µs 0.90% 0.083 -0.683 0.35% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 90624922.562op/s 91416551.254op/s ± 322112.956op/s 91438923.701op/s ± 243746.786op/s 91661506.231op/s 91952308.969op/s 92070340.535op/s 92093088.845op/s 0.72% -0.069 -0.685 0.35% 22776.826op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [205.548µs; 205.703µs] or [-0.038%; +0.038%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4861426.852op/s; 4865080.723op/s] or [-0.038%; +0.038%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.732µs; 18.761µs] or [-0.078%; +0.078%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53303511.280op/s; 53386504.419op/s] or [-0.078%; +0.078%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.934µs; 10.944µs] or [-0.049%; +0.049%] None None None
normalization/normalize_name/normalize_name/good throughput [91371909.497op/s; 91461193.012op/s] or [-0.049%; +0.049%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample_frames_x1000 execution_time 3.951ms 3.959ms ± 0.008ms 3.958ms ± 0.002ms 3.959ms 3.963ms 3.989ms 4.050ms 2.32% 7.404 70.170 0.21% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample_frames_x1000 execution_time [3.958ms; 3.960ms] or [-0.029%; +0.029%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.607ms 10.636ms ± 0.014ms 10.634ms ± 0.008ms 10.644ms 10.659ms 10.675ms 10.718ms 0.79% 1.348 5.286 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.634ms; 10.638ms] or [-0.018%; +0.018%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.323µs 2.374µs ± 0.019µs 2.369µs ± 0.008µs 2.386µs 2.400µs 2.406µs 2.502µs 5.60% 1.077 9.060 0.81% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.371µs; 2.376µs] or [-0.113%; +0.113%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.589ms 14.658ms ± 0.037ms 14.657ms ± 0.017ms 14.670ms 14.713ms 14.772ms 14.917ms 1.78% 2.389 12.763 0.25% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.653ms; 14.663ms] or [-0.035%; +0.035%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.584µs 25.929µs ± 9.846µs 18.504µs ± 0.590µs 33.968µs 42.955µs 51.445µs 71.589µs 286.89% 1.054 1.081 37.88% 0.696µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.565µs; 27.294µs] or [-5.262%; +5.262%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 49.888ms 50.320ms ± 1.455ms 50.139ms ± 0.059ms 50.194ms 50.377ms 56.675ms 65.390ms 30.42% 8.863 80.615 2.88% 0.103ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [50.119ms; 50.522ms] or [-0.401%; +0.401%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
profile_add_sample2_frames_x1000 execution_time 539.731µs 540.351µs ± 0.373µs 540.271µs ± 0.187µs 540.506µs 540.947µs 541.513µs 542.861µs 0.48% 2.246 10.031 0.07% 0.026µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
profile_add_sample2_frames_x1000 execution_time [540.299µs; 540.403µs] or [-0.010%; +0.010%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 188.590ns 191.300ns ± 2.121ns 191.140ns ± 1.578ns 192.477ns 195.014ns 196.956ns 201.406ns 5.37% 1.108 2.371 1.11% 0.150ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [191.006ns; 191.594ns] or [-0.154%; +0.154%] None None None

Group 18

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.894µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.916µs 3.920µs 3.922µs 0.26% -0.724 8.501 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 254964526.414op/s 255617855.116op/s ± 180313.955op/s 255622188.006op/s ± 98168.072op/s 255717239.963op/s 255863156.536op/s 255954635.909op/s 256773712.640op/s 0.45% 0.746 8.608 0.07% 12750.122op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.056µs 77.595µs ± 0.384µs 77.527µs ± 0.239µs 77.789µs 78.236µs 78.727µs 79.033µs 1.94% 0.966 0.997 0.49% 0.027µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12652993.325op/s 12887759.671op/s ± 63434.325op/s 12898793.969op/s ± 39683.342op/s 12931809.017op/s 12967899.598op/s 12973672.087op/s 12977556.473op/s 0.61% -0.936 0.903 0.49% 4485.484op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 70.634µs 71.123µs ± 0.314µs 71.064µs ± 0.169µs 71.287µs 71.735µs 72.061µs 72.193µs 1.59% 0.861 0.858 0.44% 0.022µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13851785.697op/s 14060395.022op/s ± 61834.478op/s 14071880.910op/s ± 33473.383op/s 14100114.564op/s 14145272.511op/s 14151597.781op/s 14157517.747op/s 0.61% -0.833 0.786 0.44% 4372.358op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.895µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.915µs 3.918µs 3.921µs 3.922µs 0.21% -0.551 4.968 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254997161.211op/s 255530157.084op/s ± 204147.813op/s 255543167.200op/s ± 121631.043op/s 255651360.463op/s 255811019.789op/s 255894916.348op/s 256722209.796op/s 0.46% 0.567 5.051 0.08% 14435.430op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 67.444µs 67.904µs ± 0.288µs 67.863µs ± 0.199µs 68.080µs 68.406µs 68.606µs 68.730µs 1.28% 0.423 -0.454 0.42% 0.020µs 1 200
credit_card/is_card_number/378282246310005 throughput 14549702.916op/s 14726945.719op/s ± 62260.774op/s 14735590.002op/s ± 43223.838op/s 14768687.812op/s 14815628.191op/s 14822725.350op/s 14827072.752op/s 0.62% -0.406 -0.479 0.42% 4402.502op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 44.695µs 45.196µs ± 0.190µs 45.192µs ± 0.126µs 45.336µs 45.482µs 45.527µs 45.573µs 0.84% -0.357 -0.379 0.42% 0.013µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21942684.719op/s 22126436.957op/s ± 93078.807op/s 22127684.525op/s ± 61617.292op/s 22184330.099op/s 22293140.913op/s 22352767.644op/s 22373632.815op/s 1.11% 0.376 -0.357 0.42% 6581.666op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.029µs 6.040µs ± 0.011µs 6.038µs ± 0.003µs 6.040µs 6.058µs 6.090µs 6.092µs 0.90% 3.273 11.336 0.18% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 164156327.181op/s 165575258.759op/s ± 299235.646op/s 165626458.831op/s ± 88067.798op/s 165718555.059op/s 165830142.393op/s 165856719.831op/s 165862959.135op/s 0.14% -3.259 11.257 0.18% 21159.155op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.893µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.917µs 3.919µs 3.933µs 0.52% 0.306 13.355 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254269732.753op/s 255601864.439op/s ± 210827.342op/s 255599178.911op/s ± 110110.682op/s 255711059.505op/s 255856913.237op/s 255925281.315op/s 256895798.563op/s 0.51% -0.268 13.341 0.08% 14907.744op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.312µs 65.590µs ± 0.086µs 65.593µs ± 0.058µs 65.653µs 65.729µs 65.758µs 65.810µs 0.33% -0.165 -0.022 0.13% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15195289.262op/s 15246200.779op/s ± 19946.147op/s 15245601.409op/s ± 13493.653op/s 15258924.882op/s 15279347.671op/s 15290794.728op/s 15311169.498op/s 0.43% 0.173 -0.015 0.13% 1410.406op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 52.950µs 53.042µs ± 0.038µs 53.045µs ± 0.026µs 53.067µs 53.097µs 53.127µs 53.148µs 0.19% -0.087 -0.287 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18815359.107op/s 18853146.595op/s ± 13336.184op/s 18851785.621op/s ± 9113.507op/s 18863597.974op/s 18875923.100op/s 18883067.025op/s 18885646.908op/s 0.18% 0.091 -0.288 0.07% 943.011op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.896µs 3.912µs ± 0.002µs 3.912µs ± 0.001µs 3.914µs 3.916µs 3.917µs 3.920µs 0.18% -1.294 8.435 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 255126291.009op/s 255604553.330op/s ± 161819.065op/s 255596973.492op/s ± 91878.295op/s 255691749.637op/s 255828421.016op/s 255940094.880op/s 256675960.915op/s 0.42% 1.310 8.552 0.06% 11442.336op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 49.743µs 49.815µs ± 0.037µs 49.814µs ± 0.025µs 49.838µs 49.876µs 49.899µs 49.995µs 0.36% 0.856 2.153 0.08% 0.003µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 20002089.771op/s 20074255.381op/s ± 15086.764op/s 20074581.565op/s ± 10197.185op/s 20085565.007op/s 20096252.953op/s 20098629.897op/s 20103154.185op/s 0.14% -0.848 2.119 0.07% 1066.795op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 44.539µs 45.150µs ± 0.235µs 45.157µs ± 0.163µs 45.336µs 45.488µs 45.520µs 45.541µs 0.85% -0.500 -0.361 0.52% 0.017µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21958228.920op/s 22148757.512op/s ± 115693.516op/s 22144877.048op/s ± 79961.154op/s 22217435.251op/s 22376436.302op/s 22439328.735op/s 22452375.932op/s 1.39% 0.521 -0.328 0.52% 8180.767op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.027µs 6.038µs ± 0.011µs 6.036µs ± 0.003µs 6.039µs 6.048µs 6.103µs 6.104µs 1.12% 4.033 18.624 0.19% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 163839738.616op/s 165607388.302op/s ± 306759.759op/s 165668851.976op/s ± 86163.645op/s 165748606.060op/s 165853091.819op/s 165894277.038op/s 165910268.794op/s 0.15% -4.009 18.436 0.18% 21691.191op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.912µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255592865.336op/s; 255642844.896op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [77.542µs; 77.648µs] or [-0.069%; +0.069%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12878968.284op/s; 12896551.058op/s] or [-0.068%; +0.068%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.080µs; 71.167µs] or [-0.061%; +0.061%] None None None
credit_card/is_card_number/ 378282246310005 throughput [14051825.358op/s; 14068964.686op/s] or [-0.061%; +0.061%] None None None
credit_card/is_card_number/37828224631 execution_time [3.913µs; 3.914µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255501864.161op/s; 255558450.008op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [67.864µs; 67.944µs] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/378282246310005 throughput [14718316.975op/s; 14735574.464op/s] or [-0.059%; +0.059%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.169µs; 45.222µs] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [22113537.130op/s; 22139336.785op/s] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.038µs; 6.041µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number/x371413321323331 throughput [165533787.577op/s; 165616729.942op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.912µs; 3.913µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ throughput [255572645.797op/s; 255631083.081op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.578µs; 65.602µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15243436.435op/s; 15248965.123op/s] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.036µs; 53.047µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18851298.328op/s; 18854994.862op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.912µs; 3.913µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255582126.764op/s; 255626979.896op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [49.810µs; 49.820µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [20072164.501op/s; 20076346.262op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.118µs; 45.183µs] or [-0.072%; +0.072%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [22132723.503op/s; 22164791.521op/s] or [-0.072%; +0.072%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.037µs; 6.040µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165564874.350op/s; 165649902.255op/s] or [-0.026%; +0.026%] None None None

Group 19

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1dd18a7 1770072113 gyuheon0h/alpine-musl-experiment
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 535.047µs 537.058µs ± 1.385µs 536.545µs ± 0.712µs 538.085µs 539.301µs 541.146µs 543.651µs 1.32% 1.319 2.212 0.26% 0.098µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1839415.957op/s 1862008.761op/s ± 4787.452op/s 1863775.855op/s ± 2477.352op/s 1865502.688op/s 1867226.202op/s 1867743.933op/s 1868993.043op/s 0.28% -1.300 2.114 0.26% 338.524op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 383.942µs 384.526µs ± 0.293µs 384.510µs ± 0.177µs 384.709µs 385.019µs 385.238µs 385.492µs 0.26% 0.291 0.033 0.08% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2594089.311op/s 2600603.556op/s ± 1981.992op/s 2600712.448op/s ± 1194.931op/s 2601888.762op/s 2603959.134op/s 2604343.005op/s 2604560.359op/s 0.15% -0.287 0.027 0.08% 140.148op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 189.494µs 190.002µs ± 0.208µs 189.990µs ± 0.142µs 190.135µs 190.348µs 190.485µs 190.610µs 0.33% 0.147 -0.097 0.11% 0.015µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5246317.993op/s 5263102.909op/s ± 5770.438op/s 5263438.825op/s ± 3925.736op/s 5267162.822op/s 5272310.549op/s 5276245.906op/s 5277201.946op/s 0.26% -0.140 -0.099 0.11% 408.032op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 36.516µs 36.627µs ± 0.047µs 36.630µs ± 0.030µs 36.658µs 36.702µs 36.725µs 36.791µs 0.44% 0.070 -0.026 0.13% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 27180344.987op/s 27302419.214op/s ± 34718.770op/s 27300047.263op/s ± 22199.177op/s 27323327.584op/s 27360953.689op/s 27370218.342op/s 27385345.059op/s 0.31% -0.062 -0.036 0.13% 2454.988op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.928µs 46.063µs ± 0.074µs 46.059µs ± 0.028µs 46.087µs 46.135µs 46.205µs 46.841µs 1.70% 6.053 61.100 0.16% 0.005µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21348690.318op/s 21709375.708op/s ± 34360.368op/s 21711076.796op/s ± 13150.691op/s 21725134.333op/s 21748002.552op/s 21761297.569op/s 21773220.895op/s 0.29% -5.927 59.363 0.16% 2429.645op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [536.866µs; 537.250µs] or [-0.036%; +0.036%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1861345.266op/s; 1862672.256op/s] or [-0.036%; +0.036%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [384.486µs; 384.567µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2600328.871op/s; 2600878.241op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [189.973µs; 190.031µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5262303.181op/s; 5263902.636op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [36.620µs; 36.633µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [27297607.526op/s; 27307230.901op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [46.053µs; 46.073µs] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21704613.692op/s; 21714137.725op/s] or [-0.022%; +0.022%] None None None

Baseline

Omitted due to size.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

crashtracker

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@gyuheon0h