| Benchmark | CV% | π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) |
|---|---|---|---|
| blind-sig | 1.89% | 393.7M cycles (p25) | 11.06% faster |
| bz2 | 2.05% | 122.6M cycles (p25) | No significant difference |
| gcc-loops | 0.22% | 21.4B cycles (p25) | 14.15% slower |
| hashset | 1.17% | 145.1M cycles (p25) | 1.36% faster |
| hex-simd | 6.79% | 958.7K cycles (p25) | 4.16% faster |
| intgemm-simd | 2.38% | 1.1B cycles (p25) | 0.74% slower |
| libsodium/libsodium-aead_aegis128l | 8.78% | 26.2M cycles (p25) | No significant difference |
| libsodium/libsodium-aead_chacha20poly13052 | 6.00% | 1.6M cycles (p25) | 4.27% faster |
| libsodium/libsodium-aead_xchacha20poly1305 | 4.81% | 753.5K cycles (p25) | No significant difference |
| libsodium/libsodium-auth5 | 2.16% | 84.7M cycles (p25) | 21.20% faster |
| libsodium/libsodium-auth7 | 5.47% | 44.0M cycles (p25) | 18.80% faster |
| libsodium/libsodium-box | 7.26% | 2.7M cycles (p25) | No significant difference |
| libsodium/libsodium-box2 | 2.72% | 2.7M cycles (p25) | No significant difference |
| libsodium/libsodium-box7 | 2.23% | 2.6B cycles (p25) | No significant difference |
| libsodium/libsodium-box8 | 0.47% | 7.9B cycles (p25) | 0.18% slower |
| libsodium/libsodium-box_easy | 5.57% | 5.4M cycles (p25) | No significant difference |
| libsodium/libsodium-chacha20 | 3.59% | 2.1M cycles (p25) | No significant difference |
| libsodium/libsodium-codecs | 2.40% | 5.4M cycles (p25) | 2.73% slower |
| libsodium/libsodium-core3 | 1.87% | 355.7M cycles (p25) | 25.30% faster |
| libsodium/libsodium-core_ed25519 | 0.88% | 9.2B cycles (p25) | 0.90% faster |
| libsodium/libsodium-core_ristretto255 | 0.64% | 10.2B cycles (p25) | 0.25% faster |
| libsodium/libsodium-ed25519_convert | 1.18% | 1.1B cycles (p25) | 1.01% faster |
| libsodium/libsodium-generichash | 2.55% | 3.5M cycles (p25) | 22.21% faster |
| libsodium/libsodium-kdf_hkdf | 2.16% | 4.3M cycles (p25) | 18.87% faster |
| libsodium/libsodium-kx | 2.68% | 15.5M cycles (p25) | 0.70% slower |
| libsodium/libsodium-metamorphic | 2.33% | 104.2M cycles (p25) | 19.39% faster |
| libsodium/libsodium-onetimeauth7 | 2.90% | 34.5M cycles (p25) | 1.09% faster |
| libsodium/libsodium-pwhash_argon2i | 1.24% | 1.8B cycles (p25) | 1.28% faster |
| libsodium/libsodium-pwhash_argon2id | 1.39% | 2.0B cycles (p25) | 1.28% faster |
| libsodium/libsodium-pwhash_scrypt | 0.81% | 4.2B cycles (p25) | 1.92% faster |
| libsodium/libsodium-pwhash_scrypt_ll | 1.82% | 290.7M cycles (p25) | 0.99% faster |
| libsodium/libsodium-scalarmult | 1.71% | 4.9M cycles (p25) | No significant difference |
| libsodium/libsodium-scalarmult5 | 6.08% | 1.4M cycles (p25) | No significant difference |
| libsodium/libsodium-scalarmult6 | 4.11% | 1.4M cycles (p25) | No significant difference |
| libsodium/libsodium-scalarmult7 | 5.61% | 2.7M cycles (p25) | No significant difference |
| libsodium/libsodium-scalarmult8 | 2.33% | 78.5M cycles (p25) | No significant difference |
| libsodium/libsodium-scalarmult_ed25519 | 1.64% | 25.3M cycles (p25) | No significant difference |
| libsodium/libsodium-scalarmult_ristretto255 | 3.17% | 29.8M cycles (p25) | No significant difference |
| libsodium/libsodium-secretbox8 | 1.79% | 106.8M cycles (p25) | No significant difference |
| libsodium/libsodium-sign | 0.65% | 4.0B cycles (p25) | 1.37% slower |
| libsodium/libsodium-stream | 0.97% | 263.8M cycles (p25) | 27.53% faster |
| libsodium/libsodium-stream2 | 2.31% | 236.8M cycles (p25) | 30.89% faster |
| libsodium/libsodium-verify1 | 1.56% | 164.0M cycles (p25) | 2.19% faster |
| libsodium/libsodium-xchacha20 | 5.36% | 85.5M cycles (p25) | No significant difference |
| meshoptimizer | 0.66% | 6.1B cycles (p25) | 2.29% faster |
| pulldown-cmark | 2.13% | 10.4M cycles (p25) | 1.93% faster |
| quicksort | 1.42% | 127.6M cycles (p25) | 7.58% slower |
| regex | 2.13% | 334.6M cycles (p25) | 3.77% faster |
| richards | 0.89% | 6.5B cycles (p25) | 0.48% faster |
| rust-compression | 0.53% | 8.0B cycles (p25) | 5.56% slower |
| rust-json | 2.49% | 24.2M cycles (p25) | 6.47% faster |
| rust-protobuf | 6.12% | 12.7M cycles (p25) | No significant difference |
| shootout/shootout-ackermann | 6.05% | 10.0M cycles (p25) | 2.70% faster |
| shootout/shootout-base64 | 1.30% | 464.5M cycles (p25) | 3.40% slower |
| shootout/shootout-ctype | 1.04% | 1.3B cycles (p25) | 2.22% slower |
| shootout/shootout-ed25519 | 0.50% | 14.6B cycles (p25) | 0.69% faster |
| shootout/shootout-fib2 | 0.46% | 5.0B cycles (p25) | No significant difference |
| shootout/shootout-gimli | 2.05% | 7.1M cycles (p25) | 1.85% slower |
| shootout/shootout-heapsort | 0.43% | 3.3B cycles (p25) | 5.97% slower |
| shootout/shootout-keccak | 1.70% | 49.3M cycles (p25) | 42.15% faster |
| shootout/shootout-matrix | 1.64% | 624.9M cycles (p25) | 1.41% faster |
| shootout/shootout-memmove | 2.03% | 46.4M cycles (p25) | No significant difference |
| shootout/shootout-minicsv | 0.72% | 2.3B cycles (p25) | 0.59% slower |
| shootout/shootout-random | 0.33% | 467.0M cycles (p25) | 0.22% faster |
| shootout/shootout-ratelimit | 3.67% | 49.4M cycles (p25) | 1.60% faster |
| shootout/shootout-seqhash | 1.72% | 12.5B cycles (p25) | 11.96% faster |
| shootout/shootout-sieve | 0.98% | 1.7B cycles (p25) | 14.80% slower |
| shootout/shootout-switch | 2.11% | 199.6M cycles (p25) | 5.26% faster |
| shootout/shootout-xblabla20 | 3.79% | 4.8M cycles (p25) | 15.12% faster |
| shootout/shootout-xchacha20 | 1.72% | 6.0M cycles (p25) | 16.40% faster |
| spidermonkey/spidermonkey-json | 1.31% | 710.2M cycles (p25) | 3.87% slower |
| spidermonkey/spidermonkey-markdown | 1.33% | 330.7M cycles (p25) | 1.14% faster |
| spidermonkey/spidermonkey-regex | 2.09% | 153.4M cycles (p25) | 8.05% faster |
| sqlite3/sqlite3 | 0.54% | 5.2B cycles (p25) | 4.01% faster |
| tinygo/tinygo-json | 2.67% | 230.5M cycles (p25) | 3.64% slower |
| tinygo/tinygo-regex | 1.01% | 9.5B cycles (p25) | 11.61% slower |
| tract-onnx-image-classification | 1.67% | 1.8B cycles (p25) | 11.58% faster |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 393.7M cycles (p25) | β | β | 1.89% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 349.9M cycles | 11.06% faster | Β±2.5M cycles | 2.61% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 122.6M cycles (p25) | β | β | 2.05% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 122.7M cycles | No significant difference | Β±645.9K cycles | 1.34% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 21.4B cycles (p25) | β | β | 0.22% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 24.4B cycles | 14.15% slower | Β±17.6M cycles | 0.28% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 145.1M cycles (p25) | β | β | 1.17% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 142.5M cycles | 1.36% faster | Β±948.5K cycles | 2.85% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 958.7K cycles (p25) | β | β | 6.79% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 925.9K cycles | 4.16% faster | Β±18.3K cycles | 5.47% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.1B cycles (p25) | β | β | 2.38% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.1B cycles | 0.74% slower | Β±7.8M cycles | 2.11% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 26.2M cycles (p25) | β | β | 8.78% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 26.2M cycles | No significant difference | Β±512.0K cycles | 1.54% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.6M cycles (p25) | β | β | 6.00% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.5M cycles | 4.27% faster | Β±28.0K cycles | 5.84% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 753.5K cycles (p25) | β | β | 4.81% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 747.2K cycles | No significant difference | Β±11.2K cycles | 4.76% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 84.7M cycles (p25) | β | β | 2.16% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 66.8M cycles | 21.20% faster | Β±635.4K cycles | 3.48% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 44.0M cycles (p25) | β | β | 5.47% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 35.5M cycles | 18.80% faster | Β±699.0K cycles | 6.09% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.7M cycles (p25) | β | β | 7.26% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.7M cycles | No significant difference | Β±54.4K cycles | 5.63% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.7M cycles (p25) | β | β | 2.72% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.7M cycles | No significant difference | Β±31.2K cycles | 4.54% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.6B cycles (p25) | β | β | 2.23% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.6B cycles | No significant difference | Β±15.4M cycles | 1.63% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 7.9B cycles (p25) | β | β | 0.47% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 7.9B cycles | 0.18% slower | Β±11.9M cycles | 0.54% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 5.4M cycles (p25) | β | β | 5.57% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 5.4M cycles | No significant difference | Β±112.6K cycles | 7.86% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.1M cycles (p25) | β | β | 3.59% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.1M cycles | No significant difference | Β±25.0K cycles | 4.16% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 5.4M cycles (p25) | β | β | 2.40% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 5.5M cycles | 2.73% slower | Β±73.9K cycles | 5.66% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 355.7M cycles (p25) | β | β | 1.87% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 265.4M cycles | 25.30% faster | Β±2.3M cycles | 3.07% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 9.2B cycles (p25) | β | β | 0.88% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 9.1B cycles | 0.90% faster | Β±23.9M cycles | 0.84% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 10.2B cycles (p25) | β | β | 0.64% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 10.2B cycles | 0.25% faster | Β±20.1M cycles | 0.67% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.1B cycles (p25) | β | β | 1.18% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.1B cycles | 1.01% faster | Β±4.0M cycles | 1.23% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 3.5M cycles (p25) | β | β | 2.55% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.7M cycles | 22.21% faster | Β±39.8K cycles | 5.94% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 4.3M cycles (p25) | β | β | 2.16% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 3.4M cycles | 18.87% faster | Β±46.3K cycles | 5.58% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 15.5M cycles (p25) | β | β | 2.68% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 15.6M cycles | 0.70% slower | Β±105.0K cycles | 1.66% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 104.2M cycles (p25) | β | β | 2.33% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 84.1M cycles | 19.39% faster | Β±589.2K cycles | 1.53% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 34.5M cycles (p25) | β | β | 2.90% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 34.1M cycles | 1.09% faster | Β±344.7K cycles | 3.68% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.8B cycles (p25) | β | β | 1.24% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.7B cycles | 1.28% faster | Β±7.2M cycles | 1.49% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.0B cycles (p25) | β | β | 1.39% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.9B cycles | 1.28% faster | Β±8.4M cycles | 1.46% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 4.2B cycles (p25) | β | β | 0.81% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 4.1B cycles | 1.92% faster | Β±12.4M cycles | 1.15% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 290.7M cycles (p25) | β | β | 1.82% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 287.7M cycles | 0.99% faster | Β±1.7M cycles | 1.96% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 4.9M cycles (p25) | β | β | 1.71% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 4.9M cycles | No significant difference | Β±61.4K cycles | 5.52% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.4M cycles (p25) | β | β | 6.08% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.3M cycles | No significant difference | Β±27.2K cycles | 6.80% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.4M cycles (p25) | β | β | 4.11% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.4M cycles | No significant difference | Β±35.3K cycles | 10.57% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.7M cycles (p25) | β | β | 5.61% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.7M cycles | No significant difference | Β±55.4K cycles | 7.64% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 78.5M cycles (p25) | β | β | 2.33% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 78.2M cycles | No significant difference | Β±864.6K cycles | 4.56% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 25.3M cycles (p25) | β | β | 1.64% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 25.2M cycles | No significant difference | Β±135.9K cycles | 1.89% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 29.8M cycles (p25) | β | β | 3.17% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 29.9M cycles | No significant difference | Β±491.6K cycles | 6.88% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 106.8M cycles (p25) | β | β | 1.79% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 106.2M cycles | No significant difference | Β±964.3K cycles | 3.80% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 4.0B cycles (p25) | β | β | 0.65% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 4.0B cycles | 1.37% slower | Β±11.0M cycles | 1.11% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 263.8M cycles (p25) | β | β | 0.97% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 190.8M cycles | 27.53% faster | Β±808.0K cycles | 1.46% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 236.8M cycles (p25) | β | β | 2.31% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 163.4M cycles | 30.89% faster | Β±1.6M cycles | 3.18% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 164.0M cycles (p25) | β | β | 1.56% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 160.6M cycles | 2.19% faster | Β±857.0K cycles | 1.91% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 85.5M cycles (p25) | β | β | 5.36% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 84.8M cycles | No significant difference | Β±1.2M cycles | 4.06% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 6.1B cycles (p25) | β | β | 0.66% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 5.9B cycles | 2.29% faster | Β±11.1M cycles | 0.57% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 10.4M cycles (p25) | β | β | 2.13% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 10.2M cycles | 1.93% faster | Β±61.7K cycles | 1.79% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 127.6M cycles (p25) | β | β | 1.42% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 137.1M cycles | 7.58% slower | Β±627.3K cycles | 1.69% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 334.6M cycles (p25) | β | β | 2.13% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 322.7M cycles | 3.77% faster | Β±2.0M cycles | 1.75% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 6.5B cycles (p25) | β | β | 0.89% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 6.4B cycles | 0.48% faster | Β±21.0M cycles | 1.24% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 8.0B cycles (p25) | β | β | 0.53% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 8.5B cycles | 5.56% slower | Β±12.0M cycles | 0.44% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 24.2M cycles (p25) | β | β | 2.49% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 22.6M cycles | 6.47% faster | Β±169.2K cycles | 2.25% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 12.7M cycles (p25) | β | β | 6.12% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 12.8M cycles | No significant difference | Β±234.9K cycles | 5.88% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 10.0M cycles (p25) | β | β | 6.05% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 9.9M cycles | 2.70% faster | Β±136.5K cycles | 1.62% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 464.5M cycles (p25) | β | β | 1.30% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 480.1M cycles | 3.40% slower | Β±2.0M cycles | 1.54% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.3B cycles (p25) | β | β | 1.04% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.3B cycles | 2.22% slower | Β±3.7M cycles | 0.83% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 14.6B cycles (p25) | β | β | 0.50% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 14.5B cycles | 0.69% faster | Β±23.9M cycles | 0.59% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 5.0B cycles (p25) | β | β | 0.46% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 5.0B cycles | No significant difference | Β±7.3M cycles | 0.51% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 7.1M cycles (p25) | β | β | 2.05% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 7.3M cycles | 1.85% slower | Β±64.0K cycles | 3.56% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 3.3B cycles (p25) | β | β | 0.43% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 3.5B cycles | 5.97% slower | Β±4.7M cycles | 0.49% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 49.3M cycles (p25) | β | β | 1.70% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 28.5M cycles | 42.15% faster | Β±191.8K cycles | 1.06% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 624.9M cycles (p25) | β | β | 1.64% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 615.1M cycles | 1.41% faster | Β±3.8M cycles | 2.39% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 46.4M cycles (p25) | β | β | 2.03% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 46.5M cycles | No significant difference | Β±277.9K cycles | 1.90% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.3B cycles (p25) | β | β | 0.72% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 2.3B cycles | 0.59% slower | Β±8.2M cycles | 1.49% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 467.0M cycles (p25) | β | β | 0.33% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 466.4M cycles | 0.22% faster | Β±381.7K cycles | 0.20% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 49.4M cycles (p25) | β | β | 3.67% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 47.9M cycles | 1.60% faster | Β±799.6K cycles | 6.61% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 12.5B cycles (p25) | β | β | 1.72% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 11.1B cycles | 11.96% faster | Β±48.4M cycles | 0.56% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.7B cycles (p25) | β | β | 0.98% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.9B cycles | 14.80% slower | Β±4.7M cycles | 0.77% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 199.6M cycles (p25) | β | β | 2.11% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 189.6M cycles | 5.26% faster | Β±979.2K cycles | 0.92% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 4.8M cycles (p25) | β | β | 3.79% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 4.1M cycles | 15.12% faster | Β±75.0K cycles | 7.19% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 6.0M cycles (p25) | β | β | 1.72% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 5.0M cycles | 16.40% faster | Β±35.3K cycles | 2.58% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 710.2M cycles (p25) | β | β | 1.31% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 737.3M cycles | 3.87% slower | Β±3.2M cycles | 1.54% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 330.7M cycles (p25) | β | β | 1.33% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 326.1M cycles | 1.14% faster | Β±1.7M cycles | 2.02% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 153.4M cycles (p25) | β | β | 2.09% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 141.2M cycles | 8.05% faster | Β±790.9K cycles | 1.28% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 5.2B cycles (p25) | β | β | 0.54% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 5.0B cycles | 4.01% faster | Β±8.4M cycles | 0.55% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 230.5M cycles (p25) | β | β | 2.67% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 238.5M cycles | 3.64% slower | Β±2.1M cycles | 3.19% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 9.5B cycles (p25) | β | β | 1.01% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 10.6B cycles | 11.61% slower | Β±26.4M cycles | 0.73% |
| Engine | Cycles (p25) | Performance | Confidence Interval | CV% |
|---|---|---|---|---|
| π /home/posborne/Projects/OpenSource/sightglass/engines/wasmtime/v39.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.8B cycles (p25) | β | β | 1.67% |
| β¦v45.0.2/libengine.so (--config /home/posborne/executed_config_x86_64.toml) | 1.6B cycles | 11.58% faster | Β±9.2M cycles | 1.90% |
Uses effect size analysis with confidence intervals based on Student's t-test. Statistical significance indicates the difference is likely real (not measurement noise). Tests with CV > 5% may have unreliable measurements.
Baseline Engine (π): The baseline engine is the reference point for all comparisons. Performance differences are calculated relative to the baseline. The baseline engine appears with a chart icon (π) and is highlighted with a light blue background in detailed tables.
P25 Metric: Cycle counts show the 25th percentile (p25) rather than mean or median. This metric is more robust to outliers, as noise in benchmarking typically appears as spikes on the higher end (system interrupts, background processes, etc.). P25 represents a "good run" that is consistently achievableβ25% of runs are this fast or faster.
Color Coding: Green indicates significantly faster performance, red indicates significantly slower, and gray indicates high measurement noise (CV > 5%). No highlighting means no statistically significant difference from baseline.
References: Benchmark Suite RFC | Sightglass Documentation