feat: opt-out telemtry for serverless builds#17164
Conversation
Codeowners resolved as |
Performance SLOsComparing candidate julio/add-features-to-reduce-native-size (63414ee) with baseline main (269a9c9) 📈 Performance Regressions (2 suites)📈 iastaspects - 118/118✅ add_aspectTime: ✅ 104.574µs (SLO: <130.000µs 📉 -19.6%) vs baseline: +0.9% Memory: ✅ 43.626MB (SLO: <46.000MB -5.2%) vs baseline: +4.8% ✅ add_inplace_aspectTime: ✅ 105.354µs (SLO: <130.000µs 📉 -19.0%) vs baseline: +1.7% Memory: ✅ 43.619MB (SLO: <46.000MB -5.2%) vs baseline: +4.7% ✅ add_inplace_noaspectTime: ✅ 28.372µs (SLO: <40.000µs 📉 -29.1%) vs baseline: +0.8% Memory: ✅ 43.509MB (SLO: <46.000MB -5.4%) vs baseline: +4.5% ✅ add_noaspectTime: ✅ 48.939µs (SLO: <70.000µs 📉 -30.1%) vs baseline: -1.1% Memory: ✅ 43.667MB (SLO: <46.000MB -5.1%) vs baseline: +4.6% ✅ bytearray_aspectTime: ✅ 251.518µs (SLO: <400.000µs 📉 -37.1%) vs baseline: -0.9% Memory: ✅ 43.627MB (SLO: <46.000MB -5.2%) vs baseline: +4.9% ✅ bytearray_extend_aspectTime: ✅ 651.516µs (SLO: <800.000µs 📉 -18.6%) vs baseline: +1.5% Memory: ✅ 43.667MB (SLO: <46.000MB -5.1%) vs baseline: +4.7% ✅ bytearray_extend_noaspectTime: ✅ 269.373µs (SLO: <400.000µs 📉 -32.7%) vs baseline: -1.5% Memory: ✅ 43.600MB (SLO: <46.000MB -5.2%) vs baseline: +4.5% ✅ bytearray_noaspectTime: ✅ 140.196µs (SLO: <300.000µs 📉 -53.3%) vs baseline: -3.7% Memory: ✅ 43.726MB (SLO: <46.000MB -4.9%) vs baseline: +4.9% ✅ bytes_aspectTime: ✅ 218.902µs (SLO: <300.000µs 📉 -27.0%) vs baseline: ~same Memory: ✅ 43.577MB (SLO: <46.000MB -5.3%) vs baseline: +4.8% ✅ bytes_noaspectTime: ✅ 134.095µs (SLO: <200.000µs 📉 -33.0%) vs baseline: -0.2% Memory: ✅ 43.627MB (SLO: <46.000MB -5.2%) vs baseline: +4.5% ✅ bytesio_aspectTime: ✅ 3.796ms (SLO: <5.000ms 📉 -24.1%) vs baseline: -2.1% Memory: ✅ 43.824MB (SLO: <46.000MB -4.7%) vs baseline: +5.3% ✅ bytesio_noaspectTime: ✅ 312.943µs (SLO: <420.000µs 📉 -25.5%) vs baseline: -0.5% Memory: ✅ 43.804MB (SLO: <46.000MB -4.8%) vs baseline: +5.1% ✅ capitalize_aspectTime: ✅ 88.351µs (SLO: <300.000µs 📉 -70.5%) vs baseline: -0.3% Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +4.7% ✅ capitalize_noaspectTime: ✅ 252.806µs (SLO: <300.000µs 📉 -15.7%) vs baseline: -3.0% Memory: ✅ 43.726MB (SLO: <46.000MB -4.9%) vs baseline: +4.9% ✅ casefold_aspectTime: ✅ 88.177µs (SLO: <500.000µs 📉 -82.4%) vs baseline: -0.9% Memory: ✅ 43.647MB (SLO: <46.000MB -5.1%) vs baseline: +4.7% ✅ casefold_noaspectTime: ✅ 301.298µs (SLO: <500.000µs 📉 -39.7%) vs baseline: -4.6% Memory: ✅ 43.588MB (SLO: <46.000MB -5.2%) vs baseline: +4.7% ✅ decode_aspectTime: ✅ 87.189µs (SLO: <100.000µs 📉 -12.8%) vs baseline: +0.3% Memory: ✅ 43.783MB (SLO: <46.000MB -4.8%) vs baseline: +5.0% ✅ decode_noaspectTime: ✅ 151.222µs (SLO: <210.000µs 📉 -28.0%) vs baseline: -1.0% Memory: ✅ 43.667MB (SLO: <46.000MB -5.1%) vs baseline: +4.8% ✅ encode_aspectTime: ✅ 84.760µs (SLO: <200.000µs 📉 -57.6%) vs baseline: ~same Memory: ✅ 43.534MB (SLO: <46.000MB -5.4%) vs baseline: +4.4% ✅ encode_noaspectTime: ✅ 142.984µs (SLO: <200.000µs 📉 -28.5%) vs baseline: +0.3% Memory: ✅ 43.608MB (SLO: <46.000MB -5.2%) vs baseline: +4.6% ✅ format_aspectTime: ✅ 14.580ms (SLO: <19.200ms 📉 -24.1%) vs baseline: -0.1% Memory: ✅ 43.655MB (SLO: <46.000MB -5.1%) vs baseline: +4.7% ✅ format_map_aspectTime: ✅ 16.394ms (SLO: <21.500ms 📉 -23.8%) vs baseline: ~same Memory: ✅ 43.724MB (SLO: <46.000MB -4.9%) vs baseline: +4.6% ✅ format_map_noaspectTime: ✅ 371.992µs (SLO: <500.000µs 📉 -25.6%) vs baseline: +0.6% Memory: ✅ 43.744MB (SLO: <46.000MB -4.9%) vs baseline: +4.9% ✅ format_noaspectTime: ✅ 302.296µs (SLO: <500.000µs 📉 -39.5%) vs baseline: -0.9% Memory: ✅ 43.863MB (SLO: <46.000MB -4.6%) vs baseline: +5.0% ✅ index_aspectTime: ✅ 131.463µs (SLO: <300.000µs 📉 -56.2%) vs baseline: +4.4% Memory: ✅ 43.685MB (SLO: <46.000MB -5.0%) vs baseline: +4.9% ✅ index_noaspectTime: ✅ 40.496µs (SLO: <300.000µs 📉 -86.5%) vs baseline: +0.5% Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +5.2% ✅ join_aspectTime: ✅ 209.789µs (SLO: <300.000µs 📉 -30.1%) vs baseline: -5.0% Memory: ✅ 43.575MB (SLO: <46.000MB -5.3%) vs baseline: +4.7% ✅ join_noaspectTime: ✅ 144.904µs (SLO: <300.000µs 📉 -51.7%) vs baseline: -2.1% Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +5.0% ✅ ljust_aspectTime: ✅ 569.366µs (SLO: <700.000µs 📉 -18.7%) vs baseline: 📈 +13.3% Memory: ✅ 43.691MB (SLO: <46.000MB -5.0%) vs baseline: +5.0% ✅ ljust_noaspectTime: ✅ 253.684µs (SLO: <300.000µs 📉 -15.4%) vs baseline: -3.2% Memory: ✅ 43.586MB (SLO: <46.000MB -5.2%) vs baseline: +4.4% ✅ lower_aspectTime: ✅ 290.983µs (SLO: <500.000µs 📉 -41.8%) vs baseline: -3.3% Memory: ✅ 43.549MB (SLO: <46.000MB -5.3%) vs baseline: +4.7% ✅ lower_noaspectTime: ✅ 233.154µs (SLO: <300.000µs 📉 -22.3%) vs baseline: -2.0% Memory: ✅ 43.706MB (SLO: <46.000MB -5.0%) vs baseline: +4.6% ✅ lstrip_aspectTime: ✅ 0.272ms (SLO: <3.000ms 📉 -90.9%) vs baseline: -2.1% Memory: ✅ 43.672MB (SLO: <46.000MB -5.1%) vs baseline: +4.5% ✅ lstrip_noaspectTime: ✅ 0.173ms (SLO: <3.000ms 📉 -94.2%) vs baseline: -3.2% Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.2% ✅ modulo_aspectTime: ✅ 14.324ms (SLO: <18.750ms 📉 -23.6%) vs baseline: -0.1% Memory: ✅ 43.729MB (SLO: <46.000MB -4.9%) vs baseline: +4.7% ✅ modulo_aspect_for_bytearray_bytearrayTime: ✅ 14.828ms (SLO: <19.350ms 📉 -23.4%) vs baseline: +0.2% Memory: ✅ 43.703MB (SLO: <46.000MB -5.0%) vs baseline: +4.5% ✅ modulo_aspect_for_bytesTime: ✅ 14.401ms (SLO: <18.900ms 📉 -23.8%) vs baseline: +0.3% Memory: ✅ 43.665MB (SLO: <46.000MB -5.1%) vs baseline: +4.7% ✅ modulo_aspect_for_bytes_bytearrayTime: ✅ 14.611ms (SLO: <19.150ms 📉 -23.7%) vs baseline: +0.2% Memory: ✅ 43.684MB (SLO: <46.000MB -5.0%) vs baseline: +4.7% ✅ modulo_noaspectTime: ✅ 0.359ms (SLO: <3.000ms 📉 -88.0%) vs baseline: -1.1% Memory: ✅ 43.686MB (SLO: <46.000MB -5.0%) vs baseline: +4.8% ✅ replace_aspectTime: ✅ 18.407ms (SLO: <24.000ms 📉 -23.3%) vs baseline: -0.3% Memory: ✅ 43.742MB (SLO: <46.000MB -4.9%) vs baseline: +4.9% ✅ replace_noaspectTime: ✅ 277.601µs (SLO: <400.000µs 📉 -30.6%) vs baseline: -1.5% Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +4.9% ✅ repr_aspectTime: ✅ 315.177µs (SLO: <420.000µs 📉 -25.0%) vs baseline: -3.3% Memory: ✅ 43.519MB (SLO: <46.000MB -5.4%) vs baseline: +4.5% ✅ repr_noaspectTime: ✅ 46.696µs (SLO: <90.000µs 📉 -48.1%) vs baseline: -0.5% Memory: ✅ 43.608MB (SLO: <46.000MB -5.2%) vs baseline: +5.0% ✅ rstrip_aspectTime: ✅ 384.864µs (SLO: <500.000µs 📉 -23.0%) vs baseline: -0.4% Memory: ✅ 43.733MB (SLO: <46.000MB -4.9%) vs baseline: +4.5% ✅ rstrip_noaspectTime: ✅ 182.755µs (SLO: <300.000µs 📉 -39.1%) vs baseline: +1.0% Memory: ✅ 43.667MB (SLO: <46.000MB -5.1%) vs baseline: +4.8% ✅ slice_aspectTime: ✅ 183.452µs (SLO: <300.000µs 📉 -38.8%) vs baseline: -0.5% Memory: ✅ 43.626MB (SLO: <46.000MB -5.2%) vs baseline: +4.8% ✅ slice_noaspectTime: ✅ 54.083µs (SLO: <90.000µs 📉 -39.9%) vs baseline: ~same Memory: ✅ 43.686MB (SLO: <46.000MB -5.0%) vs baseline: +4.9% ✅ stringio_aspectTime: ✅ 4.365ms (SLO: <5.000ms 📉 -12.7%) vs baseline: 📈 +10.6% Memory: ✅ 43.706MB (SLO: <46.000MB -5.0%) vs baseline: +4.9% ✅ stringio_noaspectTime: ✅ 343.825µs (SLO: <500.000µs 📉 -31.2%) vs baseline: -1.4% Memory: ✅ 43.844MB (SLO: <46.000MB -4.7%) vs baseline: +5.3% ✅ strip_aspectTime: ✅ 270.202µs (SLO: <350.000µs 📉 -22.8%) vs baseline: -4.2% Memory: ✅ 43.538MB (SLO: <46.000MB -5.4%) vs baseline: +4.4% ✅ strip_noaspectTime: ✅ 174.169µs (SLO: <240.000µs 📉 -27.4%) vs baseline: -1.2% Memory: ✅ 43.667MB (SLO: <46.000MB -5.1%) vs baseline: +5.0% ✅ swapcase_aspectTime: ✅ 332.867µs (SLO: <500.000µs 📉 -33.4%) vs baseline: -2.3% Memory: ✅ 43.549MB (SLO: <46.000MB -5.3%) vs baseline: +4.6% ✅ swapcase_noaspectTime: ✅ 271.652µs (SLO: <400.000µs 📉 -32.1%) vs baseline: -1.5% Memory: ✅ 43.667MB (SLO: <46.000MB -5.1%) vs baseline: +5.0% ✅ title_aspectTime: ✅ 319.883µs (SLO: <500.000µs 📉 -36.0%) vs baseline: -2.6% Memory: ✅ 43.649MB (SLO: <46.000MB -5.1%) vs baseline: +4.9% ✅ title_noaspectTime: ✅ 255.117µs (SLO: <400.000µs 📉 -36.2%) vs baseline: -3.7% Memory: ✅ 43.667MB (SLO: <46.000MB -5.1%) vs baseline: +5.0% ✅ translate_aspectTime: ✅ 490.953µs (SLO: <700.000µs 📉 -29.9%) vs baseline: -1.0% Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +4.9% ✅ translate_noaspectTime: ✅ 423.580µs (SLO: <500.000µs 📉 -15.3%) vs baseline: -2.4% Memory: ✅ 43.804MB (SLO: <46.000MB -4.8%) vs baseline: +5.1% ✅ upper_aspectTime: ✅ 292.529µs (SLO: <500.000µs 📉 -41.5%) vs baseline: -3.7% Memory: ✅ 43.548MB (SLO: <46.000MB -5.3%) vs baseline: +4.9% ✅ upper_noaspectTime: ✅ 232.135µs (SLO: <400.000µs 📉 -42.0%) vs baseline: -2.4% Memory: ✅ 43.667MB (SLO: <46.000MB -5.1%) vs baseline: +4.2% 📈 iastaspectsospath - 24/24✅ ospathbasename_aspectTime: ✅ 508.148µs (SLO: <700.000µs 📉 -27.4%) vs baseline: 📈 +18.4% Memory: ✅ 43.547MB (SLO: <46.000MB -5.3%) vs baseline: +4.9% ✅ ospathbasename_noaspectTime: ✅ 428.537µs (SLO: <700.000µs 📉 -38.8%) vs baseline: -2.9% Memory: ✅ 43.551MB (SLO: <46.000MB -5.3%) vs baseline: +4.5% ✅ ospathjoin_aspectTime: ✅ 616.615µs (SLO: <700.000µs 📉 -11.9%) vs baseline: -0.3% Memory: ✅ 43.454MB (SLO: <46.000MB -5.5%) vs baseline: +4.5% ✅ ospathjoin_noaspectTime: ✅ 627.029µs (SLO: <700.000µs 📉 -10.4%) vs baseline: -0.4% Memory: ✅ 43.726MB (SLO: <46.000MB -4.9%) vs baseline: +5.2% ✅ ospathnormcase_aspectTime: ✅ 346.922µs (SLO: <700.000µs 📉 -50.4%) vs baseline: -4.0% Memory: ✅ 43.502MB (SLO: <46.000MB -5.4%) vs baseline: +4.8% ✅ ospathnormcase_noaspectTime: ✅ 353.929µs (SLO: <700.000µs 📉 -49.4%) vs baseline: -3.2% Memory: ✅ 43.529MB (SLO: <46.000MB -5.4%) vs baseline: +4.8% ✅ ospathsplit_aspectTime: ✅ 481.534µs (SLO: <700.000µs 📉 -31.2%) vs baseline: -1.7% Memory: ✅ 43.637MB (SLO: <46.000MB -5.1%) vs baseline: +5.0% ✅ ospathsplit_noaspectTime: ✅ 495.970µs (SLO: <700.000µs 📉 -29.1%) vs baseline: -1.6% Memory: ✅ 43.627MB (SLO: <46.000MB -5.2%) vs baseline: +5.0% ✅ ospathsplitdrive_aspectTime: ✅ 373.524µs (SLO: <700.000µs 📉 -46.6%) vs baseline: -1.0% Memory: ✅ 43.698MB (SLO: <46.000MB -5.0%) vs baseline: +5.1% ✅ ospathsplitdrive_noaspectTime: ✅ 73.228µs (SLO: <700.000µs 📉 -89.5%) vs baseline: -1.5% Memory: ✅ 43.549MB (SLO: <46.000MB -5.3%) vs baseline: +4.9% ✅ ospathsplitext_aspectTime: ✅ 455.000µs (SLO: <700.000µs 📉 -35.0%) vs baseline: -2.0% Memory: ✅ 43.583MB (SLO: <46.000MB -5.3%) vs baseline: +5.0% ✅ ospathsplitext_noaspectTime: ✅ 461.256µs (SLO: <700.000µs 📉 -34.1%) vs baseline: -3.2% Memory: ✅ 43.543MB (SLO: <46.000MB -5.3%) vs baseline: +4.6% 🟡 Near SLO Breach (2 suites)🟡 djangosimple - 30/30✅ appsecTime: ✅ 19.657ms (SLO: <22.300ms 📉 -11.9%) vs baseline: -0.3% Memory: ✅ 68.681MB (SLO: <73.500MB -6.6%) vs baseline: +4.9% ✅ exception-replay-enabledTime: ✅ 1.398ms (SLO: <1.450ms -3.6%) vs baseline: +0.2% Memory: ✅ 66.793MB (SLO: <71.500MB -6.6%) vs baseline: +4.4% ✅ iastTime: ✅ 19.723ms (SLO: <22.250ms 📉 -11.4%) vs baseline: ~same Memory: ✅ 68.636MB (SLO: <75.000MB -8.5%) vs baseline: +4.8% ✅ profilerTime: ✅ 15.114ms (SLO: <16.550ms -8.7%) vs baseline: -0.3% Memory: ✅ 60.332MB (SLO: <61.000MB 🟡 -1.1%) vs baseline: +4.8% ✅ resource-renamingTime: ✅ 19.595ms (SLO: <21.750ms -9.9%) vs baseline: -0.3% Memory: ✅ 68.530MB (SLO: <73.500MB -6.8%) vs baseline: +4.7% ✅ span-code-originTime: ✅ 20.083ms (SLO: <28.200ms 📉 -28.8%) vs baseline: +1.1% Memory: ✅ 68.599MB (SLO: <75.000MB -8.5%) vs baseline: +4.6% ✅ tracerTime: ✅ 19.697ms (SLO: <21.750ms -9.4%) vs baseline: -0.3% Memory: ✅ 68.588MB (SLO: <75.000MB -8.5%) vs baseline: +4.8% ✅ tracer-and-profilerTime: ✅ 21.140ms (SLO: <23.500ms 📉 -10.0%) vs baseline: +0.2% Memory: ✅ 70.572MB (SLO: <75.000MB -5.9%) vs baseline: +4.6% ✅ tracer-dont-create-db-spansTime: ✅ 19.846ms (SLO: <21.500ms -7.7%) vs baseline: +0.4% Memory: ✅ 68.616MB (SLO: <75.000MB -8.5%) vs baseline: +4.7% ✅ tracer-minimalTime: ✅ 16.764ms (SLO: <17.500ms -4.2%) vs baseline: -0.2% Memory: ✅ 68.469MB (SLO: <75.000MB -8.7%) vs baseline: +4.4% ✅ tracer-nativeTime: ✅ 19.681ms (SLO: <21.750ms -9.5%) vs baseline: +0.7% Memory: ✅ 68.615MB (SLO: <72.500MB -5.4%) vs baseline: +4.7% ✅ tracer-no-cachesTime: ✅ 17.680ms (SLO: <19.650ms 📉 -10.0%) vs baseline: +0.3% Memory: ✅ 68.507MB (SLO: <75.000MB -8.7%) vs baseline: +4.6% ✅ tracer-no-databasesTime: ✅ 19.321ms (SLO: <20.100ms -3.9%) vs baseline: -0.2% Memory: ✅ 68.485MB (SLO: <75.000MB -8.7%) vs baseline: +4.6% ✅ tracer-no-middlewareTime: ✅ 19.440ms (SLO: <21.500ms -9.6%) vs baseline: ~same Memory: ✅ 68.557MB (SLO: <75.000MB -8.6%) vs baseline: +4.7% ✅ tracer-no-templatesTime: ✅ 19.650ms (SLO: <22.000ms 📉 -10.7%) vs baseline: +0.5% Memory: ✅ 68.665MB (SLO: <73.500MB -6.6%) vs baseline: +4.8% 🟡 recursivecomputation - 8/8✅ deepTime: ✅ 310.881ms (SLO: <320.950ms -3.1%) vs baseline: ~same Memory: ✅ 37.395MB (SLO: <38.750MB -3.5%) vs baseline: +4.8% ✅ deep-profiledTime: ✅ 328.262ms (SLO: <359.150ms -8.6%) vs baseline: ~same Memory: ✅ 43.726MB (SLO: <46.000MB -4.9%) vs baseline: +5.0% ✅ mediumTime: ✅ 7.279ms (SLO: <7.400ms 🟡 -1.6%) vs baseline: ~same Memory: ✅ 36.196MB (SLO: <38.000MB -4.7%) vs baseline: +4.5% ✅ shallowTime: ✅ 1.017ms (SLO: <1.050ms -3.2%) vs baseline: +1.7% Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +4.6%
|
Description
Testing
Risks
Additional Notes