criterion performance measurements

overview

want to understand this report?

expr 1/transform/uniplate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.561992230048169e-8 2.5665422730333265e-8 2.5722534544541423e-8
Standard deviation 1.4082561105470393e-10 1.7364760084650544e-10 2.2678696562890756e-10

Outlying measurements have no (3.4842779598022447e-3%) effect on estimated standard deviation.

expr 1/transform/generic-plate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1907425406388741e-8 1.2028509216703035e-8 1.231014704192894e-8
Standard deviation 3.409639076036942e-10 5.970458661406305e-10 9.036788879906063e-10

Outlying measurements have severe (0.736583911252521%) effect on estimated standard deviation.

expr 2/transform/uniplate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.6847579221145327e-7 2.6899373975438055e-7 2.701491473421633e-7
Standard deviation 1.394336820657928e-9 2.6967093814571213e-9 4.794734697207693e-9

Outlying measurements have slight (7.942080733964575e-2%) effect on estimated standard deviation.

expr 2/transform/generic-plate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.3630277359935993e-7 1.398123866790828e-7 1.4457268893078755e-7
Standard deviation 1.013672955429753e-8 1.3200226397701857e-8 1.8902818384686636e-8

Outlying measurements have severe (0.8951494993634008%) effect on estimated standard deviation.

expr 3/transform/uniplate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 4.842678686190948e-7 4.86489779628637e-7 4.898377081732764e-7
Standard deviation 5.452460944147439e-9 8.622457436935229e-9 1.2890362498244345e-8

Outlying measurements have moderate (0.20646816601418536%) effect on estimated standard deviation.

expr 3/transform/generic-plate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 2.679308962504798e-7 2.689348448559334e-7 2.718902985718907e-7
Standard deviation 2.385212473256103e-9 5.323040172505477e-9 1.0034331815065248e-8

Outlying measurements have moderate (0.2529638055229618%) effect on estimated standard deviation.

expr 4/transform/uniplate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 3.9694639323182734e-8 3.9775500575549846e-8 3.9944220461657706e-8
Standard deviation 1.6843289928692394e-10 3.667498350663359e-10 6.042801479054758e-10

Outlying measurements have slight (7.845815726492142e-2%) effect on estimated standard deviation.

expr 4/transform/generic-plate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.1699827846051593e-8 1.1773760663556035e-8 1.201629807776017e-8
Standard deviation 1.5715555728678397e-10 3.959374882005829e-10 8.408428339635541e-10

Outlying measurements have severe (0.5578346448520891%) effect on estimated standard deviation.

expr 5/transform/uniplate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.933315313804197e-7 1.9358076934030862e-7 1.941393488502433e-7
Standard deviation 5.647907720950727e-10 1.201128710329642e-9 2.5945544663931523e-9

Outlying measurements have no (4.064972927946774e-3%) effect on estimated standard deviation.

expr 5/transform/generic-plate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.4365958772861916e-7 1.439314058420556e-7 1.4415514745297632e-7
Standard deviation 6.942814820506703e-10 8.192437529037465e-10 9.640950184089906e-10

Outlying measurements have no (3.968190981095331e-3%) effect on estimated standard deviation.

expr 6/transform/uniplate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.9403881381445965e-7 1.9501828435477838e-7 1.97431645718049e-7
Standard deviation 1.685311027585426e-9 5.138199788582335e-9 1.0136761027093642e-8

Outlying measurements have moderate (0.3853004982796174%) effect on estimated standard deviation.

expr 6/transform/generic-plate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.4263078733006478e-7 1.427512576554114e-7 1.4293004341267254e-7
Standard deviation 3.545144727175951e-10 4.94399243538638e-10 7.697581428180947e-10

Outlying measurements have no (3.968190981095459e-3%) effect on estimated standard deviation.

expr 7/transform/uniplate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.9462354216602636e-7 1.9508777157879031e-7 1.958236178117382e-7
Standard deviation 1.270697284126907e-9 1.9146891488260622e-9 3.3308160946365165e-9

Outlying measurements have slight (8.084994590087932e-2%) effect on estimated standard deviation.

expr 7/transform/generic-plate

lower bound estimate upper bound
OLS regression xxx xxx xxx
R² goodness-of-fit xxx xxx xxx
Mean execution time 1.4279017460738183e-7 1.4298996539574474e-7 1.433077954760937e-7
Standard deviation 5.415348414390088e-10 7.670290908339516e-10 1.194043572102347e-9

Outlying measurements have no (3.968190981095597e-3%) effect on estimated standard deviation.

understanding this report

In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.

Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.

We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)

A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.