criterion performance measurements
overview
want to understand this report?
0% Lookups; 50% Insertions; 50% Deletions/IORef atomicModifyIORef HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.982828142503422 | 5.0480120648753655 | 5.090075660624279 |
| Standard deviation | 3.78865382517688e-2 | 6.889867328755783e-2 | 9.714171331487624e-2 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
0% Lookups; 50% Insertions; 50% Deletions/IORef atomic-primops IntMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.8667245188735251 | 0.9483233361885747 | 1.0469118696310034 |
| Standard deviation | 4.3072734125113754e-2 | 9.951613005683889e-2 | 0.13870828728586082 |
Outlying measurements have moderate (0.22782998589103373%) effect on estimated standard deviation.
0% Lookups; 50% Insertions; 50% Deletions/IORef atomic-primops HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.8493595294366969 | 0.9316123692715337 | 1.0355411585842376 |
| Standard deviation | 1.712410895957092e-2 | 0.12024545895857745 | 0.15926174016664257 |
Outlying measurements have moderate (0.23534542676243753%) effect on estimated standard deviation.
0% Lookups; 50% Insertions; 50% Deletions/TVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.958575899936477 | 1.9796928425657825 | 1.9903030472523824 |
| Standard deviation | 1.6073032290365927e-2 | 2.184896737284175e-2 | 2.4503218127861923e-2 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
0% Lookups; 50% Insertions; 50% Deletions/MVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 7.31474126116033 | 7.41217938339408 | 7.489282900938633 |
| Standard deviation | 6.887863895948021e-2 | 0.11807611791071763 | 0.1454895029146058 |
Outlying measurements have moderate (0.18749999999999994%) effect on estimated standard deviation.
0% Lookups; 50% Insertions; 50% Deletions/StmContainers.Map
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.2930620854895096 | 0.3304502683501293 | 0.37657599605699943 |
| Standard deviation | 1.6878930782265766e-2 | 5.168207269816878e-2 | 6.94653789740931e-2 |
Outlying measurements have moderate (0.46007614993738916%) effect on estimated standard deviation.
0% Lookups; 50% Insertions; 50% Deletions/Concurrent HashTable
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.28921963970147774 | 0.3028105912282869 | 0.3275966727978084 |
| Standard deviation | 5.8499541109907315e-3 | 2.3810709582619913e-2 | 3.162601541952682e-2 |
Outlying measurements have moderate (0.17978343067803323%) effect on estimated standard deviation.
20% Lookups; 40% Insertions; 40% Deletions/IORef atomicModifyIORef HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.636289448626485 | 4.674335961813995 | 4.734713561498211 |
| Standard deviation | 6.892076838789382e-3 | 5.7302760668296114e-2 | 7.31640852808058e-2 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
20% Lookups; 40% Insertions; 40% Deletions/IORef atomic-primops IntMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.723058219309678 | 0.8034233160172638 | 0.8887509688684077 |
| Standard deviation | 4.433801058379078e-2 | 9.63082398313979e-2 | 0.1343981161785317 |
Outlying measurements have moderate (0.23300966182290586%) effect on estimated standard deviation.
20% Lookups; 40% Insertions; 40% Deletions/IORef atomic-primops HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.6678429497478646 | 0.7733144184136714 | 0.8536211009959516 |
| Standard deviation | 5.644608868471823e-2 | 0.12184701098431713 | 0.1695325905278366 |
Outlying measurements have moderate (0.46066469711426616%) effect on estimated standard deviation.
20% Lookups; 40% Insertions; 40% Deletions/TVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 1.816650506501901 | 1.8737808111667011 | 1.9518210624131218 |
| Standard deviation | 3.2897254275009294e-2 | 8.797098094819322e-2 | 0.11502009388080943 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
20% Lookups; 40% Insertions; 40% Deletions/MVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.531894989415983 | 6.715284176579492 | 6.898673363743001 |
| Standard deviation | 0.11417452674504602 | 0.23082999522454253 | 0.2916817987995723 |
Outlying measurements have moderate (0.18749999999999997%) effect on estimated standard deviation.
20% Lookups; 40% Insertions; 40% Deletions/StmContainers.Map
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.2667258995515295 | 0.3034225309905984 | 0.34237933045524793 |
| Standard deviation | 2.8492150875118888e-2 | 5.2548482339212416e-2 | 7.104734518577067e-2 |
Outlying measurements have moderate (0.38332962756873157%) effect on estimated standard deviation.
20% Lookups; 40% Insertions; 40% Deletions/Concurrent HashTable
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.26401161813817453 | 0.2781650112691568 | 0.2938371827331139 |
| Standard deviation | 1.1574408316875747e-2 | 1.8561070634680658e-2 | 2.7804489139634302e-2 |
Outlying measurements have moderate (0.17192569785655157%) effect on estimated standard deviation.
40% Lookups; 30% Insertions; 30% Deletions/IORef atomicModifyIORef HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.45071239900426 | 4.499559892249333 | 4.5830181102452725 |
| Standard deviation | 7.854292692143328e-3 | 8.004178783213342e-2 | 0.10029639559815626 |
Outlying measurements have moderate (0.18749999999999997%) effect on estimated standard deviation.
40% Lookups; 30% Insertions; 30% Deletions/IORef atomic-primops IntMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.45838026508135954 | 0.532653651704095 | 0.5710009601643833 |
| Standard deviation | 1.1577234752621735e-2 | 7.236268593092876e-2 | 9.244763912142052e-2 |
Outlying measurements have moderate (0.23677180730645328%) effect on estimated standard deviation.
40% Lookups; 30% Insertions; 30% Deletions/IORef atomic-primops HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.4567603077448439 | 0.5239384390006308 | 0.5631734695052728 |
| Standard deviation | 1.0232226398274015e-2 | 6.378739716240327e-2 | 8.268673752750613e-2 |
Outlying measurements have moderate (0.23352858864386206%) effect on estimated standard deviation.
40% Lookups; 30% Insertions; 30% Deletions/TVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.295005373371775 | 2.375994692559592 | 2.5071613361214986 |
| Standard deviation | 5.010704487233494e-3 | 0.124387634808761 | 0.15396354618195002 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
40% Lookups; 30% Insertions; 30% Deletions/MVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.589782472874504 | 6.716856247664812 | 6.838155352582058 |
| Standard deviation | 1.3336028822775486e-2 | 0.15613835342390436 | 0.19506587510134887 |
Outlying measurements have moderate (0.18749999999999994%) effect on estimated standard deviation.
40% Lookups; 30% Insertions; 30% Deletions/StmContainers.Map
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.24242531186707006 | 0.2793366326165657 | 0.31453799559909384 |
| Standard deviation | 3.699056170545507e-2 | 4.6704050541635525e-2 | 5.842801462651256e-2 |
Outlying measurements have moderate (0.3821138571082376%) effect on estimated standard deviation.
40% Lookups; 30% Insertions; 30% Deletions/Concurrent HashTable
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.2492619291972369 | 0.2564428271156309 | 0.26659323438410254 |
| Standard deviation | 7.346776467285052e-3 | 9.574620203425786e-3 | 1.0954544998625373e-2 |
Outlying measurements have moderate (0.16000000000000003%) effect on estimated standard deviation.
50% Lookups; 25% Insertions; 25% Deletions/IORef atomicModifyIORef HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.2964073987459415 | 4.414454665996648 | 4.609026630620065 |
| Standard deviation | 7.926758764369879e-3 | 0.18503560981095332 | 0.2292488686105774 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
50% Lookups; 25% Insertions; 25% Deletions/IORef atomic-primops IntMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.3745735919364961 | 0.45221020967437653 | 0.5000589554183534 |
| Standard deviation | 2.133183166733943e-2 | 8.208958481324463e-2 | 0.1105019449426841 |
Outlying measurements have moderate (0.4703650190967862%) effect on estimated standard deviation.
50% Lookups; 25% Insertions; 25% Deletions/IORef atomic-primops HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.3656447989924345 | 0.45483886726894224 | 0.4862111157696442 |
| Standard deviation | 5.605619791216071e-3 | 5.98189185151122e-2 | 7.245110446785646e-2 |
Outlying measurements have moderate (0.23588509119434203%) effect on estimated standard deviation.
50% Lookups; 25% Insertions; 25% Deletions/TVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.340480740997009 | 2.423883981728674 | 2.4546940189817783 |
| Standard deviation | 3.5943003144602442e-3 | 5.7072779847506486e-2 | 7.115273320728886e-2 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
50% Lookups; 25% Insertions; 25% Deletions/MVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.638644079510414 | 6.706835595274849 | 6.764629105251515 |
| Standard deviation | 3.744945536891464e-2 | 8.157206842058952e-2 | 0.11423865365568525 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
50% Lookups; 25% Insertions; 25% Deletions/StmContainers.Map
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.23499698879313655 | 0.2684387038825662 | 0.29971467935392865 |
| Standard deviation | 3.0226281442882662e-2 | 4.539132122949309e-2 | 5.885084398522301e-2 |
Outlying measurements have moderate (0.38251302768633405%) effect on estimated standard deviation.
50% Lookups; 25% Insertions; 25% Deletions/Concurrent HashTable
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.2286862149240915 | 0.23677314683668857 | 0.24411027673146846 |
| Standard deviation | 8.978451330034267e-3 | 1.122818310686544e-2 | 1.361747702957983e-2 |
Outlying measurements have moderate (0.16%) effect on estimated standard deviation.
60% Lookups; 20% Insertions; 20% Deletions/IORef atomicModifyIORef HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 4.072200641563541 | 4.143562566771531 | 4.21392880716788 |
| Standard deviation | 3.511940617075515e-2 | 8.617870509507747e-2 | 0.10267785206391174 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
60% Lookups; 20% Insertions; 20% Deletions/IORef atomic-primops IntMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.28484966498217545 | 0.3636294496239619 | 0.39764846962922695 |
| Standard deviation | 2.2008282502307935e-2 | 5.695838489958824e-2 | 7.856356143042825e-2 |
Outlying measurements have moderate (0.46019819125375877%) effect on estimated standard deviation.
60% Lookups; 20% Insertions; 20% Deletions/IORef atomic-primops HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.29678539710948826 | 0.35375802476725465 | 0.38622416285700945 |
| Standard deviation | 1.5919297043486352e-2 | 5.538190694122511e-2 | 7.497733426266993e-2 |
Outlying measurements have moderate (0.4601547245969135%) effect on estimated standard deviation.
60% Lookups; 20% Insertions; 20% Deletions/TVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.380862491991138 | 2.4513402435004537 | 2.482445785877644 |
| Standard deviation | 1.960533524834318e-2 | 5.1953297990855435e-2 | 7.183517305904083e-2 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
60% Lookups; 20% Insertions; 20% Deletions/MVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.626405463503033 | 6.712345301795722 | 6.82417748775697 |
| Standard deviation | 3.539787050249288e-2 | 0.12227578564487053 | 0.1658696219638189 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
60% Lookups; 20% Insertions; 20% Deletions/StmContainers.Map
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.22777798779425212 | 0.2630416167285875 | 0.2782968875818187 |
| Standard deviation | 9.676190541818376e-3 | 2.7408417691459595e-2 | 4.0620445418244014e-2 |
Outlying measurements have moderate (0.18848693344878448%) effect on estimated standard deviation.
60% Lookups; 20% Insertions; 20% Deletions/Concurrent HashTable
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.21731047687191876 | 0.22726361574394913 | 0.2343434923621114 |
| Standard deviation | 7.783142068002005e-3 | 1.1412308423266656e-2 | 1.5399570837206795e-2 |
Outlying measurements have moderate (0.13888888888888865%) effect on estimated standard deviation.
70% Lookups; 15% Insertions; 15% Deletions/IORef atomicModifyIORef HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 3.429828891190482 | 3.4923924140633367 | 3.532205061996744 |
| Standard deviation | 2.2609086191991735e-2 | 6.1231153273520564e-2 | 8.35466766401837e-2 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
70% Lookups; 15% Insertions; 15% Deletions/IORef atomic-primops IntMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.25129843159840676 | 0.2847076321353476 | 0.30774500137243493 |
| Standard deviation | 1.877027357486218e-2 | 3.5191490949708366e-2 | 5.130855314166528e-2 |
Outlying measurements have moderate (0.36727400276312877%) effect on estimated standard deviation.
70% Lookups; 15% Insertions; 15% Deletions/IORef atomic-primops HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.2767287498138224 | 0.3045782794469657 | 0.35473072300083003 |
| Standard deviation | 2.1230141977475678e-3 | 5.3297604323768975e-2 | 7.490731400189742e-2 |
Outlying measurements have moderate (0.3836712670752421%) effect on estimated standard deviation.
70% Lookups; 15% Insertions; 15% Deletions/TVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 2.112849258377537 | 2.136951808103428 | 2.1565114731007875 |
| Standard deviation | 1.9780707521585405e-2 | 2.6027316477958043e-2 | 3.073279312961794e-2 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
70% Lookups; 15% Insertions; 15% Deletions/MVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.712791474994447 | 6.759349431103449 | 6.845304868946187 |
| Standard deviation | 5.640011655799332e-4 | 8.371792961840545e-2 | 9.953479093642288e-2 |
Outlying measurements have moderate (0.18749999999999997%) effect on estimated standard deviation.
70% Lookups; 15% Insertions; 15% Deletions/StmContainers.Map
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.2033832209863855 | 0.2328806993648565 | 0.2461946968183232 |
| Standard deviation | 5.429306638199814e-3 | 2.3473187836986882e-2 | 3.1197179763563395e-2 |
Outlying measurements have moderate (0.18769638145126383%) effect on estimated standard deviation.
70% Lookups; 15% Insertions; 15% Deletions/Concurrent HashTable
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.1980055116408039 | 0.20665059858333232 | 0.21961264975147465 |
| Standard deviation | 5.392424788269165e-3 | 1.466857274145146e-2 | 2.2390978109520218e-2 |
Outlying measurements have moderate (0.15230966032075838%) effect on estimated standard deviation.
80% Lookups; 10% Insertions; 10% Deletions/IORef atomicModifyIORef HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.6504946694985847 | 0.697354914790291 | 0.7468867608731671 |
| Standard deviation | 4.32176516811464e-2 | 5.539652650791324e-2 | 6.500144925268776e-2 |
Outlying measurements have moderate (0.2113114266294888%) effect on estimated standard deviation.
80% Lookups; 10% Insertions; 10% Deletions/IORef atomic-primops IntMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.20185566764913446 | 0.21340171949511086 | 0.24371547742501007 |
| Standard deviation | 1.0094871946785162e-3 | 2.450870942585107e-2 | 3.592061080149747e-2 |
Outlying measurements have moderate (0.31139613259315024%) effect on estimated standard deviation.
80% Lookups; 10% Insertions; 10% Deletions/IORef atomic-primops HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.20232346994113568 | 0.21449541969098695 | 0.23605240836493777 |
| Standard deviation | 8.707440439919573e-3 | 2.472042281992316e-2 | 3.51080589582684e-2 |
Outlying measurements have moderate (0.31154868656755785%) effect on estimated standard deviation.
80% Lookups; 10% Insertions; 10% Deletions/TVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.44833339274919126 | 0.47045171281327686 | 0.5055614976299694 |
| Standard deviation | 3.8458039013754795e-3 | 3.3463572894836965e-2 | 4.2464189380902254e-2 |
Outlying measurements have moderate (0.2017468640777404%) effect on estimated standard deviation.
80% Lookups; 10% Insertions; 10% Deletions/MVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.675215673957913 | 6.701199280351527 | 6.72718288674514 |
| Standard deviation | 1.4482167915654376e-2 | 3.2952420269985884e-2 | 4.328400149437613e-2 |
Outlying measurements have moderate (0.1875%) effect on estimated standard deviation.
80% Lookups; 10% Insertions; 10% Deletions/StmContainers.Map
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.20759219694138867 | 0.22561458577806157 | 0.24173968222296227 |
| Standard deviation | 1.2340622474287544e-2 | 2.4654362895402054e-2 | 3.526901761604111e-2 |
Outlying measurements have moderate (0.30910223814335674%) effect on estimated standard deviation.
80% Lookups; 10% Insertions; 10% Deletions/Concurrent HashTable
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.18114169276822292 | 0.19693542271521033 | 0.2116132291581986 |
| Standard deviation | 1.2761209392742867e-2 | 2.180651967437986e-2 | 3.3565777780527384e-2 |
Outlying measurements have moderate (0.3097339187325418%) effect on estimated standard deviation.
90% Lookups; 5% Insertions; 5% Deletions/IORef atomicModifyIORef HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.12015813971880736 | 0.13445650805157117 | 0.1416572472796602 |
| Standard deviation | 5.202872636976582e-3 | 1.3845242347781145e-2 | 2.0580405875087544e-2 |
Outlying measurements have moderate (0.26852932952388425%) effect on estimated standard deviation.
90% Lookups; 5% Insertions; 5% Deletions/IORef atomic-primops IntMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.12758347804402936 | 0.13293224753728974 | 0.1387496121505267 |
| Standard deviation | 6.441885270032377e-3 | 9.490744072138135e-3 | 1.434533638457321e-2 |
Outlying measurements have moderate (0.2260519461040994%) effect on estimated standard deviation.
90% Lookups; 5% Insertions; 5% Deletions/IORef atomic-primops HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.12109041374704768 | 0.1305071710846148 | 0.13601509710952087 |
| Standard deviation | 4.907280532352642e-3 | 1.081222720931754e-2 | 1.6588874739373545e-2 |
Outlying measurements have moderate (0.232215220657108%) effect on estimated standard deviation.
90% Lookups; 5% Insertions; 5% Deletions/TVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.16969066913863773 | 0.17734647202604617 | 0.18112727116159577 |
| Standard deviation | 3.374280459980038e-3 | 8.114970218443667e-3 | 1.1943783665487083e-2 |
Outlying measurements have moderate (0.13888888888888887%) effect on estimated standard deviation.
90% Lookups; 5% Insertions; 5% Deletions/MVar HashMap
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 6.248173489002511 | 6.356144525881973 | 6.530134497508698 |
| Standard deviation | 2.3089268129693696e-2 | 0.177015544871619 | 0.2262591606984683 |
Outlying measurements have moderate (0.18749999999999997%) effect on estimated standard deviation.
90% Lookups; 5% Insertions; 5% Deletions/StmContainers.Map
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.18293459965110137 | 0.2028008727500694 | 0.2172742727327406 |
| Standard deviation | 1.6328203624645578e-2 | 2.33901471353992e-2 | 3.1088886971449913e-2 |
Outlying measurements have moderate (0.3115812930933589%) effect on estimated standard deviation.
90% Lookups; 5% Insertions; 5% Deletions/Concurrent HashTable
| lower bound | estimate | upper bound | |
|---|---|---|---|
| OLS regression | xxx | xxx | xxx |
| R² goodness-of-fit | xxx | xxx | xxx |
| Mean execution time | 0.17182024324590908 | 0.1826716791212675 | 0.2108832625510533 |
| Standard deviation | 4.804595439088916e-3 | 2.242132507712729e-2 | 3.284978935618639e-2 |
Outlying measurements have moderate (0.3141269250319755%) effect on estimated standard deviation.
understanding this report
In this report, each function benchmarked by criterion is assigned a section of its own. The charts in each section are active; if you hover your mouse over data points and annotations, you will see more details.
- The chart on the left is a kernel density estimate (also known as a KDE) of time measurements. This graphs the probability of any given time measurement occurring. A spike indicates that a measurement of a particular time occurred; its height indicates how often that measurement was repeated.
- The chart on the right is the raw data from which the kernel density estimate is built. The x axis indicates the number of loop iterations, while the y axis shows measured execution time for the given number of loop iterations. The line behind the values is the linear regression prediction of execution time for a given number of iterations. Ideally, all measurements will be on (or very near) this line.
Under the charts is a small table. The first two rows are the results of a linear regression run on the measurements displayed in the right-hand chart.
- OLS regression indicates the time estimated for a single loop iteration using an ordinary least-squares regression model. This number is more accurate than the mean estimate below it, as it more effectively eliminates measurement overhead and other constant factors.
- R² goodness-of-fit is a measure of how accurately the linear regression model fits the observed measurements. If the measurements are not too noisy, R² should lie between 0.99 and 1, indicating an excellent fit. If the number is below 0.99, something is confounding the accuracy of the linear model.
- Mean execution time and standard deviation are statistics calculated from execution time divided by number of iterations.
We use a statistical technique called the bootstrap to provide confidence intervals on our estimates. The bootstrap-derived upper and lower bounds on estimates let you see how accurate we believe those estimates to be. (Hover the mouse over the table headers to see the confidence levels.)
A noisy benchmarking environment can cause some or many measurements to fall far from the mean. These outlying measurements can have a significant inflationary effect on the estimate of the standard deviation. We calculate and display an estimate of the extent to which the standard deviation has been inflated by outliers.