Escireadme, Foresciandunderstanding Thenewstatistics

ESCIReadme, forESCIandUnderstanding TheNewStatistics

Geoff Cumming

StatisticalCognitionLaboratory,Schoolof PsychologicalScience,LaTrobeUniversity, Melbourne,Australia3086

TheBook

Cumming,G. (2012).UnderstandingTheNewStatistics:EffectSizes,ConfidenceIntervals,and Meta-Analysis.New York:Routledge.

Formoreinformationaboutthebook, seeThe New Statistics Website.

TheSoftware

ObtainESCI(“ESS-key”, ExploratorySoftware for ConfidenceIntervals)—the softwarethataccompaniesthebook—andthelatestnewsfromThe New Statistics website.

DownloadthezippedESCIfolderthatcorrespondstoyour versionofExcel,then unzipit.Double-clickingorrightclickingthezippedfoldershouldallowunzipping.Saveall thefilesinasinglefolder,thenopenandrunyourchoiceof thesix ESCImodules.Eachis

anExcelworkbook, andshouldopenandrun inExcelimmediately.

Filenames

Iincludethedatein filenames,soyoucan easilyseewhetheramorerecentversion hasbecomeavailable.

ThisESCI ReadmeDocument

ThisReadmeprovidesthelatestinformationabout:

ESCI:BUGFIXES2

ESCIFOR DIFFERENTVERSIONSOF EXCEL2

ESCIforWindows:Excel20102

ESCIforWindows:Excel20073

ESCIforWindows:Excel20034

ESCIforMacintosh:Excel20115

ESCI:GENERALHINTS7

ESCI:TROUBLESHOOTING8

KNOWN ESCIERRORSOR PROBLEMS9

KNOWN ERRORSINTHEBOOK9

ESCI: Bug Fixes

24 July 2012

At theOriginaltwo groups anddtwo groupspagesof ESCIMeta-Analysis,when ShowNHST nearred8 isselected,thep valuesshown wereslightlywrong. Nowcorrected. (Firstbugreportedafter12 monthsof openavailabilityofESCI!)

ESCIforDifferent VersionsofExcel

Excel2010ESCIforWindows:Excel 2010

TheESCImodulesare.xlsmmacro-enabledworkbooks thatrun underExcel2010(or Excel2007).

32-bitor 64-bitExcel?

You areprobablyrunning32-bitExcel;ifyouare running64-bitExcel(partof64-bit Office2010)you arelikelytoknow andbesure aboutthis. Ifyou areusing32-bitExcel, simplydeletetheESCImodulethathas 64 bitinitsfilename.Ifyou areusing64-bitExcel, you needtousethatversionofESCIchapters5-6, whichincludes64 bit initsfilename, andyou shoulddeletethe versionofthatmodulethatdoesnotinclude64 bit initsfilename. (Notethatthecriticalthingiswhetheryou havethe32-bitor 64-bitversionof Excel,not whetheryou arerunningWindows7 thatis32-bitor64-bit.)

Enablemacros

You needtoenablemacros.Therearethreepossibilities:

1. Whenamoduleisopened,theremaybeabarnearthetopof thescreensaying somethinglikeSecuritywarning“Macros havebeen disabled”. You canenable macrosforthismodulebyclickingtheEnablecontentbutton,thenclickingYes.
2. Go toFile/Options/TrustCenter/TrustCenterSettings/MacroSettingsand clicktoEnableall macros.Thisisanon-preferredoption,becauseit enablesmacrosinallExcelworkbooks, whatevertheirsource.
3. Thepreferredoptionisto go to Officebutton/Exceloptions/TrustCenter/Trust CenterSettings/TrustedLocations.ClicktoAdd newlocation.Browsetofindthe folderwhereunzippedESCIislocated.ClickOKasmanytimesasneeded.Macros shouldthenbeenabledfor anyESCImoduleopenedfromthatfolder.

Seepopoutcomments

Popoutcommentsshouldbevisiblewheneveryouhoverthemousenearanylittlered triangleinESCI.Ifyoucan’tseethem,go toFile/Options/Advanced,scrolldown toDisplay,thenclickIndicatorsonly,andcommentson hover.

MakingtheESCIdisplayfit thescreen

ESCIisdesignedso thedisplayconvenientlyfitsthescreenforscreenresolutionof about1280 ×800 or1024 ×768. At higherscreenresolutions,theintendedESCIdisplay mayappeartoosmall,andsomeof thedataand calculationsmaybevisiblelow on the screen,or totheright.Itmaybeworthchangingthezoomfactor,whichchangesjustthe displayof thatpageon theoneoccasion.You couldsetzoomfor eachpagethensavethe

modulewithanewname,so displaywillinfutureuse thesavedzoomfactors.Alternatively, you couldconsiderthefollowingtwo options.

Screenresolution TochangethescreenresolutioninWindows7,rightclickon the desktop,chooseScreenresolution,choosefromthedropdown listthenclickOK.

Fullscreen You canregaindisplayareabyrightclickingon theribbon(thebroad bandofExcelcontrolsnearthetopof theExcelwindow)and choosingMinimizethe Ribbon. For fullscreen display,useView/FullScreen.UsetheEsckeytoexitfullscreen mode.

Protection

Ifyou wish to seeorchangeESCI’sformulas oradd anyfurthercalculationsyou need toremoveprotection.TounprotectanESCIpage,use Review/Changes/UnprotectSheet. No password is required. It’susuallybetter to leaveprotection on, to reducethe chanceof inadvertentchangesthat cancause confusion.

Excel2007ESCIforWindows:Excel 2007

TheESCImodulesare.xlsmmacro-enabledworkbooks thatrun underExcel2007 (or

Excel2010).

32-bitExcel

Ifyou arerunningExcel2007,you arerunninga 32-bitversionofExcel.You thereforedo notneedtheversionof ESCIchapters5-6 thatisprovidedfor usewiththe64- bitversionofExcel2010. You shouldsimplydeletetheESCImodulethathas64 bitinits filename.

Enablemacros

You needtoenablemacros.Therearethreepossibilities:

1. Whenamoduleisopened,theremaybeabarnearthetopof thescreensaying somethinglikeSecuritywarning“Macros havebeen disabled”. You canenable macrosbyclickingtheOptionsbuttonthentheEnablethiscontentbuttonandOK. Thisenablesmacrosonlyforthismoduleon thisoccasion.
2. Go toOfficebutton/Exceloptions/TrustCenter/TrustCenterSettings/Macro Settingsand clicktoEnableall macros.Thisisanon-preferredoptionbecauseit enablesmacrosinallExcelworkbooks, whatevertheirsource.
3. Thepreferredoptionisto go to Officebutton/Exceloptions/TrustCenter/TrustCenterSettings/TrustedLocations.ClicktoAdd newlocation.BrowsetofindthefolderwhereunzippedESCIislocated.ClickOKasmanytimesasneeded.Macros shouldthenbeenabledfor anyESCImoduleopenedfromthatfolder.

Seepopoutcomments

Popoutcommentsshouldbevisiblewheneveryouhoverthemousenearanylittlered triangleinESCI.Ifyoucan’tseethem,go toOfficebutton/Exceloptions/Advancedthen scrolldown toDisplaythenclickIndicatorsonly,andcommentson hover.

MakingtheESCIdisplayfit thescreen

ESCIisdesignedso thedisplayconvenientlyfitsthescreenforscreenresolutionof about1280 ×800 or1024 ×768. At higherscreenresolutions,theintendedESCIdisplay mayappeartoosmall,andsomeofthedataand calculationsmaybevisiblelow on the screen,or totheright. Itmaybeworthchangingthezoomfactor,whichchangesjustthe displayof thatpageon theoneoccasion.You couldsetzoomfor eachpagethensavethe

modulewithanewname,so displaywillinfutureuse thesavedzoomfactors.Alternatively, you couldconsiderthefollowingtwo options.

Screenresolution TochangethescreenresolutioninWindows7,rightclickon the desktop,chooseScreenresolution,choosefromthedropdown listthenclickOK.

Fullscreen You canregaindisplayareabyrightclickingon theribbon(thebroad bandofExcelcontrolsnearthetopof theExcelwindow)and choosingMinimizethe Ribbon. For fullscreen display,useView/FullScreen.UsetheEsckeytoexitfullscreen mode.

Protection

Ifyou wish to seeorchangeESCI’sformulas oradd anyfurthercalculationsyou need toremoveprotection.TounprotectanESCIpage,use Review/Changes/UnprotectSheet. No passwordisrequired.It’susuallybetter to leaveprotection on, to reducethe chanceof inadvertentchangesthat cancause confusion.

Excel2003ESCIforWindows:Excel 2003

TheESCImodulesare.xlsworkbooks thatrun underExcel2003.

Thisversionof Excelruns muchfasterthananylaterversionandallowsforsmoother interactivitywhenyou clickanddragthethumbnailof aslider,or click andholda spinner. Laterversionsof Excelusuallyonlyupdatethedisplayon releaseof themouse.Ifyou still haveExcel2003, preserveit carefully.

Enablemacros

You needtoenablemacros.Go toTools/Macro/Securityand click Medium.Exit

Excel—don’tSave. Restart Excel and click in theinitial dialogueboxto enable macros.

Seepopoutcomments

Popoutcommentsshouldbevisiblewheneveryouhoverthemousenearanylittlered triangle. Ifyou can’tseethem, go toTools/Options/Viewand clickCommentindicator only.

MakingtheESCIdisplayfit thescreen

ESCIisdesignedso thedisplayconvenientlyfitsthescreenforscreenresolutionof about1280 ×800 or1024 ×768. At higherscreenresolutions,theintendedESCIdisplay mayappeartoosmall,andsomeof thedataand calculationsmaybevisiblelow on the screen,or totheright. Itmaybeworth changingthezoomfactor,whichchangesjustthe displayof thatpageon theoneoccasion.You couldsetzoomfor eachpagethensavethe

modulewithanewname,so displaywillinfutureuse thesavedzoomfactors.Alternatively, you couldconsiderthefollowingtwo options.

Screenresolution TochangethescreenresolutioninWindowsXP, rightclickon the desktopandselect PropertiestoseetheDisplaypropertiesdialoguebox. Go tothe

Settingstab,adjustthescreenresolution,clickOKthenwaitafewmoments.

Fullscreen For fullscreendisplay,go toViewthenclick FullScreen.Use

View/FullScreenagaintoreturnfromfullscreen mode.

Protection

Ifyou wish to seeorchangeESCI’sformulas oradd anyfurthercalculationsyou need toremoveprotection.TounprotectanESCIpage,use Tools/Protection/UnprotectSheet. No password is required. It’susuallybetter to leaveprotection on, to reducethe chanceof inadvertentchangesthat cancause confusion.

Excel2011ESCIfor Macintosh:Excel2011

TheESCImodulesare.xlsmmacro-enabledworkbooks. Ihaveadaptedthemfrom theversionsthatrun undereitherExcel2007 or Excel2010. Excelcompatibilitybetween WindowsandMacintoshisfarfromperfect,butmyadaptationsovercomemostof the incompatibilities.Unfortunately,theMacversiondoesnothavesound, sono sound filesare needed.(Pleaseletmeknow if youcanmakesound work.) Inaddition,slidersandother controlstendtodisappearhaphazardly—seeKnownESCIErrorsorProblemsbelow.

ESCIwillnotrun inearlierversionofExcelfortheMacbecausetheseweremuch less compatiblewithExcelforWindows,and atleastoneversiondidnotsupport VBA macros,whichareusedextensivelybyESCI.

Enablemacros

You needtoenablemacros.Bydefault,whenyou openamodule(oranyotherExcel

.xlsmworkbook) adialogueboxasksyou whetheryouwish todisablemacros.To enable macrosforthismoduleon thisoccasion,clicktheEnableMacrosbutton.Ifyou wish notto beaskedon everyoccasion,go toExcel/Preferences/Security(intheSharingandPrivacy area)andclickto clearthecheckboxlabeledMacrosecurity.However,thismayberisky becauseitmeansthatallExcel.xlsmworkbooks,whatevertheirsource,will beopenedwith macrosenabled.

Seepopoutcomments

Popoutcommentsshouldbevisiblewheneveryouhoverthemousenearanylittlered triangleinESCI.Ifyoucan’tseethem,go toExcel/Preferences/View(intheAuthoring area)then,intheForcomments,showarea,clickIndicatorsonly,andcommentson hover.

MakingtheESCIdisplayfit thescreen

IhaveadjustedtheMacversionofESCIso thedisplayconvenientlyfitsthescreen forscreenresolutionof about1280 ×800. Todo this,Isetthezoomfactorataround115 to 125%, asisbestforeachpage.At higherscreenresolutions,theintendedESCIdisplaymay appeartoosmall,andsomeofthedataand calculationsmaybevisiblelowon thescreen,or totheright.Itmaybeworthchangingthezoomfactor,whichchangesjust thedisplayof that pageon theoneoccasion.You couldsetzoomfor eachpagethensavethemodulewitha newname,so displaywillinfutureuse thesavedzoomfactors.Alternatively, you could considerthefollowingtwooptions.

Screenresolution Tochangethescreenresolution,go totheApplemenuinthetop left,openSystemPreferencesthenDisplays(intheHardwarearea),andselectaresolution.

Fullscreen You canregaindisplayareabyminimizingtheribbon—thebroadbandofExcelcontrolsnearthetopof theExcelwindow. Todo this,clickon thelabelof thecurrentlyactivetab,oron thesmallup arrowhead attherighthand endoftheribbon.Forfullscreen display,useView/FullScreen.Toreturnfromfullscreenmode,eitheruse View/FullScreenagain,or presstheEsckey.

Protection

Ifyou wish to seeorchangeESCI’sformulas oradd anyfurthercalculationsyou need toremoveprotection.TounprotectanESCIpage, go toReview/Protectionand clickon Sheet,or useTools/Protection/UnprotectSheet.No password is required. It’susually better toleaveprotectionon, toreducethe chanceofinadvertentchangesthatcancause confusion.A darkgreybackgroundaroundtheSheeticonindicatesthatthecurrentpageis protected.

Chart ScreenTips

You mayseelittleyellow rectangular “chart screen tips”whenyou hover themouse overanESCIfigure.Thesearelabelsfor componentsof thefigure, for examplePlotArea. Tohidethese,go toExcel/Preferences/Chart(intheAuthoringarea),thenintheChart ScreenTipsareaclearthetwo checkboxes.Evenafterdoingthisyou maystillseesmall emptyrectangles near themouseposition, over an ESCIfigure. Idon’tknow anywayto turn theseoff.

ESCI: GeneralHints

Forgeneraladvice,seepage15 andpages478-481 of thebook. Seealsothethree appendices,andinsidetherear cover.

YouneedExcel

You needalicensedcopyofMicrosoftExceltorunESCI.ESCIisasetof six modules,eachofwhichisa regularExcelworkbook. Download,savetoyour harddrive, thenloadandrun anyofthesejustasanyotherExcelworkbook, butmakesurethatmacros areenabled.Exception:ESCI Effectsizesdoesnotuse macros.

Soundfiles

TheDanceppageof ESCIchapters5-6 requiresfivesmallsound filestobe availableinthesamefolderastheESCImoduleitself.TheESCIdownloadsforWindows arezippedfoldersthatcontainsboththeESCImoduleandthefivesound files.Keepthem together,whereveryou storethem.Tohearsound,you alsoneedtoclickthecheckboxon at red5 on theDanceppage.If thesound filesarenotavailable,everythingworks normally exceptno sounds areplayedduringsamplingattheDanceppage.(Theversion forExcel 2011 on Macdoesnotsupportsound, so no sound filesareneeded.)

GiveESCItimetorespond

ESCImakesheavydemandson Excel,especiallywhen asimulationisrunningor complexcalculationsarerequired.Anythingusingnoncentralt,includingcalculationsof power, precision for planning, and CIs on Cohen’sd, makesespeciallyheavydemands. Expectcalculationsandupdatingof thescreentotakealittletime.Screenupdatingmaybe jerky,or initiallyincomplete.Usuallythereissomeindicationthatcalculationisinprogress, butinsomecasesnothingseemstobehappening.Allow timeforESCItorespond.Seethe popoutcomments.Whenyou wanttomakealargechangetoaspinnerorslider, go slowly, andperhapsstartwithsmallchanges.

Thefiguresinthebook

ThesecomefromExcel2003 forWindows.ThedisplayinlaterversionsofExcel lookssomewhatdifferent,especiallyExcel2011 forMacintosh.Bepreparedforthe alignmentofcheckboxes,labels,andcommentstobeless thanperfect,especiallyifthezoom factorischanged.

CheckboxesinESCIMeta-Analysis

Original31andsomeotherpagesof ESCIMeta-Analysisincludeacolumnof many checkboxesthatcan removeindividualstudiesfromthemeta-analysis.In theWindows versions,itcansometimesbetrickytoclickon thecheckbox you want.Itmaywork to positionthemousepointcarefullynearthetopborderofthe checkbox youaretryingto change.

ESCI: TroubleShooting

Macrosmust be enabled

Themostfrequentcauseofaproblemisthatmacrosarenotenabled,inwhichcase buttonsandotherscreen controlswillnotwork. OnlyESCIEffectsizesdoesnotrequire macros.

Sliderssometimeshaveamindoftheirown

Sometimeswhenyou clickon asliderthenleaveyourmousepointerovertheslider thecontrolkeeps changingwhatevervalueitiscontrolling.Afteraclick,Excelslidersare sometimesinconsistentinhow theyrespondtoa hoveringmouse.You mayneedtoclick thenquicklyshiftthemouseawayfromthecontrol.

MorethanoneESCImoduleopen

OftenitisquiteOK tohavemorethanoneESCImoduleopenatonce.Butif you run intoanyproblem,tryagainwithonlyoneESCImoduleopen.

Figuresarenotprotected

Seepages478-479 of thebook. If anESCIfigure, or anyelementina figure, becomeshighlighted,probablybecauseof anaccidentalmouseclickon the figure,pressthe Esckeyonceor twice. Ifthefigureor somepartof ithasbeenchangedinadvertentlyafter beinghighlighted,tryUndooneor moretimes.

ClickingtheRun-Stopbutton

Manypageshavesucha buttontocontroltherunningof asimulation.Clickingthe buttononceshouldstartthesimulation.Clickingagainshouldstopthesimulation,but sometimesyou needtoclick(or releasetheclick)ata criticalmomentduringthesimulation trial,soyou mayneedtoclickacoupleof timestostopthesimulation—butdo so slowly,so you don’tinadvertentlystop it then start it again. You canalsostopthesimulationby clickingoneof thetabsatthebottomof theExcelwindow to go toadifferentpage.

32-bitand64-bitExcel

Ifwhen loadingor usingESCIchapters5-6you seeadialogueboxwithanerror

messagesaying“Compile error: Expected: Sub or Function”thenyouareprobablyrunning

32-bitExcelbuthaveopenedtheESCImodulewith64 bitinitsfilename.Closethat moduleandtryESCIchapters5-6 thatdoesnot have64 bitinthefilename.

On theotherhand, ifyouseeadialogueboxwith an error messagesaying “Compile error.Thecodeinthisprojectmustbeupdatedforuse on 64-bitsystems…”thenyou are probablyrunning64-bitExcel,buthaveopenedtheversionoftheESCImodulethatdoes not have64 bitinitsfilename.Tryagainwiththemodulethatdoesinclude64 bitinitsfile name.

A boxyoushouldnever see

You should never seeadialogueboxsayingsomethinglike “Thename, big1, either conflicts with a valid rangereferenceor is invalid forExcel….”, but, ifyoudo, click theOK to All buttonand continueworking.

Anotherboxyoushouldneversee

You shouldneverseeadialogueboxlabeledMicrosoftVisualBasicandsaying “Run time error…”. Ifyou do, tryclickingtheEnd button:You maybeabletocontinue working. If not, you mayneedtoclose(don’tSave)andreopentheESCImodule,andstart again.

KnownESCI Errorsor Problems

ESCIfor Macintosh

Slidersandotherscreen controls(buttons,spinners,checkboxes,andradiobuttons) sometimesdisappearafteruse!Theyreappearifyou clickintheirposition—whichiswhere themousepointerchangesfromplusto arrow. Thisisaknown Excelproblem,andIhopea future releaseof Excel 2011 will solveit. I’veused a rangeof strategies to minimizethe problem,buthaven’tbeen able to overcomeit fully.

In manycases the word“SLIDER”appears in theposition ofavanished slider.

Tominimizetheproblem:

• Don’tuse Undo. Using Undo oftenleadsto allcontrolson apagevanishing.Ifthat happens,it maybeeasiestto closeandreopenthemodule.
• Avoid triggeringaDataValidationerror. Ifyoutypeinavalueoutsidethe permissiblerange(e.g.a valueforNthatistoolargeor toosmall,or notaninteger), such an errormaybetriggered.Popoutcommentsusuallystateminandmax permissiblevalues.If such an erroristriggered,all controlsarelikelytovanish.

Pleaseletmeknowifyou haveafix.

KnownErrors in theBook

Nonehasbeenidentifiedso far.Pleaseletmeknow of anyyou find.