NCRIS

National CollaborativeResearchInfrastructureStrategy

EvaluationReport

EXECUTIVESUMMARY

The NationalCollaborativeResearchInfrastructureStrategy (NCRIS)isanAustralianGovernmentprogramforthe developmentofnationalresearchinfrastructurethathas provided$542 millionfrom2005-06throughto2010-11.

Theaimoftheprogramistoprovideresearcherswithaccess tomajorresearchfacilitiesandthesupportinginfrastructure andnetworksnecessarytoundertakeworld-classresearch.

KeyfeaturesofNCRIS— namelytheemphasison collaborationfromtheoutset,thestrategicidentificationof capabilitiesthroughtheconsultativeroadmappingprocess, thefacilitationprocesstodevelopcapabilityplansandthe provisionoffundingforskilledstaffandoperatingcosts—

contributetotheNCRISmodelbeinganappropriate,effective andefficientmechanismforestablishingcriticalresearch infrastructureforAustralia.Incorporationofthesekeyfeatures shouldbeconsideredinthedevelopmentofpolicyforfuture researchinfrastructureprograms.

Therearesomekeylearningsarisingfromthisevaluationwith respecttofacilitation,governance,interactionswithstateand territorygovernmentsandthesourceoffundingwithinthe systemforinfrastructureaccess.Theseareelementsrequiring furtherconsiderationinthedesignofprogramsforresearch infrastructureprovisiongoingforward.

Currentuncertaintyaboutfuturefundingforresearch infrastructure,particularlytheprovisionoffundingforoperating costsandspecialiststaff,createsmanagementdifficultiesfor currentNCRIScapabilitiesandplacesAustraliaatriskoflosing thehighly-skilledwork-forcerequiredforefficientoperationof sophisticatedfacilities.This issueshouldalsobeconsidered

forfuturefundingprograms.

InthepreparationofthisNCRISEvaluationReport

theEvaluationTeam, convenedbytheDepartmentof Innovation,Industry,ScienceandResearch,drewonthe work ofaSciencePanelandanEconomicConsultant. TheteamsdevelopedtheirassessmentoftheNCRIS

programusingevidencegainedfromastakeholdersurvey andfromconsultationswithNCRIScapabilityproviders, usersandkeystakeholdersincludingstateandterritory governments,universitiesandpubliclyfundedresearch agencies.Keyfindingsrelatingtothetermsofreferenceare summarisedasfollows.

APPROPRIATENESS

Thereisaclear,ongoingneedforgovernmentfundingof researchinfrastructure.Itisappropriate,andconsistentwith currentgovernmentpolicy,thatgovernmentprovidefunding tocreateresearchinfrastructuretoenhancethenational innovationsystemandtofostercollaboration.

The roadmappingprocessthatunderpinneddecision-making intheimplementationoftheNCRISprogramprovidedafirm foundationfortheallocationoffunding.Thesystematicand consultativeapproachtoresourceallocationensuredthat

thehighestnationalprioritycapabilitieswereaddressed.With appropriate,regularupdates,thisprocessisrecommendedfor futureresearchinfrastructurefundingprograms.

Facilitationachievedeffectiveresourceallocationwithin capabilitiesandisanappropriatemechanismfordeveloping nationalcapabilities.

22

Thechoiceoffacilitatoriscriticaltothesuccessofa facilitationprocess.The balancebetweentheneedforan independentfacilitatorandtheneedforthefacilitatorto

havestandingin,andknowledgeof,therelevantcommunity requirescarefulconsideration.

Collaborationnaturallydrivesabroaderperspectiveandis good forresourceallocationwithinacapability.

TheNCRISmodelisappropriateforfundingmedium-to large-scale,capability-basedresearchinfrastructureand,

forthistypeofinfrastructure,issuperiortopreviousmodels. Theanalysisshowsthatithassubstantiallyimprovedthe allocationofresources.

EFFECTIVENESS

TheNCRISapproachhasbeensuccessfulinachieving thecreationofimprovednationalresearchcapabilityby embracingabroaddefinitionofinfrastructuretodevelop newfacilitiesandleverageexistingcapacity.

TheNCRISprogramhasbroadcommunitysupportand hasengenderedatrendtowardsamorestrategicand collaborativeapproachtothefundinganddevelopment ofresearchinfrastructure.

NCRIScapabilitiesaresupportingnovel,collaborative researchactivitiesthatarealready,orhavethepotentialto be,world-class.

TheNCRISprogramiscost-effective.Particularoutcomes thatcontributetoitscost-effectivenessare:

»awillingnesstoinvestinhumancapitalandoperating costs,resultinginsuperiorservicedeliveryandviability offacilities;

»combinedbargainingpowerresultinginimproved pricing;and

»leveraging ofexistinginfrastructureandco-investment, resultingininvestmentsofincreasedvalue.

ThereisclearevidencetheNCRISprogramhasbeen effective inmeetingresearchinfrastructureneedswithinthe definedfundingenvelope.Whetherthiseffectcontinuestobe achievedwilldependonwhetherthemomentumgainedby NCRIScanbemaintained.

EFFICIENCY

Takingintoaccountgovernmentreportingrequirements, administrationoftheNCRISprogrambythedepartmenthas beenefficient,withallfundscontractedonscheduleandwith appropriateadministrativecostsforacomplexprogram.

Futureprogramsforfundingresearchinfrastructureshould considerprovidingmoreadviceandguidanceregarding suitablegovernancemodels.

Greatertransparencyisneededaroundhow accessfeesfor infrastructurearecharged,includingimprovedrigourand documentationregarding thecalculationanddegreetowhich accessfeesreflecttruemarginalcosts.

Accesstoresearchinfrastructureneedstobepaidfor somewhereintheinnovationsystem.Currentlyitisunclear wherethisresponsibilitylies. Thisissueshouldbeaddressed.

INTEGRATION

NCRISappearstohavebeensuccessfulinengaging AustralianGovernment,stateandterritorygovernmentsand governmentagenciesonpriorityareaswithoutcompromising anationalapproachtofundingresearchinfrastructure.

PERFORMANCEASSESSMENT

PerformanceassessmentforNCRIScapabilitiesisadequate, butcouldbeimprovedbymoreconsistentandbenchmarked performanceindicatorsacrosscapabilities,andaggregationof performancedataonline.

STRATEGICPOLICYALIGNMENT

NCRISisalignedwiththeAustralianGovernment’sbroader policyobjectivesandwithitsprograms.Futureresearch infrastructurefundingprogramswouldneedtoensurethatthis alignmentisretainedforexistingandnewprograms.