Department of Immigration and Border Protection

RFQ No:731

Role:Hadoop Developer

Closing Date:10am 14th Jan 2018

Contract Start Date:Feb 2018

Contract Duration/End Date:Contract until 30 June 2018

  1. Item number
/ Description / Details
  1. Proposed Work Order Start Date*
/ February 2018 *
*Note actual start date will be dependent on a satisfactory Security Clearance and Employment Suitability Clearance prior to commencement refer item 22 below for further information
  1. Proposed Initial Contract Period
/ Contract until 30 June 2018.
  1. Contract Option Period
/ Options to extend for a further 2 x 12 months.
  1. ICT Service Category
/ Category J - Specialists
  1. Personnel Category (Skill set)
/
  1. Data Warehousing
  2. (Hadoop Developer)

  1. Number of Specified Personnel required
/ Several
  1. Reduced activity period
/ The Department will notify a Christmas/New Year shut down period. Some specified personnel may be required to work during this period however prior approval will be required from their DIBP contract manager.
  1. Business Hours
/ Specified Personnel service arrangements are 40 hours per week. If it is necessary to exceed the 40 hours in any given week, written approval must be obtained prior to the work being undertaken.
Specified Personnel are required to complete DIBP ICT Contractor SAP Timesheet which must be submitted prior to close of business at the end of each week or as directed.
  1. Replacing Specified Personnel
/ Clause11.6 of the Terms and Conditions of Contract will not apply.
  1. Maximum no. of candidates per Vendor
/ Three (3)
  1. Services/work required
/ The services will include and not be limited to:
  • Designing, building, installing, configuring and supporting Hadoop;
  • Implementing data workflows and ETL processes;
  • Participating in design reviews, code reviews, unit testing and integration testing;
  • Identifying opportunities to improve the performance and quality of the platform;
  • Pre-processing using Hive, Pig, Spark, etc;
  • Translating complex functional and technical requirements into detailed design;
  • Performing analysis of vast data stores and uncover insights;
  • Maintaining security and data privacy;
  • Creating scalable and high-performance web services for data tracking;
  • Managing and deploying additional components such as NiFi, Kafka, Zeppelin, Solr;
  • Testing prototypes and overseeing handover to operational teams;
  • Developing positive team ethos within the immediate workgroup through positive participation and communication;
  • Developing and maintaining strong effective working relationships with key management personnel and internal client base.

  1. Indigenous Procurement Policy
/ Effective 1 July 2015 the Indigenous Procurement Policy replaced the Indigenous Opportunities Policy. The purpose of the Indigenous Procurement Policy is to stimulate Indigenous entrepreneurship and business development, providing Indigenous Australians with more opportunities to participate in the economy (see Indigenous Procurement Policy for further information).
Supply Nation maintains a list of enterprises that meet the definition of “Indigenous enterprises” see
Vendor to address question listed under Schedule 6 Statements in Relation to Employees & Suppliers.
  1. Methodology
/ Specified Personnel will be required to adhere to DIBP’s development framework and work standards.
  1. Monitoring & Measuring Performance
/ Specified Personnel’s performance will be monitored during the contract term and assessed against their deliverables and input into weekly performance meetings and weekly and monthly reports. Milestones will need to be achieved ie, producing relevant documentation and business outcomes.
  1. Documentation
/ Specified Personnel will be required to deliver the following:
  • Technical Specifications;
  • Basic Architect documents;
  • Technical designs and matrix;
  • Architectural documents;
  • System Design Specifications;
  • Work flows, events and sequence diagrams;
  • UML (Universal Mark-Up Language) charts;
  • Environment Context Definitions;
  • Deployment plans.

  1. Skills knowledge transfer
/ Clause 35 of the Deed applies. Specified Personnel will be expected to transfer skills and knowledge to DIBP staff and ensure appropriate documentation is stored in accordance with DIBP’s recordkeeping policy and practices.
  1. Selection criteria
  2. Please note the importance of responding to this Selection Criteria.
  3. Criteria do not need to be addressed separately, if clearly demonstrated in CV.
/ Mandatory/Essential Criteria:
  • Bachelor's degree in Computer Science or a related field;
  • Minimum 5 years’ working experience in data warehousing and Business Intelligence systems;
  • Demonstrated proficiency in designing and delivering scalable solutions in several of the following:
  • Hortonworks,
  • Cloudera, Pivotal,
  • MapR,
  • Pig,
  • Hive,
  • Spark,
  • Kafka,
  • Sqoop,
  • Hbase,
  • Flume,
  • Oozie,
  • R
  • Demonstrated ability to apply technology in solving business problems;
  • Proven ability to communicate with both technical and non-technical audiences;
  • Experience with integration of data from multiple data sources;
  • Ability to work in a team as well as independently;
  • High level written/verbal communication skills;
  • Specified Personnel must hold a current Australian Government Security Clearance (AGSVA) or be willing to undergo and obtain an AGSVA clearance (Baseline clearance as a minimum);
  • Specified Personnel must be willing to undergo and obtain an Employment Suitability Clearance (ESC).

Intellectual Property Rights – ownership of Contract Material / The Department owns the Intellectual Property Rights in Contract Material.
Limitation of liability – cap / $ 10 Million in the aggregate.
Insurance / As set out in Item 10 of Schedule 1 - Deed Details
Fee structure / Hourly rates to be quoted in either half or full dollars, GST exclusive.
IMPORTANT: Agency’s fee structure should only be quoted in Schedule 6. Please do not include this information in the candidate’s CV.
Security requirements: Security Clearance and Employment Suitability Screening / DIBP expects the Specified Personnel to adhere to current departmental security instructions.
Security Clearance:-
DIBP requires Specified Personnel to have as a minimum BASELINE VETTING security clearance prior to commencement unless otherwise specified.
Note: The Contractor will be required to meet the cost of any security clearances that are required.
Employment Suitability Screening:-
DIBP requires all specified personnel to obtain and maintain an Employment Suitability Clearance.
Other requirements
Note: Please ensure you respond to each dot point. This forms part of your submission and if not addressed your submission will not be accepted / Please respond and completethe attached Schedule 6 Standard form of quotation for each specified personnel addressing the following:
  • Indicate if specified personnel are currently working at DIBP or have previously worked at DIBP or ACBPS.
  • Indicate if specified personnel have a financial interest in your company (Vendor).
  • Specified personnel submitted must be Australian Citizen. Confirmation of specified personnel’s citizenship status is required.
  • Indicate if specified personnel currently hold a security clearance and specify the level of clearance.
  • Indicate the availability of the specified personnel.
  • Provide a statementthat vendor or nominated sub-contractors had been named as not complying with the Workplace Gender Equality Act 2012.
  • Provide a statementthat vendor and nominated sub-contractors agree to comply with DIBP policy of not engaging illegal workers.
  • Provide a statementthat vendor, or nominated sub-contractors, do not have any judicial decision against them (including any decisions under appeal) relating to unpaid employee entitlements.
  • Provide a statement on whether nominated Specified Personnel is contracting or sub-contracting through an Indigenous Enterprise (being an organisation that is 50 per cent or more Indigenous owned that is operating a business).
  • Interstate specified personnel may be required to travel to Canberra for an interview. Phone interviews may not be considered and are at the discretion of the decision-making panel.
  • DIBP work order requirements – See Attachment A to this RFQ.

YOUR RESPONSE

Name / First Name / <response>
Surname / <response>
Gender / <response>
Your mobile number / <response>
Your email / <response>
Date of birth / <response>
Home address / <response>
Availability / <response>
Rate (Excluding GST, Payroll Tax and Agency Fee) / Your Rate Excluding GST, Payroll Tax and Agency Fee>
<response>
Citizenship Status / Australian Permanent Resident Work Visa
Security Clearance / Clearance Level: / <response>
Date Granted: / <response>
Department: / <response>
Department contact: / <response>
Referee 1 / Name: / <response>
Title:
Organisation:
Professionals relationship to you:
Phone:
Mobile:
Email:
Referee 2 / Name: / <response>
Title:
Organisation:
Professionals relationship to you:
Phone:
Mobile:
Email:
Other Requirements / Australian Citizenship is mandatory

SELECTION CRITERIA

Important: All the criteria below must be addressed individually as part of your application

Mandatory/Essential Criteria:

  • Bachelor's degree in Computer Science or a related field;
  • Minimum 5 years’ working experience in data warehousing and Business Intelligence systems;
  • Demonstrated proficiency in designing and delivering scalable solutions in several of the following:
  • Hortonworks,
  • Cloudera, Pivotal,
  • MapR,
  • Pig,
  • Hive,
  • Spark,
  • Kafka,
  • Sqoop,
  • Hbase,
  • Flume,
  • Oozie,
  • R
  • Demonstrated ability to apply technology in solving business problems;
  • Proven ability to communicate with both technical and non-technical audiences;
  • Experience with integration of data from multiple data sources;
  • Ability to work in a team as well as independently;
  • High level written/verbal communication skills;
  • Specified Personnel must hold a current Australian Government Security Clearance (AGSVA) or be willing to undergo and obtain an AGSVA clearance (Baseline clearance as a minimum);
  • Specified Personnel must be willing to undergo and obtain an Employment Suitability Clearance (ESC).

Business Address: Unit 4, 15 Tench Street, Kingston. ACT 2604, Mailing address: Po.Box 153 Civic Square, ACT -2608,

Ph: 02 6108 3661, Fax: 02 6108 3662, E-mail: , ABN: 92 129 869 174