This Big 4 consultant has experience with data volumes 100+ petabytes. Their experience includes developing pipelines for global social media companies, large commercials and the APS.
This Big 4 consultant has experience with data volumes 100+ petabytes. Their experience includes developing pipelines for global social media companies, large commercials and the APS. First time entering the APS contracting market.
Our Assessment
This candidate has been referred by a high performing colleague. Their technical engineer background provided them with a methodical approach to solving problems. Their time in consulting demonstrates their ability to come into new environment and produce high quality work quickly.
Experience / Technical Skills
- Design, build, test, operate and optimise ETL pipelines (e.g. Python, Spark, HiveSQL, Bash, Azure Data Factory, FME, StreamSets, etc)
- Experienced with pipeline managing large data volumes, exceeding 100 petabytes
- Design, build, operate and optimise data warehouse for up to trillion row requirements
- Design and build supporting services including CI/CD pipeline (Ansible), workflow management (Airflow), log management, BI visualisation
Opportunities Seeking | Contract |
Charge Rate | $180/hr excl. GST |
Security Clearance | Negative Vetting 1 |
Availability | 4 weeks’ notice |