Senior Data Engineer

Job details

Location: VIC - Melbourne
Reference: Ad-44260
Posted: about 1 year ago

Job description

Senior Data Engineer

  • 6 Months contract
  • Melbourne CBD location
  • $600+ per day (Negotiable)

Skills & Experience required:

  • Hadoop Stack: Hive, Spark (Core and Streaming), Kafka, Flink, NIFI etc.
  • Stream transform using Spark Streaming or Flink
  • Change data capture in big data ecosystem
  • Building real time or batch ingestion and transformation pipelines
  • Exposure to ‘container’ technology (e.g. Docker, Kubernetes)
  • Advanced programming knowledge (e.g. Core Java, Python and Scala )
  • Experience wrangling data using library such as Pandas, Scikit-learn or Numpy
  • Experience using Notebook such as Jupyter or Polyglot
  • Experience with test-driven development, test automation & continuous delivery
  • Experience in Java build automation technologies such as Gradle, Maven, Integration with Sonarqube etc
  • Experience supporting a production service in a DevOps friendly environment
  • Excellent analytical skills and proven track record solving difficult problems
  • Experienced in Agile / Scrum projects
  • Experience with design and developing data reconciliation & metadata driven data processing frameworks.
  • Good to have Background in API and cloud-native architecture

Qualifications Necessary:

  • Education level – Degree in Computer Science or related field
  • A minimum of 6 to 8 years of industry experience
  • AWS certification would be advantageous
  • Candidate must have relevant VISA’s, Australian PR or Australian Citizenship
  • Understanding of Financial Services Industry 

How to Apply
Click APPLY or contact Rishi on for a confidential discussion


This job has expired!