inhousefyi
← Back to listings

Senior Data Engineer

Equal ExpertsMelbourne, Victoria, Australia · Posted Feb 7, 2024
Full-time
Apply now

Description

Description

Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important projects for our clients, deliver market-leading propositions across the digital, online and mobile channels, and are recognised for our leadership in the application of agile and lean delivery methods to assure delivery. We have offices in Australia, India, South Africa, the UK, the EU and the USA.

We’re looking for contract Data Engineers with proven senior-level experience to join the Equal Experts network. Our Data Engineers are highly skilled in creating data pipelines for ingest, transformation and storage of data, usually at scale, and are familiar with standing-up analytics clusters.

This role involves using modern agile technical practices - including Continuous Integration and Deployment, TDD, and XP - to deliver timely and pragmatic solutions, as well as helping others to do their jobs in a more effective way. This role involves working in teams that use modern agile technical practices - including continuous integration and deployment and fast feedback loops - to deliver timely and pragmatic solutions, as well as helping others to do their jobs in a more effective way.

Responsibilities

  • Working with the client and the team to determine data processing and access needs and how best to deliver them.
  • Creation and support of highly available data pipelines and storage solutions (e.g. data warehouses).
  • Delivery of software using agile (pair programming, TDD, CI/CD, etc) practices.
  • Automation of data infrastructure and deployments.
  • Advocating agile practices to the client organisation.
  • Mentoring client team members.
  • Helping improve the team and clients’ data capabilities.

Required Skills

  • Significant experience working on data pipelines, platforms and projects.
  • Experience in developing solutions in one or more of the main Cloud providers (AWS, GCP, Azure).
  • Strong background in at least one programming language, Python or Scala preferable.
  • Working with a variety of databases, data warehouses and distributed file systems in production environments.
  • Strong experience in SQL and data modelling.
  • Exposure with data processing at scale.
  • Working with source control and infrastructure as code (Git/Github, Terraform, ansible etc.) and CI/CD tools.
  • Understanding and being able to support data scientists or business intelligence teams - in data prep, mentoring and support functions.
  • Strong collaboration and communication skills, including the ability to communicate effectively while working remotely with globally distributed teams.

Similar jobs

Description Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions forblue-chip enterprise and public sector clients across a range of industry sectors. We work on importantp…

Full-timeRemote
Equal ExpertsSouth Africa

Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important projects fo…

Full-time
Equal ExpertsMelbourne, Victoria, Australia

Description Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important…

Full-time

Description Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important…

Full-timeRemote

Description Equal Experts is an innovative consultancy specializing in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important…

Full-timeRemote

Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important projects fo…

Full-timeRemote
ArtefactLondon, United Kingdom

Est. 90,000 GBP

Senior Data Engineer Who we are Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the ent…

Full-time
Arcana AnalyticsBangalore, India

Join our dynamic team at the forefront of cutting-edge technology as we seek a seasoned Senior Data Engineer. Embark on a journey where your deep-rooted expertise in computer science fundamentals, alongside an intricate…

Full-time

Est. 120,000 PLN

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…

Full-timeRemote

Est. 84,000 PLN

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…

Full-timeRemote
Tech HoldingAhmedabad, Gujarat, India

About us: Working at Tech Holding isn't just a job, it's an opportunity to be a part of something bigger. We are a full-service consulting firm that was founded on the premise of delivering predictable outcomes and high-…

Full-time
Solution Architect4 months ago
InfomediaSydney, New South Wales, Australia

Overview: We are seeking a highly skilled Solutions Architect to lead the design and optimization of our product’s architecture. In this role, you will serve as the key architect for data solutions, overseeing the integr…

Full-time
Data Engineer1 month ago
EncoraKuala Lumpur, Malaysia

About the Role We are looking for a Senior Data Engineer with strong experience in modern data platforms and cloud-based architectures. The ideal candidate has deep hands-on experience with Snowflake or Databricks, has b…

Full-time
Equal ExpertsSouth Africa

Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions forblue-chip enterprise and public sector clients across a range of industry sectors. We work on importantprojects for…

Full-time

Join Exadel as a Senior Data Engineer and bring logic to life. Solve analytical challenges and build solutions that matter—with a sharp, collaborative team. Why Join Exadel We’re an AI-first global tech company with 25+…

Full-timeRemote
Senior Developer4 months ago
InfomediaSydney, New South Wales, Australia

Position Purpose: Serve as a Senior Full Stack Developer responsible for designing and delivering high-quality features Hands-on development role while contributing to and influencing the overall technical direction of t…

Full-time

Est. 840,000 SEK

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…

Full-timeRemote

Est. 84,000 PLN

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…

Full-timeRemote

Description Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions forblue-chip enterprise and public sector clients across a range of industry sectors. We work on importantp…

Full-time

Senior Data Engineer Powering the future requires serious data infrastructure. We’re looking for a Senior Data Engineer to design, scale, and champion modern data solutions for us. About Sand Sand Technologies is a globa…

Full-time
Data Engineer3 months ago
Spaulding RidgeLondon, United Kingdom

Est. 80,000 GBP

Spaulding Ridge is an advisory and IT implementation firm. We help global organizations get financial clarity into the complex, daily sales, and operational decisions that impact profitable revenue generations, efficient…

Full-time
Data EngineerJun 4, 2025

Project Description We are looking for a motivated Data Engineer to join our growing data team. This is a great opportunity for someone early in their career to gain hands-on experience with modern data technologies. You…

Full-timeRemote
Data Engineer8 months ago
Particle41Remote

Data Engineer Particle41 is seeking a talented and versatile Data Engineer to join our innovative team. As a Data Engineer, you will play a key role in designing, building, and maintaining robust data pipelines and infra…

Full-timeRemote
ExadelRemote

Est. 80,000 USD

Join Exadel as a Senior Data Engineer and bring logic to life. Solve analytical challenges and build solutions that matter—with a sharp, collaborative team. Why Join Exadel We’re an AI-first global tech company with 25+…

Full-timeRemote
SSM Data Tech Lead4 months ago
InfomediaSydney, New South Wales, Australia

Position Purpose: To be part of an existing team to create, maintain, support and improve upon existing internal production applications to speed up delivery of products to our customers. This will also include the imple…

Full-time
KonradRemote

Who We Are Konrad is a next generation digital consultancy. We are dedicated to solving complex business problems for our global clients with creative and forward-thinking solutions. Our employees enjoy a culture built o…

Full-timeRemote
Poland and Eastern EuropeStockholm, Sweden

Est. 900,000 SEK

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…

Full-time

Join Exadel as a Senior Data Engineer and bring logic to life. Solve analytical challenges and build solutions that matter—with a sharp, collaborative team. Why Join Exadel We’re an AI-first global tech company with 25+…

Full-timeRemote

Est. 84,000 PLN

Xebia is a global AI-first, digital transformation, and engineering partner. With over 25 years of experience and a team of 5,000 professionals across 16 countries, we help organizations design and build scalable product…

Full-timeRemote
ExadelRemote

Join Exadel as a Senior Data Engineer and bring logic to life. Solve analytical challenges and build solutions that matter—with a sharp, collaborative team. Why Join Exadel We’re an AI-first global tech company with 25+…

Full-timeRemote