Data Engineer

5 Months ago • 3-6 Years

Job Summary

Job Description

This Data Engineer role involves designing, developing, and maintaining scalable ETL pipelines using AWS Glue and Airflow. Responsibilities include building secure data systems with AWS services and Terraform, collaborating on data transformation with dbt for analytics and machine learning, and optimizing pipelines for performance and cost-efficiency. The role also requires implementing data governance practices, building real-time pipelines using PySpark and Kinesis, and ensuring thorough testing and monitoring. The ideal candidate will have 3-6 years of experience in data engineering, proficiency in SQL, Python, or PySpark, and experience with AWS services and orchestration tools.
Must have:
  • ETL pipeline development (AWS Glue, Airflow)
  • AWS services (Redshift, Kinesis, Lambda, S3, DMS)
  • SQL, Python, or PySpark proficiency
  • Data modeling and database management
  • Real-time data pipeline experience
  • Data governance and compliance knowledge
Good to have:
  • DataOps principles
  • CI/CD pipelines
  • Agile development methodologies
  • Machine learning concepts
  • AWS certifications
Perks:
  • Championing Engineering Excellence
  • Work with top engineering talent
  • Building large-scale data pipelines
  • EAP access
  • Learning and Development Platform
  • Annual Bonuses
  • Paid volunteer day
  • Daily catered breakfast
  • On-site masseuse
  • Team lunches and happy hour
  • Fun office environment

Job Details

Are you a passionate and ambitious data engineer ready to dive into an environment that fosters innovation, continuous learning, and professional growth? We're seeking talented individuals who are eager to tackle complex big data problems, build scalable solutions, and collaborate with some of the finest engineers in the entertainment industry.

  • Complex Projects, Creative Solutions: Dive into intricate projects that challenge and push boundaries. Solve complex technical puzzles and craft scalable solutions.
  • Accelerate Your Growth: Access mentorship, training, and hands-on experiences to level up your skills. Learn from industry experts and gain expertise in scaling software.
  • Collaborate with Industry Leaders: Work alongside exceptional engineers, exchanging ideas and driving innovation forward through collaboration.
  • Caring Culture, Career Development: We deeply care about your career. Our culture prioritizes your growth with tailored learning programs and mentorship.
  • Embrace Challenges, Celebrate Success: Take on challenges, learn from failures, and celebrate achievements together.
  • Shape the Future: Your contributions will shape the future of entertainment.

About the team

You’ll be joining the Data Engineering team on an exciting mission to build a top-tier data platform that powers everything we do. We manage data from our in-house products like Stake and Kick, as well as third-party tools and services, centralising it and ensuring it’s reliable, scalable, and ready to drive smarter decisions across the business.

We’re focused on advanced data tools and services that truly make a difference. Our goal is to help teams unlock the full potential of data, empowering them to create impactful outcomes for our customers and the business. If you’re someone who loves tackling big challenges and shaping the future of data, you’ll fit right in!

Key Responsibilities:

  • Design, develop, and maintain scalable ETL pipelines using AWS Glue and orchestrate workflows with Airflow to extract, transform, and load data from various sources (e.g., databases, APIs, flat files, streaming services) into the data lake, following medallion architecture principles.
  • Build and implement secure and efficient data systems using AWS services and Terraform, ensuring performance and compliance.
  • Collaborate with cross-functional teams to transform data from the gold layer in the data lake to Redshift using dbt, enabling high-quality analytics and machine learning insights.
  • Monitor and optimise data pipelines for performance, scalability, and cost-efficiency, ensuring observability through monitoring and alerting systems.
  • Document end-to-end processes, including ingestion, transformation, storage and governance, to support knowledge sharing and scalability.
  • Implement data governance practices such as data lineage, classification, access control, and compliance with GDPR and other regulatory requirements.
  • Build and optimise real-time data pipelines using PySpark, Glue Spark, and Kinesis, focusing on Change Data Capture (CDC) for seamless operations and reliability.
  • Ensure pipelines are thoroughly tested and optimised, with comprehensive monitoring and alerting systems for reliability and performance.
  • Participate in peer code reviews to ensure adherence to best practices, coding standards, and high-quality development. 

Minimum Qualifications:

  • A Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or a related field or equivalent practical experience.
  • 3 - 6 years of experience in data engineering, with a focus on ETL development, data modelling, database management, and real-time data pipelines.
  • Proficiency in SQL, Python, or PySpark, with hands-on experience using cloud services such as Glue, Redshift, Kinesis, Lambda, S3 and DMS.
  • Experience with orchestration tools (e.g., Apache Airflow), version control systems (e.g., GitHub), and big data technologies such as Spark or Hadoop.
  • Experience designing and implementing modern cloud-based data platforms, preferably on AWS, using Infrastructure as Code (IaC) tools like Terraform.
  • Knowledge of data governance and compliance standards.
  • Strong problem-solving, analytical, and communication skills for engaging with cross-functional teams.

Preferred Qualifications 

  • Experience with DataOps principles, CI/CD pipelines, and agile development methodologies.
  • Knowledge of machine learning concepts and their application in data engineering.
  • AWS certifications (e.g., AWS Certified Solutions Architect, AWS Certified Data Analytics) or similar cloud certifications.

Some of the perks of joining us:

  • Championing Engineering Excellence to influence data driven impact across global scale software products.
  • Work alongside the top 5% of engineering talent in Australia using a vast AWS cloud native and big data technology stack.
  • Exposure to building global, large-scale volume data pipelines, data warehouses, and datalakes which are consuming requests at thousands per second frequency.
  • EAP access for you and your family
  • Access to over 9,000 courses across our Learning and Development Platform 
  • Lucrative Annual Bonuses
  • Paid volunteer day
  • Two full-time barista’s who will make your daily coffee, tea or fresh juice!
  • Daily catered breakfast
  • On-site masseuse on Wednesdays
  • Team lunches and happy hour in the office from 4pm on Fridays
  • Fun office environment with pool tables, table tennis and all your favourite gaming consoles
  • Help yourself drinks fridges and snack shelves

We believe that the unique contributions of everyone at Easygo are the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. We are passionate about providing a workplace that encourages great participation and an equal playing field, where merit and accomplishment are the only criteria for success.

Similar Jobs

Grab - Senior Manager, Data Science

Grab

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
GT - Full-stack Engineer (Python + React.js)

GT

Poland (Remote)
3 Months ago
miniclip - Games QA Engineer

miniclip

Lisbon, Lisbon, Portugal (On-Site)
2 Months ago
Virtusa - DevOps Lead

Virtusa

Pune, Maharashtra, India (Hybrid)
8 Months ago
Loft Orbital - Senior SRE / DevOps

Loft Orbital

Toulouse, Occitanie, France (Hybrid)
8 Months ago
Dream Sports - SDE 2 - ML & Data Platform

Dream Sports

Mumbai, Maharashtra, India (On-Site)
9 Months ago
Playtika - Marketing Systems Analyst

Playtika

Israel (On-Site)
7 Months ago
Bungie - Contract Senior Analyst - Destiny

Bungie

(Hybrid)
3 Months ago
The game - Data & Insights Analyst

The game

London, England, United Kingdom (Hybrid)
3 Months ago
Nielsen Holdings - ETL (AWS Glue)/Informatica-Redshift ,Java ,SQL

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
8 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Riot Games - Senior Software Engineer, Services - Shanghai Game Studio

Riot Games

Dublin, County Dublin, Ireland (On-Site)
7 Months ago
luxsoft - Test Automation Engineer (Selenium)

luxsoft

Melbourne, Victoria, Australia (On-Site)
1 Month ago
Epic Games - Senior Software Engineer, Developer Relations (UE China)

Epic Games

Shanghai, Shanghai, China (On-Site)
2 Months ago
supercell - Software Engineer (Data)

supercell

Helsinki, Uusimaa, Finland (On-Site)
2 Months ago
zwift - Engineering Manager, Mobile

zwift

United States (Remote)
1 Month ago
Miratech - Google CCAI BOT Developer

Miratech

Ahmedabad, Gujarat, India (Remote)
1 Month ago
oportun - Senior Staff AI Software Engineer

oportun

Mexico (Remote)
3 Weeks ago
Capgemini - Android Middleware Developer

Capgemini

Bengaluru, Karnataka, India (On-Site)
1 Month ago
WebFX - Full Stack JavaScript Developer (Remote PH)

WebFX

Philippines (Remote)
8 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Melbourne, Victoria, Australia

ISS Stoxx - Business Development Associate

ISS Stoxx

Sydney, New South Wales, Australia (On-Site)
2 Months ago
Thales - Senior Sales Engineer

Thales

Melbourne, Victoria, Australia (Hybrid)
1 Month ago
bazzar voice  - Strategic Account Director

bazzar voice

Sydney, New South Wales, Australia (Hybrid)
2 Months ago
Coupa - Value Solutions Consultant

Coupa

Sydney, New South Wales, Australia (Hybrid)
1 Month ago
SSC Technologies - Client Experience Account Manager

SSC Technologies

Melbourne, Victoria, Australia (Hybrid)
1 Month ago
Flying Bark Productions - Nuke Compositor

Flying Bark Productions

New South Wales, Australia (Hybrid)
3 Months ago
Nine - Deputy News Director

Nine

North Sydney, New South Wales, Australia (On-Site)
1 Month ago
Telastra - Events Technical Director

Telastra

Sydney, New South Wales, Australia (On-Site)
1 Month ago
Thales - Logistics and Warehouse Employee

Thales

Eden, New South Wales, Australia (On-Site)
2 Months ago
Framestore - Animator - Short Term - Mid & Snr

Framestore

Melbourne, Victoria, Australia (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

RoofStack - Mobile Banking Senior Business Analyst

RoofStack

Istanbul, İstanbul, Türkiye (Hybrid)
6 Months ago
Tencent - WeChat Product Management Intern

Tencent

(On-Site)
2 Months ago
GoMotive - Data Scientist, People Analytics

GoMotive

Bengaluru, Karnataka, India (Remote)
4 Months ago
beghou consulting - Sr. Consultant

beghou consulting

Boston, Massachusetts, United States (Hybrid)
8 Months ago
Ion - Data Operations ( Markets - Shared Services)

Ion

Woking, England, United Kingdom (On-Site)
9 Months ago
Xsolla - Data Warehouse Architect

Xsolla

Serbia (Remote)
9 Months ago
Rackspace Technology - Program Manager - Modern Data Platform Implementation

Rackspace Technology

Gurugram, Haryana, India (Remote)
3 Months ago
Equivalent Jobs - C++ SOFTWARE ENGINEER (MARKET DATA)

Equivalent Jobs

(Remote)
7 Months ago
Riot Games - Insights Analyst III

Riot Games

Singapore (On-Site)
9 Months ago
PropReturns - Senior Data Scientist

PropReturns

Maharashtra, India (On-Site)
10 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Melbourne, Victoria, Australia (On-Site)

Melbourne, Victoria, Australia (On-Site)

Sydney, New South Wales, Australia (On-Site)

Melbourne, Victoria, Australia (Hybrid)

Melbourne, Victoria, Australia (On-Site)

Melbourne, Victoria, Australia (On-Site)

São Paulo, Brazil (On-Site)

Melbourne, Victoria, Australia (On-Site)

Melbourne, Victoria, Australia (On-Site)

Melbourne, Victoria, Australia (On-Site)

View All Jobs

Get notified when new jobs are added by easygo

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug