Data Engineer

4 Months ago • 3-6 Years • Data Analyst

Job Summary

Job Description

This Data Engineer role involves designing, developing, and maintaining scalable ETL pipelines using AWS Glue and Airflow. Responsibilities include building secure data systems with AWS services and Terraform, collaborating on data transformation with dbt for analytics and machine learning, and optimizing pipelines for performance and cost-efficiency. The role also requires implementing data governance practices, building real-time pipelines using PySpark and Kinesis, and ensuring thorough testing and monitoring. The ideal candidate will have 3-6 years of experience in data engineering, proficiency in SQL, Python, or PySpark, and experience with AWS services and orchestration tools.
Must have:
  • ETL pipeline development (AWS Glue, Airflow)
  • AWS services (Redshift, Kinesis, Lambda, S3, DMS)
  • SQL, Python, or PySpark proficiency
  • Data modeling and database management
  • Real-time data pipeline experience
  • Data governance and compliance knowledge
Good to have:
  • DataOps principles
  • CI/CD pipelines
  • Agile development methodologies
  • Machine learning concepts
  • AWS certifications
Perks:
  • Championing Engineering Excellence
  • Work with top engineering talent
  • Building large-scale data pipelines
  • EAP access
  • Learning and Development Platform
  • Annual Bonuses
  • Paid volunteer day
  • Daily catered breakfast
  • On-site masseuse
  • Team lunches and happy hour
  • Fun office environment

Job Details

Are you a passionate and ambitious data engineer ready to dive into an environment that fosters innovation, continuous learning, and professional growth? We're seeking talented individuals who are eager to tackle complex big data problems, build scalable solutions, and collaborate with some of the finest engineers in the entertainment industry.

  • Complex Projects, Creative Solutions: Dive into intricate projects that challenge and push boundaries. Solve complex technical puzzles and craft scalable solutions.
  • Accelerate Your Growth: Access mentorship, training, and hands-on experiences to level up your skills. Learn from industry experts and gain expertise in scaling software.
  • Collaborate with Industry Leaders: Work alongside exceptional engineers, exchanging ideas and driving innovation forward through collaboration.
  • Caring Culture, Career Development: We deeply care about your career. Our culture prioritizes your growth with tailored learning programs and mentorship.
  • Embrace Challenges, Celebrate Success: Take on challenges, learn from failures, and celebrate achievements together.
  • Shape the Future: Your contributions will shape the future of entertainment.

About the team

You’ll be joining the Data Engineering team on an exciting mission to build a top-tier data platform that powers everything we do. We manage data from our in-house products like Stake and Kick, as well as third-party tools and services, centralising it and ensuring it’s reliable, scalable, and ready to drive smarter decisions across the business.

We’re focused on advanced data tools and services that truly make a difference. Our goal is to help teams unlock the full potential of data, empowering them to create impactful outcomes for our customers and the business. If you’re someone who loves tackling big challenges and shaping the future of data, you’ll fit right in!

Key Responsibilities:

  • Design, develop, and maintain scalable ETL pipelines using AWS Glue and orchestrate workflows with Airflow to extract, transform, and load data from various sources (e.g., databases, APIs, flat files, streaming services) into the data lake, following medallion architecture principles.
  • Build and implement secure and efficient data systems using AWS services and Terraform, ensuring performance and compliance.
  • Collaborate with cross-functional teams to transform data from the gold layer in the data lake to Redshift using dbt, enabling high-quality analytics and machine learning insights.
  • Monitor and optimise data pipelines for performance, scalability, and cost-efficiency, ensuring observability through monitoring and alerting systems.
  • Document end-to-end processes, including ingestion, transformation, storage and governance, to support knowledge sharing and scalability.
  • Implement data governance practices such as data lineage, classification, access control, and compliance with GDPR and other regulatory requirements.
  • Build and optimise real-time data pipelines using PySpark, Glue Spark, and Kinesis, focusing on Change Data Capture (CDC) for seamless operations and reliability.
  • Ensure pipelines are thoroughly tested and optimised, with comprehensive monitoring and alerting systems for reliability and performance.
  • Participate in peer code reviews to ensure adherence to best practices, coding standards, and high-quality development. 

Minimum Qualifications:

  • A Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or a related field or equivalent practical experience.
  • 3 - 6 years of experience in data engineering, with a focus on ETL development, data modelling, database management, and real-time data pipelines.
  • Proficiency in SQL, Python, or PySpark, with hands-on experience using cloud services such as Glue, Redshift, Kinesis, Lambda, S3 and DMS.
  • Experience with orchestration tools (e.g., Apache Airflow), version control systems (e.g., GitHub), and big data technologies such as Spark or Hadoop.
  • Experience designing and implementing modern cloud-based data platforms, preferably on AWS, using Infrastructure as Code (IaC) tools like Terraform.
  • Knowledge of data governance and compliance standards.
  • Strong problem-solving, analytical, and communication skills for engaging with cross-functional teams.

Preferred Qualifications 

  • Experience with DataOps principles, CI/CD pipelines, and agile development methodologies.
  • Knowledge of machine learning concepts and their application in data engineering.
  • AWS certifications (e.g., AWS Certified Solutions Architect, AWS Certified Data Analytics) or similar cloud certifications.

Some of the perks of joining us:

  • Championing Engineering Excellence to influence data driven impact across global scale software products.
  • Work alongside the top 5% of engineering talent in Australia using a vast AWS cloud native and big data technology stack.
  • Exposure to building global, large-scale volume data pipelines, data warehouses, and datalakes which are consuming requests at thousands per second frequency.
  • EAP access for you and your family
  • Access to over 9,000 courses across our Learning and Development Platform 
  • Lucrative Annual Bonuses
  • Paid volunteer day
  • Two full-time barista’s who will make your daily coffee, tea or fresh juice!
  • Daily catered breakfast
  • On-site masseuse on Wednesdays
  • Team lunches and happy hour in the office from 4pm on Fridays
  • Fun office environment with pool tables, table tennis and all your favourite gaming consoles
  • Help yourself drinks fridges and snack shelves

We believe that the unique contributions of everyone at Easygo are the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. We are passionate about providing a workplace that encourages great participation and an equal playing field, where merit and accomplishment are the only criteria for success.

Similar Jobs

Revenera - Senior Site Reliability Engineer

Revenera

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Trend Micro - Backend Engineer

Trend Micro

Manila, Metro Manila, Philippines (On-Site)
16 Years ago
Wrike - Senior Backend Engineer

Wrike

Nicosia, Nicosia, Cyprus (Hybrid)
1 Month ago
London stock Exchange - Trade Agent Senior Lead Platform Engineer

London stock Exchange

London, England, United Kingdom (On-Site)
1 Week ago
Cadence - Senior Robotic Simulation Product Architect

Cadence

Austin, Texas, United States (On-Site)
1 Month ago
Epic Games - Principal Data Analyst, Ecosystem Economy & UGC

Epic Games

(On-Site)
5 Months ago
playrix  - Data QA Engineer

playrix

Georgia (Remote)
7 Months ago
Next Level Business Services - Collibra Lead

Next Level Business Services

Dallas, Texas, United States (On-Site)
7 Months ago
Nightfall AI - Endpoint Engineer

Nightfall AI

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Varonis  - C# Software Engineer

Varonis

Herzliya, Tel Aviv District, Israel (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Unisys - Cloud Architect

Unisys

Hoofddorp, North Holland, Netherlands (On-Site)
3 Weeks ago
Omnissa - Staff Engineer - .Net Engineer

Omnissa

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
Contentstack - Senior Software Engineer I

Contentstack

Pune, Maharashtra, India (Hybrid)
3 Weeks ago
Turbulent - Senior Tools Developer

Turbulent

Montreal, Quebec, Canada (On-Site)
1 Month ago
ansira - Site Reliability Engineer

ansira

Noida, Uttar Pradesh, India (On-Site)
4 Days ago
Kaedim - DevOps Engineer

Kaedim

London, England, United Kingdom (On-Site)
9 Months ago
Fluxon - Senior Software Engineer

Fluxon

Hyderabad, Telangana, India (Remote)
3 Days ago
Infosys - .NET fullstack AWS Developer

Infosys

Juno Beach, Florida, United States (On-Site)
2 Weeks ago
London stock Exchange - Platform Principal Engineer

London stock Exchange

New York, United States (On-Site)
1 Week ago
Sporty Group - Android Engineer

Sporty Group

India (Remote)
10 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Melbourne, Victoria, Australia

ISG - Consultant – Digital Advisory

ISG

Canberra, Australian Capital Territory, Australia (Hybrid)
1 Month ago
CAE - Systems Architect

CAE

Homebush, New South Wales, Australia (Hybrid)
6 Days ago
Autodesk - Sales Manager, ANZ

Autodesk

North Sydney, New South Wales, Australia (On-Site)
2 Days ago
Triple dot studios - Product Manager

Triple dot studios

Melbourne, Victoria, Australia (Hybrid)
2 Days ago
Trek - Trek Australia - Expressions of Interest

Trek

Canberra, Australian Capital Territory, Australia (On-Site)
4 Months ago
Aristocrat Gaming - Sales Manager - NSW Metro

Aristocrat Gaming

North Ryde, New South Wales, Australia (Hybrid)
2 Months ago
Yahoo - Senior Platform Solutions Lead

Yahoo

Sydney, New South Wales, Australia (Hybrid)
1 Week ago
Wolters Kluwer - Senior Business Development Manager

Wolters Kluwer

Melbourne, Victoria, Australia (Hybrid)
1 Day ago
Immutable - Lead Designer

Immutable

Sydney, New South Wales, Australia (Hybrid)
1 Month ago
Canva - Backend Software Engineer - (Java) - Design Gateway

Canva

Sydney, New South Wales, Australia (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

playrix  - Senior Data Analyst (Attribution)

playrix

Ukraine (Remote)
7 Months ago
Tencent - Marketing Data Analyst (深圳)

Tencent

Shenzhen, Guangdong Province, China (On-Site)
7 Months ago
Nagarro - Staff Engineer

Nagarro

Sri Lanka (Remote)
7 Months ago
playrix  - Data QA Engineer

playrix

Ukraine (Remote)
7 Months ago
Axinous - Associate, Strategic Finance/Investor Relations

Axinous

Hyderabad, Telangana, India (Remote)
2 Months ago
The Walt Disney Company - Senior Software Engineer, Data Reliability

The Walt Disney Company

Santa Monica, California, United States (On-Site)
1 Month ago
MPOWER Financing - Data Engineer - Data - Bangalore, India

MPOWER Financing

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Scopely - Data Analyst, Marketing Analytics

Scopely

Mexico City, Mexico City, Mexico (Hybrid)
3 Months ago
Google - Open Career Opportunities, Verily Life Sciences

Google

Mountain View, California, United States (On-Site)
7 Months ago
Meta - Data Engineer Intern

Meta

Menlo Park, California, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Bogotá, Bogota, Colombia (On-Site)

Melbourne, Victoria, Australia (On-Site)

Sydney, New South Wales, Australia (On-Site)

Sydney, New South Wales, Australia (On-Site)

Melbourne, Victoria, Australia (On-Site)

Bogotá, Bogota, Colombia (On-Site)

Melbourne, Victoria, Australia (On-Site)

Lima, Callao Region, Peru (On-Site)

Melbourne, Victoria, Australia (On-Site)

Melbourne, Victoria, Australia (Hybrid)

View All Jobs

Get notified when new jobs are added by easygo

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug