Data Engineer

2 Months ago • 3-6 Years • Data Analyst

Job Summary

Job Description

This Data Engineer role involves designing, developing, and maintaining scalable ETL pipelines using AWS Glue and Airflow. Responsibilities include building secure data systems with AWS services and Terraform, collaborating on data transformation with dbt for analytics and machine learning, and optimizing pipelines for performance and cost-efficiency. The role also requires implementing data governance practices, building real-time pipelines using PySpark and Kinesis, and ensuring thorough testing and monitoring. The ideal candidate will have 3-6 years of experience in data engineering, proficiency in SQL, Python, or PySpark, and experience with AWS services and orchestration tools.
Must have:
  • ETL pipeline development (AWS Glue, Airflow)
  • AWS services (Redshift, Kinesis, Lambda, S3, DMS)
  • SQL, Python, or PySpark proficiency
  • Data modeling and database management
  • Real-time data pipeline experience
  • Data governance and compliance knowledge
Good to have:
  • DataOps principles
  • CI/CD pipelines
  • Agile development methodologies
  • Machine learning concepts
  • AWS certifications
Perks:
  • Championing Engineering Excellence
  • Work with top engineering talent
  • Building large-scale data pipelines
  • EAP access
  • Learning and Development Platform
  • Annual Bonuses
  • Paid volunteer day
  • Daily catered breakfast
  • On-site masseuse
  • Team lunches and happy hour
  • Fun office environment

Job Details

Are you a passionate and ambitious data engineer ready to dive into an environment that fosters innovation, continuous learning, and professional growth? We're seeking talented individuals who are eager to tackle complex big data problems, build scalable solutions, and collaborate with some of the finest engineers in the entertainment industry.

  • Complex Projects, Creative Solutions: Dive into intricate projects that challenge and push boundaries. Solve complex technical puzzles and craft scalable solutions.
  • Accelerate Your Growth: Access mentorship, training, and hands-on experiences to level up your skills. Learn from industry experts and gain expertise in scaling software.
  • Collaborate with Industry Leaders: Work alongside exceptional engineers, exchanging ideas and driving innovation forward through collaboration.
  • Caring Culture, Career Development: We deeply care about your career. Our culture prioritizes your growth with tailored learning programs and mentorship.
  • Embrace Challenges, Celebrate Success: Take on challenges, learn from failures, and celebrate achievements together.
  • Shape the Future: Your contributions will shape the future of entertainment.

About the team

You’ll be joining the Data Engineering team on an exciting mission to build a top-tier data platform that powers everything we do. We manage data from our in-house products like Stake and Kick, as well as third-party tools and services, centralising it and ensuring it’s reliable, scalable, and ready to drive smarter decisions across the business.

We’re focused on advanced data tools and services that truly make a difference. Our goal is to help teams unlock the full potential of data, empowering them to create impactful outcomes for our customers and the business. If you’re someone who loves tackling big challenges and shaping the future of data, you’ll fit right in!

Key Responsibilities:

  • Design, develop, and maintain scalable ETL pipelines using AWS Glue and orchestrate workflows with Airflow to extract, transform, and load data from various sources (e.g., databases, APIs, flat files, streaming services) into the data lake, following medallion architecture principles.
  • Build and implement secure and efficient data systems using AWS services and Terraform, ensuring performance and compliance.
  • Collaborate with cross-functional teams to transform data from the gold layer in the data lake to Redshift using dbt, enabling high-quality analytics and machine learning insights.
  • Monitor and optimise data pipelines for performance, scalability, and cost-efficiency, ensuring observability through monitoring and alerting systems.
  • Document end-to-end processes, including ingestion, transformation, storage and governance, to support knowledge sharing and scalability.
  • Implement data governance practices such as data lineage, classification, access control, and compliance with GDPR and other regulatory requirements.
  • Build and optimise real-time data pipelines using PySpark, Glue Spark, and Kinesis, focusing on Change Data Capture (CDC) for seamless operations and reliability.
  • Ensure pipelines are thoroughly tested and optimised, with comprehensive monitoring and alerting systems for reliability and performance.
  • Participate in peer code reviews to ensure adherence to best practices, coding standards, and high-quality development. 

Minimum Qualifications:

  • A Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or a related field or equivalent practical experience.
  • 3 - 6 years of experience in data engineering, with a focus on ETL development, data modelling, database management, and real-time data pipelines.
  • Proficiency in SQL, Python, or PySpark, with hands-on experience using cloud services such as Glue, Redshift, Kinesis, Lambda, S3 and DMS.
  • Experience with orchestration tools (e.g., Apache Airflow), version control systems (e.g., GitHub), and big data technologies such as Spark or Hadoop.
  • Experience designing and implementing modern cloud-based data platforms, preferably on AWS, using Infrastructure as Code (IaC) tools like Terraform.
  • Knowledge of data governance and compliance standards.
  • Strong problem-solving, analytical, and communication skills for engaging with cross-functional teams.

Preferred Qualifications 

  • Experience with DataOps principles, CI/CD pipelines, and agile development methodologies.
  • Knowledge of machine learning concepts and their application in data engineering.
  • AWS certifications (e.g., AWS Certified Solutions Architect, AWS Certified Data Analytics) or similar cloud certifications.

Some of the perks of joining us:

  • Championing Engineering Excellence to influence data driven impact across global scale software products.
  • Work alongside the top 5% of engineering talent in Australia using a vast AWS cloud native and big data technology stack.
  • Exposure to building global, large-scale volume data pipelines, data warehouses, and datalakes which are consuming requests at thousands per second frequency.
  • EAP access for you and your family
  • Access to over 9,000 courses across our Learning and Development Platform 
  • Lucrative Annual Bonuses
  • Paid volunteer day
  • Two full-time barista’s who will make your daily coffee, tea or fresh juice!
  • Daily catered breakfast
  • On-site masseuse on Wednesdays
  • Team lunches and happy hour in the office from 4pm on Fridays
  • Fun office environment with pool tables, table tennis and all your favourite gaming consoles
  • Help yourself drinks fridges and snack shelves

We believe that the unique contributions of everyone at Easygo are the driver of our success. To make sure that our products and culture continue to incorporate everyone's perspectives and experience we never discriminate on the basis of race, religion, national origin, gender identity or expression, sexual orientation, age, or marital, veteran, or disability status. We are passionate about providing a workplace that encourages great participation and an equal playing field, where merit and accomplishment are the only criteria for success.

Similar Jobs

Progres - Senior Full-Stack Developer

Progres

Sofia, Sofia City Province, Bulgaria (Hybrid)
3 Months ago
Gitlab - Director, Technical Writing

Gitlab

(Remote)
5 Hours ago
bosh group india - 2024_MS_EDE3_XC_SRE_DataEngineering

bosh group india

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Fluence - Controls Software Engineer-II(m/f/d)

Fluence

Erlangen, Bavaria, Germany (Hybrid)
6 Months ago
Gala games - Engineering Tech Lead

Gala games

Pakistan (On-Site)
1 Month ago
PwC - Senior BI/Data analyst – Technology Consulting

PwC

Prague, Prague, Czechia (On-Site)
6 Months ago
Game District - Data Analyst

Game District

Punjab, Pakistan (On-Site)
2 Months ago
Google - Data Transformation Lead, Specialty Retail

Google

San Francisco, California, United States (On-Site)
2 Weeks ago
Equivalent Jobs - SENIOR FINANCIAL DATA SYSTEMS ENGINEER

Equivalent Jobs

(Remote)
5 Months ago
Google - Business Data Scientist

Google

Chicago, Illinois, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Boomi - Senior Quality Engineer

Boomi

Pune, Maharashtra, India (On-Site)
1 Day ago
Aristocrat Gaming - Project Manager - AREA Suite of Apps

Aristocrat Gaming

Las Vegas, Nevada, United States (Hybrid)
1 Week ago
Glean - Technical Writer

Glean

Bengaluru, Karnataka, India (Hybrid)
6 Hours ago
Western Digital - Engineer, Manufacturing Equipment Engineering

Western Digital

Prachin Buri, Thailand (On-Site)
1 Day ago
Blackshark - Software Engineer

Blackshark

Graz, Styria, Austria (Hybrid)
4 Months ago
Lytx - Senior DevOps Engineer

Lytx

Haifa, Haifa District, Israel (Hybrid)
18 Hours ago
ION - Senior Software Engineer - Full Stack

ION

Pune, Maharashtra, India (On-Site)
6 Months ago
Futurum Technology  - DevOps Engineer (Python Focus)

Futurum Technology

Kraków, Lesser Poland Voivodeship, Poland (Remote)
1 Month ago
Springer Nature - Senior Data Engineer

Springer Nature

Pune, Maharashtra, India (Hybrid)
5 Months ago
Wargaming - Lead Automation QA (World of Warships, PC)

Wargaming

Belgrade, Serbia (Hybrid)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Melbourne, Victoria, Australia

Google - Senior Software Engineer, Android Security

Google

Sydney, New South Wales, Australia (On-Site)
2 Weeks ago
Canva - Senior Frontend Engineer - Organising Content

Canva

Brisbane, Queensland, Australia (Remote)
4 Weeks ago
Nine - Full Stack Software Engineer

Nine

North Sydney, New South Wales, Australia (On-Site)
2 Weeks ago
Microsoft - Director, AI Advertising Acceleration

Microsoft

Sydney, New South Wales, Australia (On-Site)
2 Weeks ago
Altagram Group - APAC Localization Engineer - Video Game Localization

Altagram Group

Victoria, Australia (Remote)
1 Month ago
Flying Bark Productions - Senior 3D Modeller

Flying Bark Productions

New South Wales, Australia (Hybrid)
1 Month ago
Canva - Senior Machine Learning Engineer - Specialist Platform and Experience

Canva

Surry Hills, New South Wales, Australia (Remote)
1 Month ago
Canva - Staff Backend Engineer - Product Insights Enablement - Java

Canva

Melbourne, Victoria, Australia (Remote)
2 Months ago
Canva - Senior Frontend Engineer - Canva Docs

Canva

Sydney, New South Wales, Australia (Remote)
1 Month ago
Canva - B2B Growth Marketing Specialist, Enterprise

Canva

Melbourne, Victoria, Australia (Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

PlayStation Global - Senior Data Product Manager - Telemetry & Streaming

PlayStation Global

Carlsbad, California, United States (On-Site)
3 Weeks ago
Bungie - Contract Senior Analyst - Destiny

Bungie

(Hybrid)
1 Month ago
Lifelancer - Senior Data Scientist

Lifelancer

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Eneba Games - Head of Data

Eneba Games

(Remote)
2 Months ago
Meta - Data Scientist, Product Analytics

Meta

Los Angeles, California, United States (Remote)
1 Week ago
ION - Internship - Data Science

ION

London, England, United Kingdom (On-Site)
6 Months ago
Peak - Big Data Platform Engineer - Java/Go

Peak

(On-Site)
1 Month ago
Google - Senior Technical Program Manager, Advanced Infrastructure Solutions

Google

Chicago, Illinois, United States (On-Site)
2 Days ago
PwC - Senior Data Engineer

PwC

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
7 Months ago
Microsoft - Senior Data Scientist

Microsoft

(On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Easygo is a well-established global tech startup, we pride ourselves on being early adopters, progressive in our approach and adaptable to the ever-changing technology landscape. Our core focus is in the online gaming space building well-designed casino games, crypto platforms, and sportsbooks built on our "provably fair"​ algorithms. The products we build are used by millions of people around the world including Drake and you’ll see their logos on an EPL team, the UFC, advocated by e-gamers and in a number of other sporting places.

The last 2 years have been huge for us, we have grown from 20 to 100+ team members. Whilst the products that we build are global we have two amazing offices in the same building in the heart of the CBD with all the bells and whistles you could ever want. Including an in-house barista, pool, and table tennis tables, PS5 and Nintendo Switches, a meditation room, help yourself drinks fridge and snack wall, catered breakfast daily, weekly massages and team lunch. 

Melbourne, Victoria, Australia (On-Site)

Melbourne, Victoria, Australia (On-Site)

Melbourne, Victoria, Australia (On-Site)

Melbourne, Victoria, Australia (On-Site)

Melbourne, Victoria, Australia (On-Site)

Melbourne, Victoria, Australia (On-Site)

Bogotá, Bogota, Colombia (On-Site)

Melbourne, Victoria, Australia (On-Site)

Lima, Callao Region, Peru (Remote)

Melbourne, Victoria, Australia (On-Site)

View All Jobs

Get notified when new jobs are added by Easygo

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug