Data Engineer

5 Months ago • 2 Years + • Data Analyst

Job Summary

Job Description

Avathon seeks a Data Engineer with 2+ years of experience building and optimizing big data pipelines, architectures, and datasets. Expertise in Python, ETL pipelines from large datasets, and big data tools like Hadoop, Spark, Kafka, and Postgres is essential. Experience with Elasticsearch and AWS cloud services is a plus.
Must have:
  • Python experience
  • ETL pipelines
  • Big data tools
  • Relational databases
Good to have:
  • Renewable energy
  • Workflow orchestration
  • AWS cloud services
  • Elasticsearch
Perks:
  • Clean energy
  • Startup experience

Job Details

About the job

Who are we and why this opportunity?

Avathon, Inc. delivers world-class AI solutions that allow a business to solve their most critical problems, empowering them to run a more sustainable, safer, and profitable business. Our award-winning AI solutions predict future outcomes, optimize processes, and prevent cyberattacks. We partner with the world’s industry leaders to analyze, optimize, and learn from data. We augment human intelligence, drive profitable growth, and achieve operational excellence.

Drive change and create a footprint. Learn more at: Avathon

Position Summary

Avathon’s Renewable Suite is the world's leading AI enabled SaaS platform that provides asset performance management and prescriptive analytics software to ever growing renewable energy power plants by combining the power of machine learning, big data, and deep domain expertise. Our platform works across multiple asset types such as wind, solar, storage and DC coupled assets to offer insights to our customers across their fleets. As a Data Engineer you will be working closely with team members across domains with deep technical skills and passion for clean energy.

Join Us In

  • Bringing large volumes of data from wind, solar, storage sites to cloud
  • Architecting scalable data ETL and MLOps pipelines and workflows
  • Work on engineering projects to design, construct, install, test and maintain highly scalable data management systems

You’ll Have

  • Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
  • Experience with Python
  • 2+ years of experience building and optimizing ‘big data’ data pipelines, architectures and data sets. Startup experience a plus
  • Experience building ETL pipelines from large disconnected datasets.
  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with relational databases such as Postgres
  • Experience with Elasticsearch a plus

It Would Be Great If You Had

  • Experience in renewable energy or IoT time series data
  • Experience in workflow orchestration technologies like Airflow or Prefect
  • Experience with AWS cloud services: EC2, EMR, S3, RDS, Redshift or experience with GCP

Avathon is an equal opportunity employer, dedicated to diversity, equality, and inclusion, and provides equal employment opportunities to all employees and applicants for employment.

Avathon prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

Avathon is committed to providing reasonable accommodations throughout the recruiting process. If you need a reasonable accommodation, please contact us to discuss how we can assist you.

Similar Jobs

Flying Bark Productions - Senior 3D Modeller

Flying Bark Productions

New South Wales, Australia (Hybrid)
3 Weeks ago
NVIDIA - Senior Software Engineer, VLSI Design Tools

NVIDIA

Santa Clara, California, United States (On-Site)
4 Weeks ago
Epic Games - Senior Technical Designer

Epic Games

Vancouver, British Columbia, Canada (On-Site)
2 Months ago
PwC - Senior Associate - Consulting - Strategy & Operations - Talent Pool

PwC

Jakarta, Jakarta, Indonesia (On-Site)
6 Months ago
Onward Search - Senior Market Research Manager

Onward Search

Boston, Massachusetts, United States (Remote)
1 Week ago
PwC - IN-Senior Associate _.Net Developer _Data & Analytics _Advisory _PAN India

PwC

Kolkata, West Bengal, India (On-Site)
5 Months ago
Epic Games - Marketing Performance Manager

Epic Games

(On-Site)
2 Months ago
Knuddels - Backend Development and Data Science Internship

Knuddels

Baden-Württemberg, Germany (Remote)
6 Days ago
Canva - Senior Accessibility Compliance Analyst

Canva

Brisbane, Queensland, Australia (Remote)
6 Days ago
Wildlife Studios - Data Engineer

Wildlife Studios

São Paulo, State Of São Paulo, Brazil (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

prizepicks - Data Scientist - Simulation/Sports Modeling

prizepicks

Atlanta, Georgia, United States (Remote)
1 Week ago
Flying Bark Productions - Senior 3D Modeller

Flying Bark Productions

New South Wales, Australia (Hybrid)
3 Weeks ago
Riot Games - Senior User Researcher

Riot Games

Shanghai, Shanghai, China (On-Site)
8 Months ago
Evolution - Backend Developer - Distributed Services

Evolution

Stockholm, Stockholm County, Sweden (On-Site)
5 Months ago
Tripledot Studios - Technical Artist

Tripledot Studios

London, England, United Kingdom (Hybrid)
1 Month ago
Blue Yonder - Sr Solution Architect

Blue Yonder

Dallas, Texas, United States (On-Site)
5 Months ago
Far Out Scout - Senior Back End Engineer

Far Out Scout

Brazil (Remote)
1 Week ago
MyGames - 3D HTML5 Playable Ads Developer

MyGames

(Remote)
1 Month ago
NVIDIA - Director of AI Research

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Epic Games - Senior Technical Designer

Epic Games

Montreal, Quebec, Canada (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Nagarro - Principal Engineer, ETL

Nagarro

India (Remote)
5 Months ago
Omnissa - Staff Engineer (Data Science)

Omnissa

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
PwC - Senior Associate-SAP SD

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
NinjaVan - Senior Full Stack Engineer

NinjaVan

Hyderabad, Telangana, India (On-Site)
5 Months ago
Rackspace Technology - SAP FICO Business Systems Consultant IV

Rackspace Technology

Gurugram, Haryana, India (Remote)
6 Days ago
KLA - Analyst, Info Sys 4

KLA

Chennai, Tamil Nadu, India (On-Site)
6 Months ago
Hitachi - Azure Data Engineer (MS)

Hitachi

Pune, Maharashtra, India (Remote)
5 Months ago
Lakshya Digital - QC Artist

Lakshya Digital

Maharashtra, India (On-Site)
5 Days ago
NVIDIA - High Speed IO Validation Engineer

NVIDIA

Bengaluru, Karnataka, India (Hybrid)
1 Week ago
Zones - Azure Backend Developer

Zones

Bengaluru, Karnataka, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

PwC - IFS-Operate-Data Analytics- Associate-Kolkata

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
CloudHire - Data Labeler

CloudHire

Karnataka, India (Remote)
1 Week ago
Ubisoft - Legal Counsel Data Protection Assistant Intern

Ubisoft

Paris, Île-de-France, France (On-Site)
6 Days ago
PwC - Senior BI/Data analyst – Technology Consulting

PwC

Prague, Prague, Czechia (On-Site)
5 Months ago
ION - Data Operations ( Markets - Shared Services)

ION

Woking, England, United Kingdom (On-Site)
5 Months ago
Tencent - Data Engineer Intern

Tencent

(On-Site)
1 Month ago
SmileGate - Management Strategy Planning

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
1 Week ago
Tencent - Game Operation Manager

Tencent

Shenzhen, Guangdong Province, China (On-Site)
4 Months ago
Google - Open Career Opportunities, Verily Life Sciences

Google

(On-Site)
3 Months ago
The Walt Disney Company - Lead Data Engineer, Data Reliability

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Avathon

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug