Data Engineer

5 Days ago • 1 Years + • Data Analyst

Job Summary

Job Description

Design and build scalable, reliable data infrastructure. Build applications for optimal data extraction, cleaning, transformation, and loading from diverse sources using big data technologies. Develop ETL/ELT pipelines and work with data lakes, warehouses, and BI tools. Utilize cloud services (AWS, GCP, Azure) for highly available data processing and storage. Implement data quality monitoring processes. Collaborate with business units to develop long-term data platform architecture. Establish operational excellence in data engineering. Evaluate and integrate tools to accelerate data engineering, data science, and analytics. Write unit/integration tests. Contribute to design documents.
Must have:
  • Build scalable data infrastructure
  • ETL/ELT pipeline development
  • Big data technologies (Spark, Hadoop)
  • Cloud experience (AWS, GCP, Azure)
  • Data quality monitoring
  • Python, Scala, or Java proficiency
  • Database design experience
Good to have:
  • Redshift/Snowflake/BigQuery experience
  • Data Lake/warehouse experience
  • Airflow/similar workflow tools
  • Machine learning model deployment
  • Agile methodologies

Job Details

Description

Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS, IoT & Machine Learning space. Our team of 400+ elite software engineers solves hard technical problems while transforming customer ideas into successful products.

Requirements

  • Design and build scalable data infrastructure with efficiency, reliability, and consistency to meet rapidly growing data needs
  • Build the applications required for optimal extraction, cleaning, transformation, and loading data from disparate data sources and formats using the latest big data technologies
  • Building ETL/ELT pipelines and work with other data infrastructure components, like Data Lakes, Data Warehouses and BI/reporting/analytics tools
  • Work with various cloud services like AWS, GCP, Azure to implement highly available, horizontally scalable data processing and storage systems and automate manual processes and workflows
  • Implement processes and systems to monitor data quality, to ensure data is always accurate, reliable, and available for the stakeholders and other business processes that depend on it
  • Work closely with different business units and engineering teams to develop a long-term data platform architecture strategy and thus foster data-driven decision-making practices across the organization
  • Help establish and maintain a high level of operational excellence in data engineering
  • Evaluate, integrate, and build tools to accelerate Data Engineering, Data Science, Business Intelligence, Reporting, and Analytics as needed
  • Focus on building test-driven development by writing unit/integration tests
  • Contribute to design documents and engineering wiki

You will enjoy this role if you...

  • Like building elegant well-architected software products with enterprise customers
  • Want to learn to leverage public cloud services & cutting-edge big data technologies, like Spark, Airflow, Hadoop, Snowflake, and Redshift
  • Work collaboratively as part of a close-knit team of geeks, architects, and leads

Desired Skills & Experience:

  • 1+ years of data engineering or equivalent knowledge and ability
  • 1+ years software engineering or equivalent knowledge and ability
  • Strong proficiency in at least one of the following programming languages: Python, Scala, or Java
  • Experience designing and maintaining at least one type of database (Object Store, Columnar, In-memory, Relational, Tabular, Key-Value Store, Triple-store, Tuple-store, Graph, and other related database types)
  • Good understanding of star/snowflake schema designs
  • Extensive experience working with big data technologies like Spark, Hadoop, Hive
  • Experience building ETL/ELT pipelines and working on other data infrastructure components like BI/reporting/analytics tools
  • Experience working with workflow orchestration tools like Apache Airflow, Oozie, Azkaban, NiFi, Airbyte, etc.
  • Experience building production-grade data backup/restore strategies and disaster recovery solutions
  • Hands-on experience with implementing batch and stream data processing applications using technologies like AWS DMS, Apache Flink, Apache Spark, AWS Kinesis, Kafka, etc.
  • Knowledge of best practices in developing and deploying applications that are highly available and scalable
  • Experience with or knowledge of Agile Software Development methodologies
  • Excellent problem-solving and troubleshooting skills
  • Process-oriented with excellent documentation skills

Bonus points if you:

  • Have hands-on experience using one or multiple cloud service providers like AWS, GCP, Azure and have worked with specific products like EMR, Glue, DataProc, DataBricks, DataStudio, etc
  • Have hands-on experience working with either Redshift, Snowflake, BigQuery, Azure Synapse, or Athena and understand the inner workings of these cloud storage systems
  • Have experience building DataLakes, scalable data warehouses, and DataMarts
  • Have familiarity with tools like Jupyter Notebooks, Pandas, NumPy, SciPy, sci-kit learn, Seaborn, SparkML, etc.
  • Have experience building and deploying Machine Learning models to production at scale
  • Possess excellent cross-functional collaboration and communication skills

Benefits

Our Culture:

  • We have an autonomous and empowered work culture encouraging individuals to take ownership and grow quickly
  • Flat hierarchy with fast decision making and a startup-oriented “get things done” culture
  • A strong, fun & positive environment with regular celebrations of our success. We pride ourselves in creating an inclusive, diverse & authentic environment

At Velotio, we embrace diversity. Inclusion is a priority for us, and we are eager to foster an environment where everyone feels valued. We welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, disability or sexual orientation.

Similar Jobs

Tencent - Tencent Cloud Technical Account Manager

Tencent

California, United States (On-Site)
1 Month ago
CloudHire - Full Stack Developer - Angular & Node

CloudHire

Mumbai, Maharashtra, India (Remote)
6 Days ago
Warner Bros Games - Principal Engineer - Backend (MSC Team)

Warner Bros Games

(Hybrid)
1 Month ago
Barracuda Networks  Inc  - Principal Application Security Engineer

Barracuda Networks Inc

Ontario, Canada (Remote)
1 Week ago
Sony Interactive Entertainment - Software QA Engineer (PlayStation System Software/Game Title Verification)

Sony Interactive Entertainment

Tokyo, Japan (On-Site)
2 Months ago
Ubisoft - Data Director

Ubisoft

Singapore, Singapore (On-Site)
1 Week ago
MyGames - Analyst Developer

MyGames

(Remote)
1 Week ago
ION - Buyer, Italy

ION

Italy (Hybrid)
5 Months ago
Zazz - Data Engineer

Zazz

(Remote)
2 Months ago
ION - UK Holdings - India - 854

ION

Mumbai, Maharashtra, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Krafton  - Game Security Platform Engineer

Krafton

Seoul, South Korea (On-Site)
1 Day ago
Flying Bark Productions - DevOps Engineer

Flying Bark Productions

Sydney, New South Wales, Australia (Hybrid)
6 Days ago
Microsoft - Member of Technical Staff, Infrastructure Engineer

Microsoft

Mountain View, California, United States (Hybrid)
1 Week ago
Trend Micro - Data Scientist

Trend Micro

Manila, Metro Manila, Philippines (On-Site)
15 Years ago
ARHS - AWS or Azure Cloud Architect

ARHS

Luxembourg (On-Site)
5 Months ago
Aristocrat Gaming - Senior Solutions Architect

Aristocrat Gaming

London, England, United Kingdom (Hybrid)
3 Days ago
ByteDance - Site Reliability Engineer, Traffic Platform

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Activision - Senior Machine Learning Operations Engineer

Activision

Los Angeles, California, United States (Remote)
6 Days ago
Warner Bros Games - Senior Data Engineer

Warner Bros Games

Hyderabad, Telangana, India (Hybrid)
1 Week ago
PwC - Senior Manager_Data Engineering_D&A_Advisory _Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Pune, Maharashtra, India

Sportskeeda - Content Editor (Picks4Sure)

Sportskeeda

India (Remote)
2 Months ago
Anthology  Inc  - Associate Software Engineer II

Anthology Inc

Bengaluru, Karnataka, India (On-Site)
6 Days ago
Hike - Lead Marketing Manager - Paid

Hike

Delhi, India (Remote)
5 Days ago
PwC - IN_Associate – Crm Technical -Ms Dynamics– Advisory -Hyderabad

PwC

Hyderabad, Telangana, India (On-Site)
4 Months ago
Outscal - Video Editor

Outscal

Delhi, India (On-Site)
4 Months ago
Abnormal Security - Software Engineer - II, Backend

Abnormal Security

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Hitachi - Terraform with DevOps

Hitachi

Pune, Maharashtra, India (On-Site)
5 Months ago
Valeo - Site Management Controller

Valeo

Chennai, Tamil Nadu, India (On-Site)
5 Months ago
Blue Yonder - Bug Bounty Technical Lead- (Vulnerability disclosure (VDP))

Blue Yonder

Hyderabad, Telangana, India (On-Site)
6 Months ago
Xentrix Studios - Lighting – Senior Artist

Xentrix Studios

India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Onward Search - Senior Business Systems Analyst

Onward Search

(Remote)
1 Week ago
Aristocrat Gaming - Business Analyst

Aristocrat Gaming

Austin, Texas, United States (Hybrid)
3 Days ago
Playrix - Senior Data Analyst (Attribution)

Playrix

Georgia (Remote)
5 Months ago
Canva - Full-stack Software Engineer (Java + JavaScript) - Data Platform

Canva

Surry Hills, New South Wales, Australia (Remote)
5 Days ago
Digital Extremes - Senior Data Engineer

Digital Extremes

(Remote)
1 Week ago
Epic Games - Senior Data Analyst

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
Zazz - Data Engineer (6–8 Years) Adhoc

Zazz

India (On-Site)
3 Months ago
EXUSIA - Azure Databricks / Python / PySpark Senior Data Engineer

EXUSIA

Hyderabad, Telangana, India (Remote)
5 Days ago
Amanotes - Senior Game Data Analyst (Based in HCM)

Amanotes

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
10 Months ago
Go Fund Me - Staff Data Scientist

Go Fund Me

San Francisco, California, United States (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Maharashtra, India (Remote)

Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

View All Jobs

Get notified when new jobs are added by Velotio Technologies

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug