Senior Engineer (Data Engineer)

2 Months ago • 4 Years + • Data Analyst

Job Summary

Job Description

As a Senior Data Engineer at Velotio, you'll design and build scalable, reliable data infrastructure. Responsibilities include building ETL/ELT pipelines, working with data lakes/warehouses, and utilizing big data technologies (Spark, Hadoop, Snowflake, Redshift). You'll leverage cloud services (AWS, GCP, Azure) for highly scalable data processing and storage. You'll also implement data quality monitoring, collaborate with business units on long-term data platform architecture, and contribute to test-driven development. Experience with big data technologies, ETL/ELT pipelines, cloud services, and Agile methodologies is crucial.
Must have:
  • Design and build scalable data infrastructure
  • Build ETL/ELT pipelines
  • Work with big data technologies (Spark, Hadoop)
  • Experience with cloud services (AWS, GCP, Azure)
  • Implement data quality monitoring
  • Collaborate with engineering teams
Good to have:
  • Experience with Redshift, Snowflake, BigQuery
  • Building Data Lakes, data warehouses, Data Marts
  • Familiarity with Jupyter Notebooks, Pandas, etc.
  • Building and deploying ML models
Perks:
  • Autonomous work culture
  • Flat hierarchy
  • Positive work environment
  • Inclusive and diverse environment

Job Details

Description

About Velotio:

Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS, IoT & Machine Learning space. Our team of 400+ elite software engineers solves hard technical problems while transforming customer ideas into successful products.

Requirements

  • Design and build scalable data infrastructure with efficiency, reliability, and consistency to meet rapidly growing data needs
  • Build the applications required for optimal extraction, cleaning, transformation, and loading data from disparate data sources and formats using the latest big data technologies
  • Building ETL/ELT pipelines and work with other data infrastructure components, like Data Lakes, Data Warehouses and BI/reporting/analytics tools
  • Work with various cloud services like AWS, GCP, Azure to implement highly available, horizontally scalable data processing and storage systems and automate manual processes and workflows
  • Implement processes and systems to monitor data quality, to ensure data is always accurate, reliable, and available for the stakeholders and other business processes that depend on it
  • Work closely with different business units and engineering teams to develop a long-term data platform architecture strategy and thus foster data-driven decision-making practices across the organization
  • Help establish and maintain a high level of operational excellence in data engineering
  • Evaluate, integrate, and build tools to accelerate Data Engineering, Data Science, Business Intelligence, Reporting, and Analytics as needed
  • Focus on building test-driven development by writing unit/integration tests
  • Contribute to design documents and engineering wiki

You will enjoy this role if you...

  • Like building elegant well-architected software products with enterprise customers
  • Want to learn to leverage public cloud services & cutting-edge big data technologies, like Spark, Airflow, Hadoop, Snowflake, and Redshift
  • Work collaboratively as part of a close-knit team of geeks, architects, and leads

Desired Skills & Experience:

  • 4+ years of data engineering or equivalent knowledge and ability
  • 4+ years software engineering or equivalent knowledge and ability
  • Strong proficiency in at least one of the following programming languages: Python, Scala, or Java
  • Experience designing and maintaining at least one type of database (Object Store, Columnar, In-memory, Relational, Tabular, Key-Value Store, Triple-store, Tuple-store, Graph, and other related database types)
  • Good understanding of star/snowflake schema designs
  • Extensive experience working with big data technologies like Spark, Hadoop, Hive
  • Experience building ETL/ELT pipelines and working on other data infrastructure components like BI/reporting/analytics tools
  • Experience working with workflow orchestration tools like Apache Airflow, Oozie, Azkaban, NiFi, Airbyte, etc.
  • Experience building production-grade data backup/restore strategies and disaster recovery solutions
  • Hands-on experience implementing batch and stream data processing applications using technologies like AWS DMS, Apache Flink, Apache Spark, AWS Kinesis, Kafka, etc.
  • Hands-on experience implementing big data solutions with tools like Snowflake, DataBricks, etc
  • Knowledge of best practices in developing and deploying applications that are highly available and scalable
  • Experience with or knowledge of Agile Software Development methodologies
  • Excellent problem-solving and troubleshooting skills
  • Process-oriented with excellent documentation skills

Bonus points if you:

  • Have hands-on experience using one or multiple cloud service providers like AWS, GCP, and Azure and have worked with specific products like EMR, Glue, DataProc, DataBricks, Snowpark, DataStudio, etc
  • Have hands-on experience working with either Redshift, Snowflake, BigQuery, Databricks, Azure Synapse or Athena and understand the inner workings of these cloud storage systems.
  • Have experience building DataLakes, scalable data warehouses, and DataMarts
  • Familiarity with tools like Jupyter Notebooks, Pandas, NumPy, SciPy, sci-kit learn, Seaborn, SparkML, etc.
  • Have experience building and deploying Machine Learning models to production at scale
  • Have experience with System Design and Architecture
  • Possess excellent cross-functional collaboration and communication skills.

Benefits

Our Culture:

  • We have an autonomous and empowered work culture encouraging individuals to take ownership and grow quickly
  • Flat hierarchy with fast decision making and a startup-oriented “get things done” culture
  • A strong, fun & positive environment with regular celebrations of our success. We pride ourselves in creating an inclusive, diverse & authentic environment

At Velotio, we embrace diversity. Inclusion is a priority for us, and we are eager to foster an environment where everyone feels valued. We welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, disability or sexual orientation.

Similar Jobs

Thousand Eyes - Senior DevOps Engineer II (Python or Golang), Engineering Effectiveness

Thousand Eyes

Austin, Texas, United States (On-Site)
2 Weeks ago
Liquid Advertising - Junior Software Engineer - Python

Liquid Advertising

Michigan, United States (Remote)
2 Months ago
Trend Micro - Inside Sales Account Manager

Trend Micro

North Sydney, New South Wales, Australia (On-Site)
3 Days ago
warner bros games - Principal Engineer- Backend (MSC Team), Bangalore

warner bros games

Bengaluru, Karnataka, India (On-Site)
10 Months ago
Illuminia - Staff Software Engineer - Front End

Illuminia

Singapore (On-Site)
2 Weeks ago
PwC - Senior Associate_ GCP Data Visualization_ Data and  Analytics_Advisory_Bengaluru

PwC

Bengaluru, Karnataka, India (On-Site)
8 Months ago
PlayStation Global - Senior Data Product Manager - Telemetry & Streaming

PlayStation Global

Carlsbad, California, United States (On-Site)
1 Month ago
Super.com - Manager, Data Analytics

Super.com

United States (Remote)
2 Months ago
Slay - Data Engineer

Slay

Berlin, Berlin, Germany (On-Site)
2 Months ago
playrix  - Senior Data Analyst (Game)

playrix

Almaty, Almaty Region, Kazakhstan (Remote)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Perplexity AI - Cloud Security Engineer

Perplexity AI

California, United States (On-Site)
1 Week ago
Stonewall Collision & Auto Painting - Senior Data Scientist

Stonewall Collision & Auto Painting

Vijayawada, Andhra Pradesh, India (On-Site)
8 Months ago
Insight Software - Software Engineer

Insight Software

Aachen, North Rhine-Westphalia, Germany (On-Site)
1 Month ago
Zelis  - Data Science Engineer / Healthcare Data Analyst

Zelis

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
Godspeed Games - Senior Backend Developer

Godspeed Games

Pune, Maharashtra, India (Remote)
3 Weeks ago
TransUnion - Mid DevOps Engineer

TransUnion

(Remote)
2 Weeks ago
Beyond Sports - System Admin/IT Support

Beyond Sports

Alkmaar, North Holland, Netherlands (On-Site)
2 Months ago
Ion - Lead Software Engineer, Italy

Ion

Pisa, Tuscany, Italy (On-Site)
7 Months ago
HCL Tech - Lead site reliability engineer

HCL Tech

Illinois, United States (On-Site)
1 Week ago
Koombea - Senior Rust Developer

Koombea

(Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Maharashtra, India

Tesla - Customer Support Supervisor

Tesla

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Google - Staff Software Engineer, Google Cloud

Google

Pune, Maharashtra, India (On-Site)
6 Months ago
Vigaet - Internship - Mechanical Engineer

Vigaet

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Capgemini - Design Concessions

Capgemini

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Quizizz - Product Designer

Quizizz

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Capgemini - Adobe Analytics Testing

Capgemini

Pune, Maharashtra, India (On-Site)
3 Weeks ago
Irdeto - Senior Software Engineer in Test

Irdeto

Noida, Uttar Pradesh, India (Hybrid)
8 Months ago
Lakshya Digital - Graphic Designer / Sr. Graphic Designer - Creative & Pop Culture Specialist

Lakshya Digital

Gurugram, Haryana, India (On-Site)
1 Month ago
Nagarro - Staff Engineer, PHP Drupal

Nagarro

India (Remote)
7 Months ago
Technorizen Software Solutions - Exp. Android Developer (1-2 years)

Technorizen Software Solutions

Indore, Madhya Pradesh, India (On-Site)
10 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

PwC - PowerBI Lead

PwC

Toronto, Ontario, Canada (On-Site)
7 Months ago
Epic Games - Senior Data Analyst, Unreal Engine & Creator Products

Epic Games

Cary, North Carolina, United States (On-Site)
4 Months ago
Google - Senior Data Scientist, Intelligent Automation and Recommendation

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Epic Games - Senior Data Analyst, Game Platform

Epic Games

Cary, North Carolina, United States (On-Site)
4 Months ago
DWS Group - Data Scientist

DWS Group

Mumbai, Maharashtra, India (Hybrid)
6 Months ago
The Walt Disney Company - Analyst, Growth & Retention Analytics

The Walt Disney Company

Buenos Aires, Buenos Aires, Argentina (On-Site)
1 Month ago
Google - Accessibility Analyst, Chrome Accessibility, Early Career

Google

Mexico City, Mexico City, Mexico (On-Site)
1 Month ago
Google - Senior Data Scientist, Product, Android App Safety

Google

Bengaluru, Karnataka, India (On-Site)
1 Month ago
PwC - IN-Senior Manager_GTM_Data and Analytics_Advisory_Bengaluru

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
PwC - Senior Associate_Azure Data Enginer_Advisory Corporate_Advisory_Bangalore Millenia

PwC

Bengaluru, Karnataka, India (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Velotio Technologies is a leading product engineering and digital solutions company working with innovative startups and enterprises across the globe. We specialize in Full-Stack development, Web & Mobile App Development, Cloud & DevOps, Data Engineering, AI/ML, UI/UX, and Quality Assurance.Since our inception in 2016, we have worked with over 110 global customers including NASDAQ-listed enterprises, unicorn startups, YCombinator and Sequoia funded companies, and cutting-edge product companies.

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

View All Jobs

Get notified when new jobs are added by velotio technologies

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug