Senior Engineer (Data Engineer)

4 Months ago • 4 Years + • Data Analysis

Job Summary

Job Description

As a Senior Data Engineer at Velotio, you'll design and build scalable, reliable data infrastructure. Responsibilities include building ETL/ELT pipelines, working with data lakes/warehouses, and utilizing big data technologies (Spark, Hadoop, Snowflake, Redshift). You'll leverage cloud services (AWS, GCP, Azure) for highly scalable data processing and storage. You'll also implement data quality monitoring, collaborate with business units on long-term data platform architecture, and contribute to test-driven development. Experience with big data technologies, ETL/ELT pipelines, cloud services, and Agile methodologies is crucial.
Must have:
  • Design and build scalable data infrastructure
  • Build ETL/ELT pipelines
  • Work with big data technologies (Spark, Hadoop)
  • Experience with cloud services (AWS, GCP, Azure)
  • Implement data quality monitoring
  • Collaborate with engineering teams
Good to have:
  • Experience with Redshift, Snowflake, BigQuery
  • Building Data Lakes, data warehouses, Data Marts
  • Familiarity with Jupyter Notebooks, Pandas, etc.
  • Building and deploying ML models
Perks:
  • Autonomous work culture
  • Flat hierarchy
  • Positive work environment
  • Inclusive and diverse environment

Job Details

Description

About Velotio:

Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS, IoT & Machine Learning space. Our team of 400+ elite software engineers solves hard technical problems while transforming customer ideas into successful products.

Requirements

  • Design and build scalable data infrastructure with efficiency, reliability, and consistency to meet rapidly growing data needs
  • Build the applications required for optimal extraction, cleaning, transformation, and loading data from disparate data sources and formats using the latest big data technologies
  • Building ETL/ELT pipelines and work with other data infrastructure components, like Data Lakes, Data Warehouses and BI/reporting/analytics tools
  • Work with various cloud services like AWS, GCP, Azure to implement highly available, horizontally scalable data processing and storage systems and automate manual processes and workflows
  • Implement processes and systems to monitor data quality, to ensure data is always accurate, reliable, and available for the stakeholders and other business processes that depend on it
  • Work closely with different business units and engineering teams to develop a long-term data platform architecture strategy and thus foster data-driven decision-making practices across the organization
  • Help establish and maintain a high level of operational excellence in data engineering
  • Evaluate, integrate, and build tools to accelerate Data Engineering, Data Science, Business Intelligence, Reporting, and Analytics as needed
  • Focus on building test-driven development by writing unit/integration tests
  • Contribute to design documents and engineering wiki

You will enjoy this role if you...

  • Like building elegant well-architected software products with enterprise customers
  • Want to learn to leverage public cloud services & cutting-edge big data technologies, like Spark, Airflow, Hadoop, Snowflake, and Redshift
  • Work collaboratively as part of a close-knit team of geeks, architects, and leads

Desired Skills & Experience:

  • 4+ years of data engineering or equivalent knowledge and ability
  • 4+ years software engineering or equivalent knowledge and ability
  • Strong proficiency in at least one of the following programming languages: Python, Scala, or Java
  • Experience designing and maintaining at least one type of database (Object Store, Columnar, In-memory, Relational, Tabular, Key-Value Store, Triple-store, Tuple-store, Graph, and other related database types)
  • Good understanding of star/snowflake schema designs
  • Extensive experience working with big data technologies like Spark, Hadoop, Hive
  • Experience building ETL/ELT pipelines and working on other data infrastructure components like BI/reporting/analytics tools
  • Experience working with workflow orchestration tools like Apache Airflow, Oozie, Azkaban, NiFi, Airbyte, etc.
  • Experience building production-grade data backup/restore strategies and disaster recovery solutions
  • Hands-on experience implementing batch and stream data processing applications using technologies like AWS DMS, Apache Flink, Apache Spark, AWS Kinesis, Kafka, etc.
  • Hands-on experience implementing big data solutions with tools like Snowflake, DataBricks, etc
  • Knowledge of best practices in developing and deploying applications that are highly available and scalable
  • Experience with or knowledge of Agile Software Development methodologies
  • Excellent problem-solving and troubleshooting skills
  • Process-oriented with excellent documentation skills

Bonus points if you:

  • Have hands-on experience using one or multiple cloud service providers like AWS, GCP, and Azure and have worked with specific products like EMR, Glue, DataProc, DataBricks, Snowpark, DataStudio, etc
  • Have hands-on experience working with either Redshift, Snowflake, BigQuery, Databricks, Azure Synapse or Athena and understand the inner workings of these cloud storage systems.
  • Have experience building DataLakes, scalable data warehouses, and DataMarts
  • Familiarity with tools like Jupyter Notebooks, Pandas, NumPy, SciPy, sci-kit learn, Seaborn, SparkML, etc.
  • Have experience building and deploying Machine Learning models to production at scale
  • Have experience with System Design and Architecture
  • Possess excellent cross-functional collaboration and communication skills.

Benefits

Our Culture:

  • We have an autonomous and empowered work culture encouraging individuals to take ownership and grow quickly
  • Flat hierarchy with fast decision making and a startup-oriented “get things done” culture
  • A strong, fun & positive environment with regular celebrations of our success. We pride ourselves in creating an inclusive, diverse & authentic environment

At Velotio, we embrace diversity. Inclusion is a priority for us, and we are eager to foster an environment where everyone feels valued. We welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, disability or sexual orientation.

Similar Jobs

Glean - Cloud Infrastructure Engineer

Glean

Palo Alto, California, United States (Hybrid)
2 Months ago
Progress - Senior Inside Account Manager

Progress

Burlington, Massachusetts, United States (Hybrid)
1 Month ago
Cognite - Senior Full-stack Developer (Frontend Focus)

Cognite

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Palo Alto Networks - Senior Manager, NetSec Business Development

Palo Alto Networks

London, England, United Kingdom (On-Site)
2 Months ago
Workato - Commercial Account Executive

Workato

Frankfurt Am Main, Hessen, Germany (On-Site)
3 Weeks ago
Triple dot studios - Fraud Data Analyst

Triple dot studios

Toronto, Ontario, Canada (Hybrid)
2 Weeks ago
Amanotes - Data Analyst - For Marketing Team

Amanotes

Ho Chi Minh City, Vietnam (On-Site)
1 Year ago
zeta - Principal Data Scientist I

zeta

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Epic Games - Senior Data Analyst

Epic Games

(On-Site)
5 Months ago
PwC - Senior Data Engineer

PwC

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
10 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

The Globel Talent Co - Customer Support Representative

The Globel Talent Co

Argentina (Remote)
4 Months ago
DevRev - Senior Customer Success Manager

DevRev

Palo Alto, California, United States (On-Site)
2 Weeks ago
Highspot - Sr. Software Development Engineer, Coaching

Highspot

Hyderabad, Telangana, India (Hybrid)
1 Year ago
Sprinkler - Configuration Specialist

Sprinkler

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Dialpad AI - Solution Architect

Dialpad AI

Pasig, Metro Manila, Philippines (On-Site)
3 Months ago
Banyan Software - Sales and Marketing Manager

Banyan Software

Augusta, Georgia, United States (Remote)
1 Month ago
deel. - Payroll Associate

deel.

Denmark (Remote)
5 Days ago
deel. - Payroll Implementation Manager | UK

deel.

India (Remote)
5 Days ago
WebFX - AI Digital Marketing Specialist

WebFX

Cape Town, Western Cape, South Africa (On-Site)
2 Months ago
deel. - Payroll Compliance Analyst

deel.

Japan (Remote)
6 Days ago

Get notifed when new similar jobs are uploaded

Jobs in Maharashtra, India

Varaha - Senior Frontend Developer

Varaha

Bengaluru, Karnataka, India (On-Site)
10 Months ago
Trek - Customer Care Executive

Trek

Haryana, India (On-Site)
5 Months ago
Accenture - Quality Auditing Associate Manager

Accenture

Hyderabad, Telangana, India (On-Site)
2 Months ago
PhonePe - Category Manager- UPI

PhonePe

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Nice - Senior Specialist Cloud Database Engineer

Nice

Pune, Maharashtra, India (Hybrid)
3 Weeks ago
Assystems - OHE Design Engineer

Assystems

Gurugram, Haryana, India (On-Site)
9 Months ago
smartbear - Associate Software Engineer III

smartbear

Ahmedabad, Gujarat, India (On-Site)
3 Weeks ago
CME Group - Technology Solutions Analyst I

CME Group

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Assystems - Manager / Senior Manager - Project (Kolkata)

Assystems

Kolkata, West Bengal, India (On-Site)
9 Months ago
ansira - Site Reliability Engineer

ansira

Noida, Uttar Pradesh, India (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Cadence - Data Quality Assurance Analyst

Cadence

Portland, Oregon, United States (On-Site)
2 Months ago
nubank - Senior/Staff Data Scientist

nubank

United States (Remote)
2 Weeks ago
Cognite - Data Engineer - Support

Cognite

Bengaluru, Karnataka, India (Hybrid)
1 Week ago
Western Digital - Engineer, Data Analyst Equipment Engineering

Western Digital

Bayan Lepas, Penang, Malaysia (On-Site)
3 Months ago
Match Group - Data Analyst (Azar)

Match Group

Seoul, South Korea (Hybrid)
2 Months ago
Apple - Software Engineer - ASE Data Services

Apple

Seattle, Washington, United States (On-Site)
2 Months ago
Scopely - Data Scientist

Scopely

Barcelona, Catalonia, Spain (Hybrid)
2 Months ago
gismart - Data Engineer/Data Quality

gismart

(Remote)
3 Weeks ago
Rackspace Technology - Senior Cloud Data Engineer (AWS/Azure)

Rackspace Technology

Germany (Remote)
6 Days ago

Get notifed when new similar jobs are uploaded

About The Company

Velotio Technologies is a leading product engineering and digital solutions company working with innovative startups and enterprises across the globe. We specialize in Full-Stack development, Web & Mobile App Development, Cloud & DevOps, Data Engineering, AI/ML, UI/UX, and Quality Assurance.Since our inception in 2016, we have worked with over 110 global customers including NASDAQ-listed enterprises, unicorn startups, YCombinator and Sequoia funded companies, and cutting-edge product companies.

Pune, Maharashtra, India (Remote)

Bengaluru, Karnataka, India (Hybrid)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Hybrid)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

View All Jobs

Get notified when new jobs are added by velotio technologies

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug