Software Engineer (Data Engineering)

1 Day ago • 1 Years + • Data Analyst • DevOps

Job Summary

Job Description

As a Software Engineer (DE) at Velotio Technologies, you will design and build scalable data infrastructure, ensuring efficiency, reliability, and consistency. Responsibilities include building applications for optimal data extraction, transformation, and loading from diverse sources using big data technologies. You'll construct ETL/ELT pipelines, work with data lakes and warehouses, and utilize cloud services (AWS, GCP, Azure) for scalable data processing and storage. You'll implement data quality monitoring systems and collaborate with various teams to establish long-term data platform architecture strategies. Building test-driven development and contributing to design documents are key aspects of this role. Experience with big data technologies (Spark, Hadoop, Hive), ETL/ELT pipelines, and workflow orchestration tools is essential.
Must have:
  • 1+ years data engineering experience
  • 1+ years software engineering experience
  • Proficiency in Python, Scala, or Java
  • Database design experience
  • Big data tech experience (Spark, Hadoop, Hive)
  • ETL/ELT pipeline experience
  • Cloud service experience (AWS, GCP, Azure)
Good to have:
  • Experience with Redshift, Snowflake, BigQuery
  • Data Lake/Warehouse experience
  • Machine learning model deployment experience
  • Agile methodology experience

Job Details

Description

Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS, IoT & Machine Learning space. Our team of 400+ elite software engineers solves hard technical problems while transforming customer ideas into successful products.

Requirements

  • Design and build scalable data infrastructure with efficiency, reliability, and consistency to meet rapidly growing data needs
  • Build the applications required for optimal extraction, cleaning, transformation, and loading data from disparate data sources and formats using the latest big data technologies
  • Building ETL/ELT pipelines and work with other data infrastructure components, like Data Lakes, Data Warehouses and BI/reporting/analytics tools
  • Work with various cloud services like AWS, GCP, Azure to implement highly available, horizontally scalable data processing and storage systems and automate manual processes and workflows
  • Implement processes and systems to monitor data quality, to ensure data is always accurate, reliable, and available for the stakeholders and other business processes that depend on it
  • Work closely with different business units and engineering teams to develop a long-term data platform architecture strategy and thus foster data-driven decision-making practices across the organization
  • Help establish and maintain a high level of operational excellence in data engineering
  • Evaluate, integrate, and build tools to accelerate Data Engineering, Data Science, Business Intelligence, Reporting, and Analytics as needed
  • Focus on building test-driven development by writing unit/integration tests
  • Contribute to design documents and engineering wiki

You will enjoy this role if you...

  • Like building elegant well-architected software products with enterprise customers
  • Want to learn to leverage public cloud services & cutting-edge big data technologies, like Spark, Airflow, Hadoop, Snowflake, and Redshift
  • Work collaboratively as part of a close-knit team of geeks, architects, and leads

Desired Skills & Experience:

  • 1+ years of data engineering or equivalent knowledge and ability
  • 1+ years software engineering or equivalent knowledge and ability
  • Strong proficiency in at least one of the following programming languages: Python, Scala, or Java
  • Experience designing and maintaining at least one type of database (Object Store, Columnar, In-memory, Relational, Tabular, Key-Value Store, Triple-store, Tuple-store, Graph, and other related database types)
  • Good understanding of star/snowflake schema designs
  • Extensive experience working with big data technologies like Spark, Hadoop, Hive
  • Experience building ETL/ELT pipelines and working on other data infrastructure components like BI/reporting/analytics tools
  • Experience working with workflow orchestration tools like Apache Airflow, Oozie, Azkaban, NiFi, Airbyte, etc.
  • Experience building production-grade data backup/restore strategies and disaster recovery solutions
  • Hands-on experience with implementing batch and stream data processing applications using technologies like AWS DMS, Apache Flink, Apache Spark, AWS Kinesis, Kafka, etc.
  • Knowledge of best practices in developing and deploying applications that are highly available and scalable
  • Experience with or knowledge of Agile Software Development methodologies
  • Excellent problem-solving and troubleshooting skills
  • Process-oriented with excellent documentation skills

Bonus points if you:

  • Have hands-on experience using one or multiple cloud service providers like AWS, GCP, Azure and have worked with specific products like EMR, Glue, DataProc, DataBricks, DataStudio, etc
  • Have hands-on experience working with either Redshift, Snowflake, BigQuery, Azure Synapse, or Athena and understand the inner workings of these cloud storage systems
  • Have experience building DataLakes, scalable data warehouses, and DataMarts
  • Have familiarity with tools like Jupyter Notebooks, Pandas, NumPy, SciPy, sci-kit learn, Seaborn, SparkML, etc.
  • Have experience building and deploying Machine Learning models to production at scale
  • Possess excellent cross-functional collaboration and communication skills

Benefits

Our Culture:

  • We have an autonomous and empowered work culture encouraging individuals to take ownership and grow quickly
  • Flat hierarchy with fast decision making and a startup-oriented “get things done” culture
  • A strong, fun & positive environment with regular celebrations of our success. We pride ourselves in creating an inclusive, diverse & authentic environment

At Velotio, we embrace diversity. Inclusion is a priority for us, and we are eager to foster an environment where everyone feels valued. We welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, disability or sexual orientation.

Similar Jobs

GoMotive - Software Engineer, Backend

GoMotive

India (Remote)
1 Week ago
Rebellion - Experienced JavaScript Developer

Rebellion

Oxford, England, United Kingdom (Hybrid)
2 Days ago
Hudl - Software Engineer II

Hudl

London, England, United Kingdom (Hybrid)
3 Months ago
Nielsen Holdings - Software Engineer - ( Java and GO, AWS, Kubernetes, Terraform, Cassandra, PostgreSQL)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
Rackspace Technology - Senior DevOps Engineer (AWS)

Rackspace Technology

Poland (Remote)
1 Week ago
Token Metrics - Crypto Senior Backend Engineer (Remote)

Token Metrics

Medellín, Antioquia, Colombia (Remote)
5 Months ago
Netflix - Data Visualization Engineer (L5)

Netflix

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Fanatee - Data Analyst

Fanatee

Spain (Hybrid)
1 Week ago
CloudHire - Senior Database Engineer

CloudHire

Karnataka, India (Remote)
1 Week ago
Mozilla - Senior Data Engineer

Mozilla

Canada (Remote)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Truecaller - Data Architect

Truecaller

Stockholm, Stockholm County, Sweden (On-Site)
4 Months ago
Inworld AI - Staff Cloud DevOps/Site Reliability Engineer (SRE) - USA

Inworld AI

Mountain View, California, United States (On-Site)
7 Months ago
Normalyze - Lead DevOps Engineer - Enterprise Cybersecurity - SaaS - Bay Area, CA

Normalyze

California, United States (Remote)
5 Months ago
ION - Senior Software Engineer, Italy

ION

Turin, Piedmont, Italy (On-Site)
5 Months ago
Axinous - Staff BSA - ServiceNow

Axinous

California, United States (Remote)
3 Weeks ago
Interactive Brokers - Senior Java Developer - Client Portal

Interactive Brokers

Hong Kong Island, Hong Kong (On-Site)
5 Months ago
1047 Games - Fullstack Engineer

1047 Games

(Remote)
1 Month ago
PlayStation Global - Senior Full Stack Software Engineer - Golang

PlayStation Global

Carlsbad, California, United States (On-Site)
2 Days ago
Zinnia - Senior Cloud Security Engineer

Zinnia

Noida, Uttar Pradesh, India (Hybrid)
5 Months ago
Dream11 - SDE 2 - Frontend

Dream11

Mumbai, Maharashtra, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Maharashtra, India

DNEG - Principal Security Architect

DNEG

Mumbai, Maharashtra, India (On-Site)
1 Week ago
Scopely - Software Engineer

Scopely

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Paytm - Data Engineering - Data Engineer

Paytm

Noida, Uttar Pradesh, India (On-Site)
3 Months ago
PwC - IN-Senior Associate_ GIS Business Analyst _ Social_ Advisory_ Gurugram

PwC

Gurugram, Haryana, India (On-Site)
2 Months ago
Enphase Energy - EG Cloud Quality Engineer

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Highspot - Sr. Software Development Engineer

Highspot

Hyderabad, Telangana, India (Hybrid)
5 Months ago
Sportskeeda - Content Editor (Picks4Sure)

Sportskeeda

India (Remote)
2 Months ago
Technorizen Software Solutions - PHP Developer

Technorizen Software Solutions

Indore, Madhya Pradesh, India (On-Site)
8 Months ago
Paytm - LEA Ops - Associate / Sr Associate -

Paytm

Noida, Uttar Pradesh, India (On-Site)
3 Months ago
Zeta - Senior Site Reliability Engineer

Zeta

Bengaluru, Karnataka, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

ByteDance - Data Analyst - AI Innovation Business

ByteDance

Singapore (On-Site)
4 Months ago
Morning Star - Team Lead

Morning Star

Mumbai, Maharashtra, India (Hybrid)
5 Months ago
CloudHire - Data Curator

CloudHire

Mumbai, Maharashtra, India (Remote)
1 Week ago
Warner Bros Games - Staff Software Engineer - Data

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Voodoo - Head of Data

Voodoo

Paris, Île-de-France, France (Hybrid)
2 Days ago
The Walt Disney Company - Decision Science Undergraduate Intern

The Walt Disney Company

Lake Buena Vista, Florida, United States (On-Site)
3 Days ago
Easybrain - Senior Data Engineer

Easybrain

Cyprus (On-Site)
8 Months ago
SuperPlay - Business Data Analyst - Disney

SuperPlay

Tel Aviv District, Israel (On-Site)
1 Month ago
Luxoft - Senior Data Ops Engineer

Luxoft

Delhi, India (On-Site)
4 Months ago
Microsoft - Member of Technical Staff, AI Data

Microsoft

London, England, United Kingdom (On-Site)
3 Days ago

Get notifed when new similar jobs are uploaded

About The Company

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

View All Jobs

Get notified when new jobs are added by Velotio Technologies

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug