Software Engineer (Data Engineering)

1 Month ago • 1 Years + • Data Analyst • DevOps

Job Summary

Job Description

As a Software Engineer (DE) at Velotio Technologies, you'll design and build scalable data infrastructure, ensuring efficiency, reliability, and consistency. You'll create applications for optimal data extraction, transformation, and loading from diverse sources using cutting-edge big data technologies. Responsibilities include building ETL/ELT pipelines, working with data lakes and warehouses, utilizing cloud services (AWS, GCP, Azure), implementing data quality monitoring systems, collaborating with business units on long-term data platform architecture, and fostering data-driven decision-making. You'll also contribute to test-driven development and design documentation. Experience with big data technologies (Spark, Hadoop, Hive), ETL/ELT pipelines, and cloud services is essential.
Must have:
  • 1+ years data engineering experience
  • 1+ years software engineering experience
  • Proficiency in Python, Scala, or Java
  • Database design experience
  • Big data technologies (Spark, Hadoop, Hive)
  • ETL/ELT pipeline development
  • Cloud service experience (AWS, GCP, Azure)
  • Agile methodologies
Good to have:
  • Experience with Redshift, Snowflake, or BigQuery
  • Data Lake/Warehouse development
  • Machine learning model deployment
  • Experience with Airflow, Oozie, etc.
Perks:
  • Autonomous work culture
  • Flat hierarchy
  • Positive work environment
  • Inclusive and diverse environment

Job Details

Description

Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS, IoT & Machine Learning space. Our team of 400+ elite software engineers solves hard technical problems while transforming customer ideas into successful products.

Requirements

  • Design and build scalable data infrastructure with efficiency, reliability, and consistency to meet rapidly growing data needs
  • Build the applications required for optimal extraction, cleaning, transformation, and loading data from disparate data sources and formats using the latest big data technologies
  • Building ETL/ELT pipelines and work with other data infrastructure components, like Data Lakes, Data Warehouses and BI/reporting/analytics tools
  • Work with various cloud services like AWS, GCP, Azure to implement highly available, horizontally scalable data processing and storage systems and automate manual processes and workflows
  • Implement processes and systems to monitor data quality, to ensure data is always accurate, reliable, and available for the stakeholders and other business processes that depend on it
  • Work closely with different business units and engineering teams to develop a long-term data platform architecture strategy and thus foster data-driven decision-making practices across the organization
  • Help establish and maintain a high level of operational excellence in data engineering
  • Evaluate, integrate, and build tools to accelerate Data Engineering, Data Science, Business Intelligence, Reporting, and Analytics as needed
  • Focus on building test-driven development by writing unit/integration tests
  • Contribute to design documents and engineering wiki

You will enjoy this role if you...

  • Like building elegant well-architected software products with enterprise customers
  • Want to learn to leverage public cloud services & cutting-edge big data technologies, like Spark, Airflow, Hadoop, Snowflake, and Redshift
  • Work collaboratively as part of a close-knit team of geeks, architects, and leads

Desired Skills & Experience:

  • 1+ years of data engineering or equivalent knowledge and ability
  • 1+ years software engineering or equivalent knowledge and ability
  • Strong proficiency in at least one of the following programming languages: Python, Scala, or Java
  • Experience designing and maintaining at least one type of database (Object Store, Columnar, In-memory, Relational, Tabular, Key-Value Store, Triple-store, Tuple-store, Graph, and other related database types)
  • Good understanding of star/snowflake schema designs
  • Extensive experience working with big data technologies like Spark, Hadoop, Hive
  • Experience building ETL/ELT pipelines and working on other data infrastructure components like BI/reporting/analytics tools
  • Experience working with workflow orchestration tools like Apache Airflow, Oozie, Azkaban, NiFi, Airbyte, etc.
  • Experience building production-grade data backup/restore strategies and disaster recovery solutions
  • Hands-on experience with implementing batch and stream data processing applications using technologies like AWS DMS, Apache Flink, Apache Spark, AWS Kinesis, Kafka, etc.
  • Knowledge of best practices in developing and deploying applications that are highly available and scalable
  • Experience with or knowledge of Agile Software Development methodologies
  • Excellent problem-solving and troubleshooting skills
  • Process-oriented with excellent documentation skills

Bonus points if you:

  • Have hands-on experience using one or multiple cloud service providers like AWS, GCP, Azure and have worked with specific products like EMR, Glue, DataProc, DataBricks, DataStudio, etc
  • Have hands-on experience working with either Redshift, Snowflake, BigQuery, Azure Synapse, or Athena and understand the inner workings of these cloud storage systems
  • Have experience building DataLakes, scalable data warehouses, and DataMarts
  • Have familiarity with tools like Jupyter Notebooks, Pandas, NumPy, SciPy, sci-kit learn, Seaborn, SparkML, etc.
  • Have experience building and deploying Machine Learning models to production at scale
  • Possess excellent cross-functional collaboration and communication skills

Benefits

Our Culture:

  • We have an autonomous and empowered work culture encouraging individuals to take ownership and grow quickly
  • Flat hierarchy with fast decision making and a startup-oriented “get things done” culture
  • A strong, fun & positive environment with regular celebrations of our success. We pride ourselves in creating an inclusive, diverse & authentic environment

At Velotio, we embrace diversity. Inclusion is a priority for us, and we are eager to foster an environment where everyone feels valued. We welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, disability or sexual orientation.

Similar Jobs

Warner Bros Games - Software Engineer II - DevOps

Warner Bros Games

Bengaluru, Karnataka, India (Hybrid)
2 Weeks ago
Behaviour Interactive - Principal Generalist Programmer - Dead by Daylight

Behaviour Interactive

Ontario, Canada (Hybrid)
3 Weeks ago
The Walt Disney Company - Sr. Principal Software Engineer - Identity

The Walt Disney Company

New York, New York, United States (On-Site)
3 Months ago
Passion Gaming - Back End Engineer PHP

Passion Gaming

Gurugram, Haryana, India (On-Site)
7 Months ago
Britive - SENIOR SOFTWARE ENGINEER (CLOUD)

Britive

Bengaluru, Karnataka, India (Remote)
4 Months ago
Tencent - Data Science Intern

Tencent

(On-Site)
1 Month ago
Voodoo - Senior Data Engineer (Ad networks)

Voodoo

Paris, Île-de-France, France (Hybrid)
2 Months ago
Samsung Semiconductor - Performance Analysis Engineer (Contractor)

Samsung Semiconductor

San Jose, California, United States (Hybrid)
4 Months ago
PwC - Senior Associate_AI Engineer_Data & Analytics_Advisory_PAN India

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
CrazyLabs - Game Analytics Team Leader

CrazyLabs

Berlin, Berlin, Germany (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Playrix - Python Full Stack Developer (DevTools)

Playrix

Ireland (Remote)
3 Weeks ago
Nielsen Holdings - Staff Software Engineer (AM-TECH-DA-43)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Nielsen Holdings - Software Engineer - (Java/Python, Sencha Ext JS, Oracle, Postgres, Spring boot, AWS)

Nielsen Holdings

Gurugram, Haryana, India (Hybrid)
6 Months ago
N-iX - Senior Data Engineer (#2327)

N-iX

Ukraine (Remote)
5 Months ago
Nielsen Holdings - Sr DevOps Engineer (AM-TECH-DA-40)

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Xsolla - IT Director

Xsolla

Los Angeles, California, United States (Remote)
3 Weeks ago
Ness Digital - QA Engineer with Tosca

Ness Digital

Timișoara, Timiș, Romania (Remote)
2 Months ago
Luxoft - Data Engineer for Market Data Projects (with Streamlit Expertise)

Luxoft

Brazil, Indiana, United States (Remote)
5 Months ago
Ajmera Infotech - Senior React Engineer - Product Development & Innovation

Ajmera Infotech

Ahmedabad, Gujarat, India (On-Site)
3 Months ago
Nielsen Holdings - Scala Developer

Nielsen Holdings

Bengaluru, Karnataka, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Maharashtra, India

bosh group india - Enterprise Architect - eCommerce

bosh group india

Bengaluru, Karnataka, India (On-Site)
4 Months ago
PwC - Senior Associate  - Technology Consulting

PwC

Hyderabad, Telangana, India (On-Site)
6 Months ago
Simple Viral Games - Android Developer Intern

Simple Viral Games

Bengaluru, Karnataka, India (On-Site)
8 Months ago
CloudHire - AWS Cloud Engineer

CloudHire

India (Remote)
4 Weeks ago
Avathon - Quality Assurance Engineer

Avathon

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Saviynt - Sr.Principal Engineer, Software Engineering

Saviynt

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Sportskeeda - Golf Static Writer

Sportskeeda

India (Remote)
4 Weeks ago
Hike - Senior Analytics Manager

Hike

Delhi, India (Remote)
2 Weeks ago
Assystems - Sr. Electrical Design Engineer

Assystems

Gurugram, Haryana, India (On-Site)
5 Months ago
Fairmatic - Senior Software Engineer - Backend

Fairmatic

Bengaluru, Karnataka, India (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Definitive Healthcare - Senior Data Scientist

Definitive Healthcare

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Playrix - Senior Data Analyst (Game)

Playrix

Portugal (Remote)
5 Months ago
Voodoo - Head of Data

Voodoo

Paris, Île-de-France, France (Hybrid)
3 Weeks ago
Head Digital Works - Data Scientist

Head Digital Works

Hyderabad, Telangana, India (On-Site)
8 Months ago
PwC - IN_Manager_ Data Governance, D&A_Advisory_Manager

PwC

Mumbai, Maharashtra, India (On-Site)
6 Months ago
IGT - Marketing Analyst

IGT

Austin, Texas, United States (On-Site)
4 Months ago
ByteDance - Senior Data Scientist

ByteDance

Seattle, Washington, United States (On-Site)
2 Months ago
Tencent - WeChat Tech Intern (Data Scientist - Safety Strategies)

Tencent

Singapore (On-Site)
7 Months ago
GoTo Group - Senior Software Engineer - Data Platform (Streaming)

GoTo Group

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Avathon - Data Engineer

Avathon

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Maharashtra, India (Remote)

Maharashtra, India (Remote)

Maharashtra, India (Remote)

Maharashtra, India (Remote)

Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

View All Jobs

Get notified when new jobs are added by Velotio Technologies

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug