Data Engineer

1 Day ago • 1 Years + • Data Analyst

Job Summary

Job Description

Design and build scalable, reliable data infrastructure. Build applications for optimal data extraction, cleaning, transformation, and loading from diverse sources using big data technologies. Develop ETL/ELT pipelines and work with data lakes, warehouses, and BI tools. Utilize cloud services (AWS, GCP, Azure) for highly available data processing and storage. Implement data quality monitoring processes. Collaborate with business units to develop long-term data platform architecture. Establish operational excellence in data engineering. Evaluate and integrate tools to accelerate data engineering, data science, and analytics. Write unit/integration tests. Contribute to design documents.
Must have:
  • Build scalable data infrastructure
  • ETL/ELT pipeline development
  • Big data technologies (Spark, Hadoop)
  • Cloud experience (AWS, GCP, Azure)
  • Data quality monitoring
  • Python, Scala, or Java proficiency
  • Database design experience
Good to have:
  • Redshift/Snowflake/BigQuery experience
  • Data Lake/warehouse experience
  • Airflow/similar workflow tools
  • Machine learning model deployment
  • Agile methodologies

Job Details

Description

Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS, IoT & Machine Learning space. Our team of 400+ elite software engineers solves hard technical problems while transforming customer ideas into successful products.

Requirements

  • Design and build scalable data infrastructure with efficiency, reliability, and consistency to meet rapidly growing data needs
  • Build the applications required for optimal extraction, cleaning, transformation, and loading data from disparate data sources and formats using the latest big data technologies
  • Building ETL/ELT pipelines and work with other data infrastructure components, like Data Lakes, Data Warehouses and BI/reporting/analytics tools
  • Work with various cloud services like AWS, GCP, Azure to implement highly available, horizontally scalable data processing and storage systems and automate manual processes and workflows
  • Implement processes and systems to monitor data quality, to ensure data is always accurate, reliable, and available for the stakeholders and other business processes that depend on it
  • Work closely with different business units and engineering teams to develop a long-term data platform architecture strategy and thus foster data-driven decision-making practices across the organization
  • Help establish and maintain a high level of operational excellence in data engineering
  • Evaluate, integrate, and build tools to accelerate Data Engineering, Data Science, Business Intelligence, Reporting, and Analytics as needed
  • Focus on building test-driven development by writing unit/integration tests
  • Contribute to design documents and engineering wiki

You will enjoy this role if you...

  • Like building elegant well-architected software products with enterprise customers
  • Want to learn to leverage public cloud services & cutting-edge big data technologies, like Spark, Airflow, Hadoop, Snowflake, and Redshift
  • Work collaboratively as part of a close-knit team of geeks, architects, and leads

Desired Skills & Experience:

  • 1+ years of data engineering or equivalent knowledge and ability
  • 1+ years software engineering or equivalent knowledge and ability
  • Strong proficiency in at least one of the following programming languages: Python, Scala, or Java
  • Experience designing and maintaining at least one type of database (Object Store, Columnar, In-memory, Relational, Tabular, Key-Value Store, Triple-store, Tuple-store, Graph, and other related database types)
  • Good understanding of star/snowflake schema designs
  • Extensive experience working with big data technologies like Spark, Hadoop, Hive
  • Experience building ETL/ELT pipelines and working on other data infrastructure components like BI/reporting/analytics tools
  • Experience working with workflow orchestration tools like Apache Airflow, Oozie, Azkaban, NiFi, Airbyte, etc.
  • Experience building production-grade data backup/restore strategies and disaster recovery solutions
  • Hands-on experience with implementing batch and stream data processing applications using technologies like AWS DMS, Apache Flink, Apache Spark, AWS Kinesis, Kafka, etc.
  • Knowledge of best practices in developing and deploying applications that are highly available and scalable
  • Experience with or knowledge of Agile Software Development methodologies
  • Excellent problem-solving and troubleshooting skills
  • Process-oriented with excellent documentation skills

Bonus points if you:

  • Have hands-on experience using one or multiple cloud service providers like AWS, GCP, Azure and have worked with specific products like EMR, Glue, DataProc, DataBricks, DataStudio, etc
  • Have hands-on experience working with either Redshift, Snowflake, BigQuery, Azure Synapse, or Athena and understand the inner workings of these cloud storage systems
  • Have experience building DataLakes, scalable data warehouses, and DataMarts
  • Have familiarity with tools like Jupyter Notebooks, Pandas, NumPy, SciPy, sci-kit learn, Seaborn, SparkML, etc.
  • Have experience building and deploying Machine Learning models to production at scale
  • Possess excellent cross-functional collaboration and communication skills

Benefits

Our Culture:

  • We have an autonomous and empowered work culture encouraging individuals to take ownership and grow quickly
  • Flat hierarchy with fast decision making and a startup-oriented “get things done” culture
  • A strong, fun & positive environment with regular celebrations of our success. We pride ourselves in creating an inclusive, diverse & authentic environment

At Velotio, we embrace diversity. Inclusion is a priority for us, and we are eager to foster an environment where everyone feels valued. We welcome applications regardless of ethnicity or cultural background, age, gender, nationality, religion, disability or sexual orientation.

Similar Jobs

Matific - Senior Data Engineer

Matific

Colombo, Western Province, Sri Lanka (On-Site)
2 Months ago
JustPlay - Senior Marketing Data Analyst

JustPlay

(Remote)
1 Week ago
Axon - Senior Technical Program Manager, AI

Axon

Seattle, Washington, United States (Remote)
1 Month ago
Trend Micro - (Sr.) Cloud Developer (Vision One)

Trend Micro

Taipei City, Taiwan (On-Site)
5 Months ago
N-iX - Senior Engineer with AWS Greengrass Expertise

N-iX

Ukraine (Remote)
1 Month ago
Samsung Semiconductor - Performance Analysis Engineer (Contractor)

Samsung Semiconductor

San Jose, California, United States (Hybrid)
3 Months ago
Playtika - Data Infrastructure Director

Playtika

Israel (On-Site)
4 Months ago
The Walt Disney Company - Senior Product Manager II, Commerce Performance & Insights

The Walt Disney Company

Bristol, Connecticut, United States (On-Site)
3 Days ago
Nexters - Marketing Analyst

Nexters

Cyprus (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Huuuge Games - Senior Java Software Engineer

Huuuge Games

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Days ago
Tencent - Senior IT Operations Engineer

Tencent

California, United States (On-Site)
3 Days ago
Nielsen Holdings - QA Engineer (Automation/Manual/Python/Java)- P2

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Ness Digital - Cloud Systems Engineer

Ness Digital

Timișoara, Timiș, Romania (Hybrid)
2 Months ago
NVIDIA - Senior HPC DevOps Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
2 Months ago
PwC - Senior Data Scientist

PwC

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
5 Months ago
Easygo - Senior Digital Product Analyst

Easygo

Melbourne, Victoria, Australia (On-Site)
1 Month ago
Activision - Senior Machine Learning Operations Engineer

Activision

Los Angeles, California, United States (Remote)
2 Days ago
Go Fund Me - Senior Software Engineer (Payments)

Go Fund Me

Buenos Aires, Buenos Aires, Argentina (On-Site)
4 Months ago
SuperPlay - SENIOR .NET DEVELOPER

SuperPlay

Bucharest, Bucharest, Romania (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Pune, Maharashtra, India

Provenir - Senior Quality Assurance Automation Engineer

Provenir

Bengaluru, Karnataka, India (On-Site)
7 Months ago
DNEG - FX - Crowd Artist

DNEG

Mumbai, Maharashtra, India (On-Site)
2 Days ago
Axinous - Principal Professional Services Architect (Data Loss Prevention)

Axinous

Hyderabad, Telangana, India (Remote)
2 Weeks ago
Sporty Group - Creative Designer

Sporty Group

India (Remote)
2 Months ago
Ubisoft - Technical Architect

Ubisoft

Pune, Maharashtra, India (On-Site)
1 Month ago
Virtusa - Data Scientist

Virtusa

Andhra Pradesh, India (On-Site)
6 Months ago
Paytm - Paytm Ads ops (Monetization)

Paytm

Bengaluru, Karnataka, India (On-Site)
5 Months ago
PhonePe - Outbound Sales Lead, SME (Online Merchants)

PhonePe

Bengaluru, Karnataka, India (On-Site)
4 Months ago
CloudHire - Fullstack IONIC Developer

CloudHire

Pune, Maharashtra, India (Remote)
1 Day ago
Zazz - IT Recruiter_South Asia

Zazz

Hyderabad, Telangana, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

seeking alpha - Senior Data Engineer

seeking alpha

Ukraine (Remote)
1 Month ago
TVH - Data Scientist

TVH

Pune, Maharashtra, India (On-Site)
6 Months ago
GoTo Group - Senior Software Engineer - Data Platform (Streaming)

GoTo Group

Bengaluru, Karnataka, India (On-Site)
5 Months ago
seeking alpha - Senior Data Engineer

seeking alpha

Poland (Remote)
1 Month ago
ION - Internship - Data Science

ION

Pisa, Tuscany, Italy (On-Site)
5 Months ago
Just Play GmbH - Senior Marketing Data Analyst

Just Play GmbH

(Remote)
2 Weeks ago
Fugo Games - Data Engineer

Fugo Games

İstanbul, Türkiye (On-Site)
3 Months ago
Moon Active - Data Scientist

Moon Active

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
2 Days ago
Amanotes - Senior Game Data Analyst (Based in HCM)

Amanotes

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
9 Months ago
Evolution - Business Intelligence Data Analyst

Evolution

Riga, Latvia (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Maharashtra, India (Remote)

Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

Pune, Maharashtra, India (Remote)

View All Jobs

Get notified when new jobs are added by Velotio Technologies

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug