Senior Data Engineer

10 Months ago • 6 Years + • Data Analysis

Job Summary

Job Description

We are seeking a Senior Data Engineer to join our Data Platform team for our Edge Computing AI Platform. You will be responsible for building new tools and services that support other teams’ data workflows. Experience with data modeling, ETL/ELT processes, streaming data pipelines, and data warehousing technologies like Databricks/Snowflake is required.
Must have:
  • Data Modeling
  • ETL/ELT Processes
  • Streaming Data Pipelines
  • Data Warehousing Technologies
Good to have:
  • Spark on K8S
  • Databricks
  • AWS EMR
  • Airflow
Perks:
  • Edge Computing
  • AI Platform

Job Details

About the job

About the Company

Armada is an edge computing startup that provides computing infrastructure to remote areas where connectivity and cloud infrastructure is limited, as well as areas where data needs to be processed locally for real-time analytics and AI at the edge. We’re looking to bring on the most brilliant minds to help further our mission of bridging the digital divide with advanced technology infrastructure that can be rapidly deployed anywhere.


About the Job

We are seeking a highly motivated Senior Data Engineer to join our Data Platform team for our Edge Computing AI Platform. As a Data Engineer in our Data Platform team, you will be responsible for helping us shape the future of data ingestion, processing, and analysis, while maintaining and improving existing data systems.


If you are a highly motivated individual with a passion for cutting-edge AI, cloud, edge, and infrastructure technology and are ready to take on the challenge of defining and delivering a new computing and AI platform, we would love to hear from you.


Key Responsibilities

  • Build new tools and services that support other teams’ data workflows, ingestion, processing, and distribution.
  • Design, discuss, propose, and implement to our existing data tooling and services.
  • Collaborate with a diverse group of people, giving and receiving feedback for growth.
  • Execute on big opportunities and contribute to building a company culture rising to the top of the AI and Edge Computing industry.


Preferred Qualifications

  • 6+ years of experience in software development.
  • Experience with data modeling, ETL/ELT processes, streaming data pipelines.
  • Familiarity with data warehousing technologies like Databricks/Snowflake/BigQuery/Redshift and data processing platforms like Spark; working with data warehousing file formats like Avro and Parquet.
  • Strong understanding of Storage (Object Stores, Data Virtualization) and Compute (Spark on K8S, Databricks, AWS EMR and the like) architectures used by data stack solutions and platforms.
  • Experience with scheduler tooling like Airflow.
  • Experience with version control systems like Git and working using a standardized git flow.
  • Strong analytical and problem-solving skills, with the ability to work independently and collaboratively in a team environment.
  • Professional experience developing data-heavy platforms and/or APIs.
  • A strong understanding of distributed systems and how architectural decisions affect performance and maintainability.
  • Bachelor’s degree in computer science, Electrical Engineering, or related field.


Additional Skills and Experience

  • Experience analyzing ML algorithms that could be used to solve a given problem and ranking them by their success probability.
  • Proficiency with a deep learning framework such as TensorFlow or Keras.
  • Understanding of MLOps practices and practical experience with platforms like Kubeflow / Sagemaker.


Our Company is an equal opportunity employer that is committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws. This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. Our Company makes hiring decisions based solely on qualifications, merit, and business needs at the time.

Similar Jobs

GT HQ - Senior Full-stack Developer (Python+React.js)

GT HQ

Ukraine (Remote)
4 Months ago
Bombay Play - Technical Artist

Bombay Play

Bengaluru, Karnataka, India (On-Site)
2 Months ago
fish in bottle  - Back-end Developer

fish in bottle

United Kingdom (Remote)
3 Months ago
Triple dot studios - Senior Machine Learning Engineer

Triple dot studios

Barcelona, Catalonia, Spain (Hybrid)
2 Weeks ago
Ion - Senior Java Developer - Italy

Ion

Collecchio, Emilia-Romagna, Italy (On-Site)
10 Months ago
quience - Software Development Engineer - 2 : Data Engineering

quience

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Expedia - Senior Data Engineer

Expedia

Austin, Texas, United States (On-Site)
1 Month ago
Zelis  - Data Engineer

Zelis

Hyderabad, Telangana, India (On-Site)
2 Months ago
Spyke Games - Data Scientist

Spyke Games

İstanbul, Türkiye (On-Site)
10 Months ago
Ion - Senior Business Analyst, Italy

Ion

Italy (Hybrid)
10 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Unity - Mobile Automation Engineer

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
4 Months ago
Nasdaq - Senior Software Developer

Nasdaq

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Devoteam - Consultant DevOps CI / CD

Devoteam

Cesson-Sévigné, Brittany, France (On-Site)
10 Months ago
Luxoft - Senior ETL Developer

Luxoft

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
8 Months ago
USE Insider - People and Culture / Global Tech Recruiter

USE Insider

Istanbul, İstanbul, Türkiye (Hybrid)
1 Year ago
CRB workforce  - Software Engineer (Python/Django)

CRB workforce

Salt Lake City, Utah, United States (On-Site)
2 Months ago
Stepico - Node.js Developer

Stepico

(Remote)
4 Months ago
Any Desk - Software Developer Generalist

Any Desk

Stuttgart, Baden-Württemberg, Germany (Hybrid)
2 Months ago
bytedance - Research Scientist Graduate (Foundation Model - Vision and Language)

bytedance

Seattle, Washington, United States (On-Site)
6 Months ago
Sleeper - DevOps / QA Engineer - Risk & Trading

Sleeper

Las Vegas, Nevada, United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Thiruvananthapuram, Kerala, India

Rackspace Technology - Network Security Engineer III - IN (Professional Services Delivery Engineer III)

Rackspace Technology

Gurugram, Haryana, India (Hybrid)
1 Week ago
Toast - Internal Audit Manager - Systems and Technology Audits

Toast

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Zeeco, Inc. - QC - GET (HO)

Zeeco, Inc.

Mumbai, Maharashtra, India (On-Site)
8 Months ago
Netomi - SDE II/III Backend

Netomi

India (Remote)
2 Months ago
Aristocrat - Associate Principal - Game Producer

Aristocrat

Noida, Uttar Pradesh, India (Hybrid)
3 Weeks ago
Wolters Kluwer - IT Support Engineer

Wolters Kluwer

Chennai, Tamil Nadu, India (On-Site)
2 Months ago
Globalization Partners - Director, HR Business Partner

Globalization Partners

India (Remote)
1 Month ago
Morning Star - Senior Data Research Analyst

Morning Star

Mumbai, Maharashtra, India (Hybrid)
2 Months ago
Open Systems Technologies - Principal Engineer, System Architect

Open Systems Technologies

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Lakshya Digital - 3D Animation Lead

Lakshya Digital

Gurugram, Haryana, India (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Axi - Data Engineer

Axi

Bengaluru, Karnataka, India (On-Site)
2 Months ago
HCL Tech - Senior Business Analyst with HL7 (Health Level Standard)

HCL Tech

New Jersey, United States (On-Site)
2 Months ago
Dream Sports - Software Development Engineer 3 - Machine Learning & Data Platform

Dream Sports

Mumbai, Maharashtra, India (On-Site)
6 Months ago
MiQ - ERP Data Engineer II

MiQ

Bengaluru, Karnataka, India (On-Site)
1 Month ago
HCL Tech - Senior Reporting & Data Analyst

HCL Tech

Madurai, Tamil Nadu, India (On-Site)
2 Months ago
Playstation - Lead Data Scientist

Playstation

United States (Remote)
2 Weeks ago
PayPal - Data Scientist

PayPal

Dublin, County Dublin, Ireland (Hybrid)
2 Months ago
Pattern - Senior Data and Applied Scientist

Pattern

Pune, Maharashtra, India (On-Site)
1 Month ago
Apple - Sr. Software Engineer - Data Infrastructure (ASE)

Apple

Cupertino, California, United States (On-Site)
2 Months ago
C3 IoT - Senior Software Engineer, Platform - Data + AI (Back-End)

C3 IoT

Redwood City, California, United States (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Thiruvananthapuram, Kerala, India (On-Site)

Thiruvananthapuram, Kerala, India (On-Site)

Thiruvananthapuram, Kerala, India (On-Site)

Thiruvananthapuram, Kerala, India (On-Site)

View All Jobs

Get notified when new jobs are added by Armada

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug