Senior Data Engineer

9 Months ago • 6 Years + • Data Analysis

Job Summary

Job Description

We are seeking a Senior Data Engineer to join our Data Platform team for our Edge Computing AI Platform. You will be responsible for building new tools and services that support other teams’ data workflows. Experience with data modeling, ETL/ELT processes, streaming data pipelines, and data warehousing technologies like Databricks/Snowflake is required.
Must have:
  • Data Modeling
  • ETL/ELT Processes
  • Streaming Data Pipelines
  • Data Warehousing Technologies
Good to have:
  • Spark on K8S
  • Databricks
  • AWS EMR
  • Airflow
Perks:
  • Edge Computing
  • AI Platform

Job Details

About the job

About the Company

Armada is an edge computing startup that provides computing infrastructure to remote areas where connectivity and cloud infrastructure is limited, as well as areas where data needs to be processed locally for real-time analytics and AI at the edge. We’re looking to bring on the most brilliant minds to help further our mission of bridging the digital divide with advanced technology infrastructure that can be rapidly deployed anywhere.


About the Job

We are seeking a highly motivated Senior Data Engineer to join our Data Platform team for our Edge Computing AI Platform. As a Data Engineer in our Data Platform team, you will be responsible for helping us shape the future of data ingestion, processing, and analysis, while maintaining and improving existing data systems.


If you are a highly motivated individual with a passion for cutting-edge AI, cloud, edge, and infrastructure technology and are ready to take on the challenge of defining and delivering a new computing and AI platform, we would love to hear from you.


Key Responsibilities

  • Build new tools and services that support other teams’ data workflows, ingestion, processing, and distribution.
  • Design, discuss, propose, and implement to our existing data tooling and services.
  • Collaborate with a diverse group of people, giving and receiving feedback for growth.
  • Execute on big opportunities and contribute to building a company culture rising to the top of the AI and Edge Computing industry.


Preferred Qualifications

  • 6+ years of experience in software development.
  • Experience with data modeling, ETL/ELT processes, streaming data pipelines.
  • Familiarity with data warehousing technologies like Databricks/Snowflake/BigQuery/Redshift and data processing platforms like Spark; working with data warehousing file formats like Avro and Parquet.
  • Strong understanding of Storage (Object Stores, Data Virtualization) and Compute (Spark on K8S, Databricks, AWS EMR and the like) architectures used by data stack solutions and platforms.
  • Experience with scheduler tooling like Airflow.
  • Experience with version control systems like Git and working using a standardized git flow.
  • Strong analytical and problem-solving skills, with the ability to work independently and collaboratively in a team environment.
  • Professional experience developing data-heavy platforms and/or APIs.
  • A strong understanding of distributed systems and how architectural decisions affect performance and maintainability.
  • Bachelor’s degree in computer science, Electrical Engineering, or related field.


Additional Skills and Experience

  • Experience analyzing ML algorithms that could be used to solve a given problem and ranking them by their success probability.
  • Proficiency with a deep learning framework such as TensorFlow or Keras.
  • Understanding of MLOps practices and practical experience with platforms like Kubeflow / Sagemaker.


Our Company is an equal opportunity employer that is committed to diversity and inclusion in the workplace. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws. This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. Our Company makes hiring decisions based solely on qualifications, merit, and business needs at the time.

Similar Jobs

Thatgamecompany - Full Stack iOS Engineer

Thatgamecompany

Shanghai, Shanghai, China (On-Site)
3 Months ago
nord current - Unity Developer

nord current

Dnipro, Dnipropetrovsk Oblast, Ukraine (On-Site)
7 Months ago
SoftSwiss - Full-Stack Connectivity Engineer

SoftSwiss

(Remote)
1 Month ago
Ajmera Infotech - iOS Developer II

Ajmera Infotech

Hyderabad, Telangana, India (On-Site)
1 Month ago
Ion - NetSuite ERP Developer

Ion

London, England, United Kingdom (On-Site)
4 Months ago
Marsh McLennan - Senior Analyst - Data Management

Marsh McLennan

Manila, Metro Manila, Philippines (Hybrid)
2 Weeks ago
Roblox - Data Scientist

Roblox

Gurugram, India (On-Site)
2 Weeks ago
Mozilla - Manager, Marketing Data Science

Mozilla

Canada (Remote)
1 Month ago
Nintendo - Senior Business Systems Analyst (Oracle Demantra/EBS)

Nintendo

Redmond, Washington, United States (Hybrid)
10 Months ago
oportun - Senior Data Engineer - DBA

oportun

Mexico (Remote)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Meta - Research Scientist Intern, Smart Glasses in Wearables AI (PhD)

Meta

Menlo Park, California, United States (On-Site)
7 Months ago
Qualcomm - Systems Analyst, Sr

Qualcomm

Hyderabad, Telangana, India (On-Site)
1 Month ago
Qualcomm - Engineer, Senior Staff

Qualcomm

Bengaluru, Karnataka, India (On-Site)
4 Weeks ago
RocketWerkz - GAME PROGRAMMER (C#)

RocketWerkz

Auckland, Auckland, New Zealand (On-Site)
10 Months ago
Genies.io - Senior Pipeline Engineer

Genies.io

Los Angeles, California, United States (Hybrid)
3 Weeks ago
JDA - Sr. Support Engineer1

JDA

Bengaluru, Karnataka, India (On-Site)
1 Month ago
luxsoft - Test Engineer

luxsoft

Sofia, Sofia City Province, Bulgaria (On-Site)
1 Month ago
London stock Exchange - Senior DevOps Engineer

London stock Exchange

Colombo, Western Province, Sri Lanka (On-Site)
1 Month ago
oportun - Senior Software ML Engineer

oportun

India (Remote)
2 Months ago
Hawkeye Innovations - Senior Data Test Automation Engineer

Hawkeye Innovations

Basingstoke, England, United Kingdom (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Thiruvananthapuram, Kerala, India

e2 open - Senior Calypso Developer

e2 open

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
Capgemini - Tableau

Capgemini

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Qualcomm - Technical Writer, Senior

Qualcomm

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Saviynt - Staff Accountant

Saviynt

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Simple Viral Games - Android Developer

Simple Viral Games

Bengaluru, Karnataka, India (On-Site)
11 Months ago
Qualcomm - Chipset Architect

Qualcomm

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Vimeo - Financial Systems Manager

Vimeo

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Applied materials  - Unity Developer

Applied materials

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Capgemini - ServiceNow HRSD Design Lead

Capgemini

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Euromonitor - Software Engineer 3

Euromonitor

Bengaluru, Karnataka, India (Hybrid)
4 Days ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

upwork - Lead Software Engineer - AI Data Systems

upwork

United States (Remote)
3 Days ago
Aptive - Expert Data Scientist - Machine Learning

Aptive

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
1 Month ago
Workato - Senior Java Engineer (CDC and Data Integration)

Workato

Sofia, Sofia City Province, Bulgaria (On-Site)
1 Month ago
adictiz - Data engineering | Data scientist

adictiz

Lille, Hauts-de-France, France (On-Site)
1 Month ago
London stock Exchange - Senior Data Science Cloud Engineer

London stock Exchange

St. Louis, Missouri, United States (On-Site)
1 Month ago
CommerceIQ - Senior Manager- Data Science

CommerceIQ

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Apple - AI Solutions Architect, Data Solutions & Initiatives

Apple

Cupertino, California, United States (On-Site)
2 Weeks ago
NBC Universal - Data Product Manager, Product Analytics

NBC Universal

Brentford, England, United Kingdom (On-Site)
3 Weeks ago
Roblox - Senior Data Science Manager, Marketplace

Roblox

San Mateo, California, United States (On-Site)
2 Weeks ago
Apple - Data Visualization / BI Engineer

Apple

Cupertino, California, United States (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Thiruvananthapuram, Kerala, India (On-Site)

Thiruvananthapuram, Kerala, India (On-Site)

Thiruvananthapuram, Kerala, India (On-Site)

Thiruvananthapuram, Kerala, India (On-Site)

View All Jobs

Get notified when new jobs are added by Armada

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug