Jobs

Scholarships

Courses

Companies

Placements

Community

Home >

Jobs >

Staff Data Engineer

Karnataka, India (Hybrid)

Staff Data Engineer

1 Month ago • 10-10 Years • Data Analyst

About the job

15 skills required for this role

Test your skills to join the top 1% applicants for this job

java

mongodb

redis

graphql

apache-flink

aws

python

sql

terraform

hadoop

apache-kafka

mysql

postgresql

innovation

automated-testing

Job Description

Staff Data Engineer with 10+ years of experience in developing Data products and enterprise-scale Big Data solutions. Must-have expertise in Python, AWS, Kafka, and SQL Server. Experience with Redshift, DynamoDB, and RESTful APIs is preferred. Join a team passionate about making a positive impact on roadways.

Must have:

Python Experience
AWS Expertise
Kafka Experience
SQL Server

Good to have:

Redshift Exp.
DynamoDB Exp.
RESTful APIs
GraphQL APIs

Perks:

Inclusive Team
Positive Impact

Not hearing back from companies?

Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

About the job

Staff Data Engineer has full accountability to design and develop rich data-driven frameworks, applications and services. This role will be responsible for development of applications on the Cloud platform and migration of existing on-premise data systems and processes to the Cloud, while also engaging with the Teams navigate through Technology stack evaluation and incubation of newer Cloud technologies. Staff Data Engineer is an expert at cloud technologies, specifically AWS tools and resources, and participates in building robust data pipeline frameworks that are configurable and highly re-usable. This role will be responsible for architecting enterprise level data solutions keeping in mind future scale and SLA management with scale.

If you are that person, you'll help us continue to improve and innovate our Data Applications and Services, and we’ll help you grow!

Job Responsibilities

Participate in the full software lifecycle (requirements, design, code, unit test, deployment, sustaining) for assigned modules

Interact with Product Management to determine Product / Feature requirements and perform technical analysis

Interact with Application & Analyst Teams to determine Data dependencies and perform technical analysis

Acquire and maintain a clear understanding of the technologies used in Lytx’s products and services and help steer future technology vision

Participate in scrum sprints with other developers, business users, and testers

Mentor and guide junior members on the team and drive product and features development with the Team

Collaborate with the product / program management Teams to define clear requirements

Experience breaking down product requirements in manageable software development tasks that could be tracked

Experience with architecture design and ability to document, publish, and evangelize architecture design to technology partners

Practice and instill design & development best practices, re-usability concepts using frameworks, and Enterprise-wide view while designing and implementing solutions

Understand big picture when working on product and features, ability to design enterprise level solutions focused on future growth and SLA requirements

Other duties as assigned

Education Requirements

Bachelor’s degree in computer science, computer information systems, or equivalent experience

Experience Requirements

10+ years of industry experience developing Data products and/or developing enterprise-scale Big Data solutions

7+ years’ experience in a senior developer role with focus in data Ingest, data processing and data publishing design

6+ years in design/development of high-volume high-throughput Data systems ranging from OLTP to data lake & data warehouse environments

5+ years of solid experience developing software products and/or developing enterprise-scale Data solutions on Cloud Platform

Technical Expertise Requirements

Languages & Tools:

5+ years experience with Python

4+ years of experience with core Java, Java springboot is preferable

Knowledge of IAC using terraform & terragrunt

Cloud Platform

Experience developing Data solutions on AWS platform is preferable

Experience developing frameworks and point solutions for Data ingest, Data processing and Data publishing (AWS platform experience is preferable)

Experience with building Streaming data solutions using Apache Kafka, Apache Flink, Apache Airflow or equivalent

Experience with ingesting data using Kafka connect (AWS managed and/or confluent open source)

Experience developing Data warehouse solutions on Redshift is preferable

Experience managing and developing on big data distributed systems such as hadoop is highly preferable

Databases (RDBMS)

Experience in SQL Server development, including high proficiency in writing and analyzing SQL/T-SQL, and developing/managing SSIS workloads is preferable

SQL Server database performance management background is preferable

Experience with alternate RDBMS technologies such as MySQL or PostgreSQL

Databases (no-sql)

Experience with DynamoDB or MongoDB or Redis

Data APIs

Experience building RESTful interfaces

Experience building graphQL API interfaces

Ci & Cd

Experience in an environment with continuous deployment, integration, automated testing

Experience developing software using agile methodologies delivering solutions within bounded sprints

Production Support

Ability to diagnose and decompose problems at the appropriate levels of the stack

Ability to quickly resolve the problems, keeping in mind upstream and downstream systems dependencies, to bring systems to acceptable SLA levels

Ability to perform root cause analysis (RCA) and suggest & perform system changes ac

cordingly

Innovation Lives Here

You go all in no matter what you do, and so do we. At Lytx, we’re powered by cutting-edge technology and Happy People. You want your work to make a positive impact in the world, and that’s what we do. Join our diverse team of hungry, humble and capable people united to make a difference.

Together, we help save lives on our roadways.

Find out how good it feels to be a part of an inclusive, collaborative team. We’re committed to delivering an environment where everyone feels valued, included and supported to do their best work and share their voices.

Lytx, Inc. is proud to be an equal opportunity/affirmative action employer and maintains a drug-free workplace. We’re committed to attracting, retaining and maximizing the performance of a diverse and inclusive workforce. EOE/M/F/Disabled/Vet.

View Full Job Description

Upload your resume, increase your shortlisting chances by 80%

About The Company

Lytx, Inc.

17 Active Jobs

Lytx is the global leader in fleet management technologies. Our solutions harness the power of video to empower drivers and fleets to be safer and more efficient, productive, and profitable so they can thrive in today’s competitive environment. Through the Lytx platform, direct and reseller clients access our customizable services and programs spanning driver safety, risk detection, fleet tracking, compliance, preventative maintenance, and fuel management. Using the world’s largest driving database of its kind, along with proprietary machine vision and artificial intelligence technology, we help protect and connect thousands of fleets and 1.6 million drivers in more than 60 countries worldwide. Lytx is privately held and headquartered in San Diego, California. For more information, visit us at Lytx.com.

The SurfsightTM solution is Lytx's indirect market offering, available in North America and internationally. Strategic partners and resellers can use Surfsight's open API platform to easily add video to their telematics stack or utilize our stand-alone Surfsight Cloud dashboard to allow fleet managers to track vehicles, view risky and distracted driving events, retrieve videos from the field, and view and analyze data. The innovative technology in the Surfsight dash cam, powered by Lytx, uses robust machine vision and artificial intelligence to proactively detect and mitigate risk. It provides detailed analytics and real-time visibility into overall fleet performance, giving companies valuable data to help increase safety and savings through better fleet management. The solution offers an accessible entry point into video telematics without compromising on features, functionality, and configuration options. For more information visit https://www.lytx.com/en-us/surfsight.