Lead Data Engineer

1 Month ago • 3 Years +
Data Analysis

Job Description

The Lead Data Engineer is an experienced data pipeline builder and data wrangler, focused on optimizing data systems and building new solutions. This role involves working with developers, architects, product managers, and data analysts on data initiatives. Key responsibilities include ensuring optimal data delivery with good performance and uptime metrics, and contributing to data pipeline architecture and implementation.
Must Have:
  • Create, enhance, and maintain optimal data pipeline architecture.
  • Analyze data sets to meet business requirements.
  • Design and implement data process automation.
  • Build infrastructure and tools to increase data ETL velocity.
  • Collaborate with data and analytics experts on product features.
  • Provide life cycle support for Data Engineering team products.
  • Review design documents and code, provide feedback.
  • Test and deploy programs and applications.
  • Improve product quality, security, and performance.
  • Bachelor’s degree in Computer Science or related field.
  • 5-8 years of Software Development experience.
  • 3+ years of Data Engineer experience.
  • Familiarity with Agile software design processes.
  • Experience building and optimizing big data pipelines.
  • Proficiency with Hadoop, Spark, Kafka.
  • Experience with relational SQL databases (PostgreSQL, MySQL).
  • Knowledge of stream-processing systems (Flink, KSQL, Spark-Streaming).
  • Proficiency in Java, Scala, Python.
  • Experience with cloud data engineering (AWS).
  • Strong analytical skills for structured and unstructured datasets.
  • Knowledge of message queuing and scalable big data stores.
Perks:
  • Competitive total compensation
  • Flexible/remote work
  • Inclusive, collaborative, and transparent organizational culture

Add these skills to join the top 1% applicants for this job

team-management
communication
data-analytics
game-texts
agile-development
postgresql
mysql
aws
hadoop
spark
python
sql
scala
java

Who We're Looking For

The Lead Data Engineer is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems or building new solutions from ground up. This role will work with developers, architects, product managers and data analysts on data initiatives and ensure optimal data delivery with good performance and uptime metrics.

Your behaviors align strongly with our values because ours do.

Some of What You'll Do

Scope of the Role:

  • Direct Reports: This is an individual contributor role with no direct reports

Key Responsibilities

  • Create, enhance, and maintain optimal data pipeline architecture and implementations.
  • Analyze data sets to meet functional / non-functional business requirements.
  • Identify, design, and implement data process: automating processes, optimizing data delivery, etc.
  • Build infrastructure and tools to increase data ETL velocity.
  • Work with data and analytics experts to implement and enhance analytic product features.
  • Provide life cycle support the Operations team for existing products, services, and functionality assigned to the Data Engineering team.
  • Review design documents and code to provide constructive feedback.
  • Testing and deploying programs and applications.
  • Constantly improve product quality, security, and performance.

Experience, Education, and Certifications:

  • Bachelor’s degree in Computer Science, Statistics, Informatics or related field or equivalent work experience.
  • 5-8 years of Software Development experience
  • 3+ years of experience in Data Engineer fields.

Additional Requirements:

  • Familiar with Agile software design processes and methodologies.
  • Experience in building and optimizing big data pipelines, architectures, and data sets:
  • Experience with big data tools: Hadoop, Spark, Kafka, etc.
  • Experience with relational SQL databases, such as PostgreSQL, MySQL, etc.
  • Experience with stream-processing systems: Flink, KSQL, Spark-Streaming, etc.
  • Experience with programming languages, such as Java, Scala, Python, etc.
  • Experience with cloud data engineering and development, such as AWS, etc.
  • Good analytic skills related to working with structured and unstructured datasets.
  • Knowledge of message queuing, stream processing and scalable big data stores.
  • Ownership/accountability for tasks/projects with on time and quality deliveries.
  • Good verbal and written communication skills.
  • Teamwork with independent design and development habits.
  • Work with a sense of urgency and positive attitude.

Why You Should Join Us

Join us as we write a new chapter, guided by world-class leadership. Come be a part of an exciting and growing organization where we offer a competitive total compensation, flexible/remote work and with a leadership team committed to fostering an inclusive, collaborative, and transparent organizational culture.

At Syniverse connectedness is at the core of our business. We believe diversity, equity, and inclusion among our employees is crucial to our success as a global company as we seek to recruit, develop, and retain the most talented people who want to help us connect the world.

Know someone at Syniverse?

Be sure to have them submit you as a referral prior to applying for this position.

Set alerts for more jobs like Lead Data Engineer
Set alerts for new jobs by Syniverse
Set alerts for new Data Analysis jobs in India
Set alerts for new jobs in India
Set alerts for Data Analysis (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙