Big Data Engineer

2 Months ago • All levels • Data Analysis • $130,000 PA - $140,000 PA

Job Summary

Job Description

As a Big Data Engineer, you will develop and optimize big data technologies such as Apache Spark and Azure Databricks. You will create robust data pipelines, ensure high data quality, and collaborate closely with cross-functional teams to implement scalable cloud-native solutions on major cloud providers, predominantly Microsoft Azure. You will also be responsible for writing and deploying complex production systems, leveraging Terraform for infrastructure automation, designing and implementing CI/CD pipelines, applying best practices for testing and monitoring, and contributing to system architecture and design. The role involves working within Agile teams and collaborating effectively in a global team environment.
Must have:
  • Develop big data solutions with Apache Spark and Azure Databricks
  • Hands-on experience with Terraform for infrastructure as code
  • Programming expertise in Scala, Java, or Python for complex systems
  • Extensive Python experience, especially in data engineering
  • Background in platform engineering on cloud platforms
  • Practical knowledge of testing frameworks and alerting tools
  • Experience building and maintaining CI/CD pipelines
  • Deep understanding of information modeling and algorithms
  • Hands-on experience with containerization (Docker) and orchestration (Kubernetes)
  • Strong understanding of technical architecture and system design
  • Familiarity with Agile methodologies in software development
Good to have:
  • Experience working with financial or risk management data
  • Knowledge of data governance and security standards
  • Familiarity with additional cloud providers
  • Contributions to open-source data projects
Perks:
  • Highly competitive compensation and benefits package
  • Multinational organization with offices worldwide
  • 10 days of paid annual leave (plus sick leave and national holidays)
  • Maternity & paternity leave plans
  • Comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability
  • Retirement savings plans
  • A higher education certification policy
  • Commuter benefits
  • Extensive training opportunities
  • On-demand Udemy for Business for all employees
  • Coaching opportunities
  • Cutting edge projects at leading financial institutions
  • A flat and approachable organization
  • A truly diverse, fun-loving, and global work culture

Job Details

We are

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,500+, and has 58 offices in 21 countries within key global markets.

Our Challenge
As a Big Data Engineer, candidate will be instrumental in developing and optimizing big data technologies such as Apache Spark and Azure Databricks. Candidate will create robust data pipelines, ensure high data quality, and collaborate closely with cross-functional teams to implement scalable cloud-native solutions on major cloud providers, predominantly Microsoft Azure.

Additional Information*

The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within Weehawken, NJ is $130k - $140k/year & benefits (see below).

 

The Role

Responsibilities:

  • Develop, optimize, and maintain big data pipelines using Apache Spark, Azure Databricks, and related tools.
  • Write and deploy complex production systems in Scala, Java, or Python, ensuring high performance and reliability.
  • Leverage Terraform for automating cloud infrastructure deployment on Azure or other major cloud providers.
  • Design and implement CI/CD pipelines for data workflows using modern tools like GitLab, promoting automation and continuous improvement.
  • Apply best practices for testing, instrumentation, observability, and alerting to maintain data pipeline health and performance.
  • Contribute to system architecture and low-level design, ensuring modularity, scalability, and security.
  • Understand and implement data models, data structures, and algorithms for efficient data processing.
  • Use containerization technologies such as Docker and Kubernetes for development, build, and runtime environments.
  • Work within Agile development teams, participating in planning, daily stand-ups, and iterative releases.
  • Collaborate effectively in a global team, influencing key architectural decisions and sharing best practices.

 

Requirements:

  • Proven experience developing big data solutions with Apache Spark and Azure Databricks.
  • Hands-on experience with Terraform for infrastructure as code (IaC) on major cloud platforms, ideally Azure.
  • Programming expertise in Scala, Java, or Python for complex production systems.
  • Extensive Python experience, especially in data engineering contexts.
  • Background in platform engineering roles on cloud platforms, with strong knowledge of Azure services.
  • Practical knowledge of testing frameworks, instrumentation, observability, and alerting tools.
  • Experience building and maintaining CI/CD pipelines with modern cloud-friendly systems like GitLab.
  • Deep understanding of information modeling, data structures, and algorithms.
  • Hands-on experience with containerization (Docker) and orchestration tools (Kubernetes).
  • Strong understanding of technical architecture and low-level system design.
  • Familiarity with Agile methodologies and best practices in software development.

 

Preferred, but not required:

  • Experience working with financial or risk management data.
  • Knowledge of data governance, security standards, and compliance in cloud environments.
  • Familiarity with additional cloud providers and multi-cloud deployment strategies.
  • Contributions to open-source data projects or communities.

We offer:

  • A highly competitive compensation and benefits package.
  • A multinational organization with 58 offices in 21 countries and the possibility to work abroad.
  • 10 days of paid annual leave (plus sick leave and national holidays).
  • Maternity & paternity leave plans.
  • A comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region).
  • Retirement savings plans.
  • A higher education certification policy.
  • Commuter benefits (varies by region).
  • Extensive training opportunities, focused on skills, substantive knowledge, and personal development.
  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.
  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.
  • Cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms.
  • A flat and approachable organization.
  • A truly diverse, fun-loving, and global work culture.

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.


All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Similar Jobs

Gamezop - Quality Assurance Engineer

Gamezop

India (Remote)
10 Months ago
Scale AI - Senior Product Designer, GenAI Marketplace

Scale AI

San Francisco, California, United States (On-Site)
2 Months ago
Qualcomm - Machine Learning Research Engineer

Qualcomm

San Diego, California, United States (On-Site)
1 Month ago
Zinnia - Director, Client Delivery Lead

Zinnia

San Antonio, Texas, United States (Hybrid)
2 Months ago
Digital sun games - Producer

Digital sun games

Valencia, Valencian Community, Spain (On-Site)
2 Months ago
Capco - SMS Analyst - Data Intelligence

Capco

Brazil (Remote)
6 Months ago
Unity - Senior Big Data & ML Engineer

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (Remote)
4 Months ago
Winzo - Data Analyst

Winzo

New Delhi, Delhi, India (On-Site)
2 Months ago
Nintendo - Senior Business Systems Analyst (Oracle Demantra/EBS)

Nintendo

Redmond, Washington, United States (Hybrid)
10 Months ago
Car Gurus - Product Manager, Data Science & Machine Learning

Car Gurus

Boston, Massachusetts, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Grab - Head, Platform & Financial Operations

Grab

Pasig, Metro Manila, Philippines (On-Site)
1 Month ago
Apple - iPhone Product Design Engineering Project Manager (PD EPM)

Apple

San Diego, California, United States (On-Site)
2 Months ago
Glean - Senior Manager, SDR Field Operations

Glean

United States (Remote)
2 Weeks ago
Luxoft - Business Analyst - Treasury

Luxoft

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Glean - Delivery Excellence Manager

Glean

New York, United States (Hybrid)
2 Weeks ago
Techland - Security Risk Officer

Techland

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
2 Months ago
Aristocrat - Business Analyst

Aristocrat

Las Vegas, Nevada, United States (Hybrid)
1 Month ago
hogarth - Product Graphics Designer

hogarth

Sunnyvale, California, United States (Hybrid)
2 Months ago
Barracuda - Director, Web Marketing

Barracuda

Oregon, United States (Remote)
1 Month ago
Apple - Core OS Software Engineer - Darwin Server

Apple

Cupertino, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Weehawken Township, New Jersey, United States

SBM Management - Account Manager, Soft Services

SBM Management

San Francisco, California, United States (On-Site)
1 Month ago
Thatgamecompany - General Design

Thatgamecompany

United States (Remote)
4 Months ago
Coherent corp. - Sales Director

Coherent corp.

Seattle, Washington, United States (Hybrid)
1 Month ago
Playstation - QA Automation Engineer II

Playstation

Madison, Wisconsin, United States (On-Site)
2 Months ago
Notion - Engineering Manager, Web Infrastructure

Notion

San Francisco, California, United States (On-Site)
2 Months ago
GoMotive - Senior Strategic Sales Development Representative

GoMotive

Austin, Texas, United States (On-Site)
2 Weeks ago
Cadence - IT - Sr Systems Engineer (OpenStack & Nutanix Administration)

Cadence

San Jose, California, United States (On-Site)
2 Months ago
Apple - Software Engineering Program Manager, System Experience

Apple

Cupertino, California, United States (On-Site)
2 Months ago
Clearwater Analytics - Vice President, Software Development

Clearwater Analytics

New York, United States (On-Site)
1 Year ago
Qualcomm - Manager, Corporate Communications

Qualcomm

Washington, District Of Columbia, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Autodesk - Data Engineer

Autodesk

Toronto, Ontario, Canada (Hybrid)
1 Month ago
Cognite - Senior Data Engineer

Cognite

Bengaluru, Karnataka, India (Hybrid)
10 Months ago
Rippling - Senior Software Engineer - Data Bridge

Rippling

Seattle, Washington, United States (On-Site)
1 Month ago
Tide - Senior Engineer, Python (Data & AI)

Tide

Belgrade, Serbia (Hybrid)
2 Months ago
Activision - Staff Data Analyst

Activision

New York, United States (On-Site)
1 Month ago
OKX - Data Architect

OKX

Singapore, Singapore (On-Site)
9 Months ago
Nasdaq - Salesforce Business Analyst

Nasdaq

Taguig, Metro Manila, Philippines (Hybrid)
2 Months ago
Meta - Data Science Director

Meta

Menlo Park, California, United States (Remote)
8 Months ago
Car Gurus - Product Manager, Data Science & Machine Learning

Car Gurus

Boston, Massachusetts, United States (Hybrid)
1 Month ago
Nagarro - Associate Staff Engineer, Big Data

Nagarro

(On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

About The Company

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies spanend-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in ourFinLabswe develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more.Over the last20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of14,500+,and has58offices in 21 countrieswithin key global markets.For more information on the company, please visit ourwebsiteorLinkedIncommunity.

Novi Sad, Vojvodina, Serbia (Hybrid)

Mississauga, Ontario, Canada (On-Site)

Bengaluru, Karnataka, India (On-Site)

Novi Sad, Vojvodina, Serbia (Hybrid)

Dallas, Texas, United States (On-Site)

Pune, Maharashtra, India (On-Site)

Mississauga, Ontario, Canada (On-Site)

Pune, Maharashtra, India (On-Site)

Pittsburgh, Pennsylvania, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Synechron

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug