Big Data Engineer

2 Months ago • 10 Years + • Data Analysis • $100,000 PA - $110,000 PA

Job Summary

Job Description

Seeking a Senior Big Data Engineer with over a decade of experience in building large-scale data solutions using Hadoop and Spark ecosystems. The role involves designing and optimizing data pipelines, building data lakes, developing ETL workflows, collaborating with Data Scientists and Analysts, tuning and troubleshooting jobs, implementing security best practices, mentoring junior team members, and staying current with the latest technologies. The engineer will work on cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms.
Must have:
  • 10+ years in big data engineering with Hadoop and Spark.
  • Experience with Hadoop ecosystem components: HDFS, MapReduce, YARN.
  • Proficiency in Apache Spark (Scala, Python, or Java).
Good to have:
  • Experience with Spark Streaming and real-time data processing.
  • Knowledge of advanced analytics and machine learning pipelines.
  • Experience with automation and orchestration tools like Apache Airflow.
Perks:
  • Competitive compensation and benefits.
  • Opportunity to work abroad.
  • Paid annual leave, sick leave, and national holidays.
  • Comprehensive insurance plan.
  • Retirement savings plans.
  • Higher education certification policy.
  • Commuter benefits.
  • Extensive training opportunities.
  • Access to Udemy for Business.
  • Coaching opportunities.
  • Cutting edge projects.
  • Diverse and global work culture.

Job Details

We are

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,500+, and has 58 offices in 21 countries within key global markets.

Our challenge

We are looking for a highly skilled and experienced Senior Big Data Engineer with over a decade of expertise in building large-scale data solutions utilizing Hadoop and Spark ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing complex data processing architectures to enable advanced analytics, machine learning, and reporting platforms.

Additional Information* 

The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within Charlotte, NC is $100k - $110k/year & benefits (see below).

The Role

Responsibilities:

  • Design, develop, and optimize big data pipelines and processing frameworks using Hadoop (HDFS, MapReduce, YARN) and Apache Spark.

  • Build scalable data ingestion processes and data lakes for diverse data sources.

  • Develop and maintain ETL workflows that handle processing of structured and unstructured data.

  • Collaborate with Data Scientists, Analysts, and Business Teams to translate requirements into technical solutions.

  • Tune and troubleshoot Spark and Hadoop jobs for maximum efficiency and performance.

  • Implement data security, privacy, and compliance best practices across all platforms.

  • Mentor junior team members and foster best practices in big data development.

  • Stay current with emerging trends and technologies related to Hadoop and Spark.

  • Document architecture, workflows, and standards for maintainability and knowledge sharing.

Requirements:
  • Bachelor’s, Master’s, or Ph.D. in Computer Science, Information Technology, or related field.

  • 10+ years of industry experience in big data engineering with proven expertise in Hadoop and Spark technologies.

  • Extensive experience with Hadoop ecosystem components: HDFS, MapReduce, YARN, Hive, Pig, HBase, and Oozie.

  • Strong proficiency in Apache Spark (Scala, Python, or Java) and Spark SQL.

  • Experience with data ingestion tools such as Apache NiFi, Kafka, or Flume.

  • Hands-on experience with cloud platforms (AWS, Azure, GCP) and their big data services integrated with Hadoop/Spark.

  • Knowledge of data modeling, data warehousing, and database technologies (NoSQL, relational systems).

  • Familiarity with containerization and orchestration tools like Docker and Kubernetes.

  • Familiar with data governance, security, and compliance standards.

  • Excellent problem-solving, system architecture, and communication skills.

Preferred, but not required:
  • Experience with Spark Streaming and real-time data processing.

  • Knowledge of advanced analytics, machine learning pipelines, and integration with Spark MLlib.

  • Experience with automation and orchestration tools such as Apache Airflow.

  • Familiarity with version control and CI/CD practices for big data platforms.

We offer:
  • A highly competitive compensation and benefits package.

  • A multinational organization with 58 offices in 21 countries and the possibility to work abroad.

  • 10 days of paid annual leave (plus sick leave and national holidays).

  • Maternity & paternity leave plans.

  • A comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region).

  • Retirement savings plans.

  • A higher education certification policy.

  • Commuter benefits (varies by region).

  • Extensive training opportunities, focused on skills, substantive knowledge, and personal development.

  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.

  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.

  • Cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms.

  • A flat and approachable organization.

  • A truly diverse, fun-loving, and global work culture.

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.


All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Similar Jobs

Glean - Business Development Representative

Glean

Japan (Remote)
9 Months ago
Zamp - Talent Recruiter

Zamp

Bengaluru, Karnataka, India (On-Site)
1 Year ago
King - Senior Designer - Immersive Ad Formats (Gaming)

King

San Francisco, California, United States (On-Site)
3 Weeks ago
PwC - Data Architecture - Senior Manager

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
2 Months ago
CGS Carrers - Front End Software Developer

CGS Carrers

Guadalajara, Jalisco, Mexico (Remote)
3 Weeks ago
plana technologies - Data Architect

plana technologies

Maldonado Department, Uruguay (Remote)
2 Months ago
Figma - Data Engineer

Figma

United States (Remote)
3 Weeks ago
Cineplex - Analyst, Data & Insights

Cineplex

Toronto, Ontario, Canada (Hybrid)
3 Weeks ago
Make - Data Engineer

Make

Madrid, Community Of Madrid, Spain (On-Site)
3 Months ago
Tesla - Business Planning Analyst

Tesla

Berlin, Berlin, Germany (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Boomi  - Consultant, Customer Journey

Boomi

Vancouver, British Columbia, Canada (Hybrid)
1 Month ago
160over90 - Account Executive, Partnerships

160over90

Chicago, Illinois, United States (On-Site)
3 Weeks ago
Ion - Data Operations ( Markets - Shared Services)

Ion

Woking, England, United Kingdom (On-Site)
10 Months ago
Marvell - Senior Staff Software Engineer

Marvell

Santa Clara, California, United States (On-Site)
3 Weeks ago
Optiv - Technical Manager - IGA

Optiv

United States (Remote)
3 Weeks ago
Canva - Staff Frontend Engineer - Apps API Platform

Canva

Auckland, Auckland, New Zealand (Remote)
4 Months ago
Yahoo - Principal Software Development Engineer

Yahoo

Ireland (Remote)
1 Month ago
Rackspace Technology - Senior Data Architect - Azure Data Services

Rackspace Technology

United States (Remote)
1 Month ago
Capgemini - Business Analyst (BFSI)

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Charlotte, North Carolina, United States

Twitch - Principal UX Designer

Twitch

San Francisco, California, United States (On-Site)
1 Month ago
Electronic Arts - Director, Battlefield Performance Media

Electronic Arts

Los Angeles, California, United States (Hybrid)
1 Month ago
Polygon Labs - Engineering Lead - Fintech

Polygon Labs

United States (Remote)
1 Month ago
Rackspace Technology - Lead Platform Enterprise Architect

Rackspace Technology

San Antonio, Texas, United States (Remote)
1 Month ago
Scout - Senior Engineer, Whole Vehicle EMC Test & Verification

Scout

Novi, Michigan, United States (On-Site)
1 Month ago
Jane Street - Data Center Mechanical Engineer

Jane Street

New York, United States (On-Site)
2 Months ago
Nintendo - Intern – Machine Learning Software Engineer (NTD)

Nintendo

Redmond, Washington, United States (On-Site)
8 Months ago
Twitch - Business Development Manager

Twitch

San Francisco, California, United States (On-Site)
1 Month ago
Crunchyroll - iOS Engineering Manager

Crunchyroll

Culver City, California, United States (Remote)
8 Months ago
Spaulding Ridge - OneStream GTM Director

Spaulding Ridge

Chicago, Illinois, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Trek - Marketing Data Analyst

Trek

Haryana, India (On-Site)
6 Months ago
GameChanger - Data Platform Engineer

GameChanger

United States (Remote)
4 Months ago
binance - Senior Data Scientist (Onchain Analytics)

binance

Taipei City, Taiwan (On-Site)
1 Year ago
blend - Senior Data Scientist

blend

Hyderabad, Telangana, India (On-Site)
1 Month ago
Scopely - Senior Data Analyst, Marketing Analytics

Scopely

Mexico City, Mexico (Hybrid)
3 Months ago
attentive - Senior Software Engineer, Data Platform

attentive

United States (Remote)
1 Month ago
Apple - Data Scientist

Apple

Sunnyvale, California, United States (On-Site)
3 Weeks ago
Corsair - Business Intelligence Data Analyst

Corsair

Milpitas, California, United States (On-Site)
4 Months ago
Glean - Staff Data Engineer

Glean

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
CrazyLabs - Data Engineer

CrazyLabs

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies spanend-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in ourFinLabswe develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more.Over the last20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of14,500+,and has58offices in 21 countrieswithin key global markets.For more information on the company, please visit ourwebsiteorLinkedIncommunity.

Sterling, Virginia, United States (On-Site)

Bengaluru, Karnataka, India (On-Site)

Pune, Maharashtra, India (On-Site)

Jersey City, New Jersey, United States (On-Site)

New York, United States (On-Site)

Pittsburgh, Pennsylvania, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Synechron

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug