Big Data Engineer

1 Month ago • 10 Years + • Data Analysis • $100,000 PA - $110,000 PA

Job Summary

Job Description

Seeking a Senior Big Data Engineer with over a decade of experience in building large-scale data solutions using Hadoop and Spark ecosystems. The role involves designing and optimizing data pipelines, building data lakes, developing ETL workflows, collaborating with Data Scientists and Analysts, tuning and troubleshooting jobs, implementing security best practices, mentoring junior team members, and staying current with the latest technologies. The engineer will work on cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms.
Must have:
  • 10+ years in big data engineering with Hadoop and Spark.
  • Experience with Hadoop ecosystem components: HDFS, MapReduce, YARN.
  • Proficiency in Apache Spark (Scala, Python, or Java).
Good to have:
  • Experience with Spark Streaming and real-time data processing.
  • Knowledge of advanced analytics and machine learning pipelines.
  • Experience with automation and orchestration tools like Apache Airflow.
Perks:
  • Competitive compensation and benefits.
  • Opportunity to work abroad.
  • Paid annual leave, sick leave, and national holidays.
  • Comprehensive insurance plan.
  • Retirement savings plans.
  • Higher education certification policy.
  • Commuter benefits.
  • Extensive training opportunities.
  • Access to Udemy for Business.
  • Coaching opportunities.
  • Cutting edge projects.
  • Diverse and global work culture.

Job Details

We are

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,500+, and has 58 offices in 21 countries within key global markets.

Our challenge

We are looking for a highly skilled and experienced Senior Big Data Engineer with over a decade of expertise in building large-scale data solutions utilizing Hadoop and Spark ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing complex data processing architectures to enable advanced analytics, machine learning, and reporting platforms.

Additional Information* 

The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within Charlotte, NC is $100k - $110k/year & benefits (see below).

The Role

Responsibilities:

  • Design, develop, and optimize big data pipelines and processing frameworks using Hadoop (HDFS, MapReduce, YARN) and Apache Spark.

  • Build scalable data ingestion processes and data lakes for diverse data sources.

  • Develop and maintain ETL workflows that handle processing of structured and unstructured data.

  • Collaborate with Data Scientists, Analysts, and Business Teams to translate requirements into technical solutions.

  • Tune and troubleshoot Spark and Hadoop jobs for maximum efficiency and performance.

  • Implement data security, privacy, and compliance best practices across all platforms.

  • Mentor junior team members and foster best practices in big data development.

  • Stay current with emerging trends and technologies related to Hadoop and Spark.

  • Document architecture, workflows, and standards for maintainability and knowledge sharing.

Requirements:
  • Bachelor’s, Master’s, or Ph.D. in Computer Science, Information Technology, or related field.

  • 10+ years of industry experience in big data engineering with proven expertise in Hadoop and Spark technologies.

  • Extensive experience with Hadoop ecosystem components: HDFS, MapReduce, YARN, Hive, Pig, HBase, and Oozie.

  • Strong proficiency in Apache Spark (Scala, Python, or Java) and Spark SQL.

  • Experience with data ingestion tools such as Apache NiFi, Kafka, or Flume.

  • Hands-on experience with cloud platforms (AWS, Azure, GCP) and their big data services integrated with Hadoop/Spark.

  • Knowledge of data modeling, data warehousing, and database technologies (NoSQL, relational systems).

  • Familiarity with containerization and orchestration tools like Docker and Kubernetes.

  • Familiar with data governance, security, and compliance standards.

  • Excellent problem-solving, system architecture, and communication skills.

Preferred, but not required:
  • Experience with Spark Streaming and real-time data processing.

  • Knowledge of advanced analytics, machine learning pipelines, and integration with Spark MLlib.

  • Experience with automation and orchestration tools such as Apache Airflow.

  • Familiarity with version control and CI/CD practices for big data platforms.

We offer:
  • A highly competitive compensation and benefits package.

  • A multinational organization with 58 offices in 21 countries and the possibility to work abroad.

  • 10 days of paid annual leave (plus sick leave and national holidays).

  • Maternity & paternity leave plans.

  • A comprehensive insurance plan including medical, dental, vision, life insurance, and long-/short-term disability (plans vary by region).

  • Retirement savings plans.

  • A higher education certification policy.

  • Commuter benefits (varies by region).

  • Extensive training opportunities, focused on skills, substantive knowledge, and personal development.

  • On-demand Udemy for Business for all Synechron employees with free access to more than 5000 curated courses.

  • Coaching opportunities with experienced colleagues from our Financial Innovation Labs (FinLabs) and Center of Excellences (CoE) groups.

  • Cutting edge projects at the world’s leading tier-one banks, financial institutions and insurance firms.

  • A flat and approachable organization.

  • A truly diverse, fun-loving, and global work culture.

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.


All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Similar Jobs

Bosch Group India - S/4 HANA HR ABAP With CPI

Bosch Group India

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Ramboll3 - Consultant - Sustainable Finance

Ramboll3

Aix-en-Provence, Provence-Alpes-Côte D'Azur, France (Hybrid)
2 Months ago
Ansys - Product Specialist II

Ansys

Waterloo, Ontario, Canada (On-Site)
1 Month ago
Ubisoft - Project Manager Assistant – Online Services

Ubisoft

Paris, Île-de-France, France (On-Site)
2 Months ago
Epic Games - Director, User Experience Research

Epic Games

Cary, North Carolina, United States (On-Site)
3 Months ago
Marsh McLennan - Data Scientist

Marsh McLennan

Mexico City, Mexico (Hybrid)
1 Month ago
bytedance - Senior Site Reliability Engineer - Data Infrastructure (Seattle)

bytedance

Seattle, Washington, United States (On-Site)
8 Months ago
Razer - Senior Data Analyst

Razer

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
2 Days ago
GoTo Group - Transport Marketing Data Analyst

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
3 Months ago
Capgemini - Data Analytics Lead

Capgemini

Mumbai, Maharashtra, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Epic Games - Core Tech Programmer

Epic Games

Cary, North Carolina, United States (On-Site)
2 Months ago
attentive - Sales Development Representative

attentive

London, England, United Kingdom (Hybrid)
3 Weeks ago
ISS Stoxx - Senior Software Engineer in .NET/Java and SQL (Oracle)

ISS Stoxx

Mumbai, Maharashtra, India (On-Site)
1 Month ago
plana technologies - Senior IT Identity Specialist

plana technologies

Tlalnepantla De Baz, State Of Mexico, Mexico (Remote)
1 Week ago
Sony Pictures Entertainment - Director, Rights & Clearances

Sony Pictures Entertainment

Culver City, California, United States (Hybrid)
1 Month ago
CD PROJEKT RED - Asset Artist (Geology Environment)

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (Hybrid)
3 Months ago
Morning Star - Assistant Vice President - Sovereign Credit Ratings

Morning Star

Toronto, Ontario, Canada (Hybrid)
1 Day ago
Alation - Sr. Technical Escalation Manager

Alation

Austin, Texas, United States (Remote)
2 Months ago
Gala games - Senior Back End Engineer

Gala games

Pakistan (On-Site)
4 Months ago
Wargaming - Lead Level Artist (World of Tanks)

Wargaming

Warsaw, Masovian Voivodeship, Poland (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Charlotte, North Carolina, United States

NBC Universal - DayPart Manager

NBC Universal

Chicago, Illinois, United States (On-Site)
2 Months ago
Technicon design - CAD Digital Designer

Technicon design

California, United States (Hybrid)
1 Month ago
Postman - Staff Engineer, Developer Tooling

Postman

Boston, Massachusetts, United States (Hybrid)
2 Months ago
bytedance - Frontend Software Engineer - Customer Service Platforms - Seattle

bytedance

Seattle, Washington, United States (On-Site)
8 Months ago
Epic Games - Senior DevOps Programmer

Epic Games

Cary, North Carolina, United States (On-Site)
4 Months ago
playbrains - 3D Artist

playbrains

New York, United States (On-Site)
2 Weeks ago
bytedance - Research Engineer Graduate (Vision AI Platform)

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago
Nintendo - Associate Configuration Support Specialist

Nintendo

Redmond, Washington, United States (Hybrid)
1 Year ago
Nintendo - Events Marketing Specialist (LatAm)

Nintendo

Redmond, Washington, United States (Hybrid)
7 Months ago
Salesforce - Business Development Representative - West

Salesforce

California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Nagarro - Senior Staff Consultant ,SAP Analytics Data Manageme

Nagarro

India (Remote)
8 Months ago
Salesforce - Principal Solution Engineer, Data Cloud

Salesforce

Dallas, Texas, United States (On-Site)
4 Days ago
Tencent - Workday Business Analyst - HCM

Tencent

California, United States (On-Site)
4 Months ago
Philips - Business Analyst

Philips

Chennai, Tamil Nadu, India (Hybrid)
1 Year ago
Revolgy - Data & AI Cloud Engineer

Revolgy

London, England, United Kingdom (Remote)
1 Month ago
Thales - Data Visualization Power BI Engineer

Thales

Lille, Hauts-de-France, France (Hybrid)
1 Month ago
playrix  - Data QA Engineer

playrix

Ukraine (Remote)
8 Months ago
Autodesk - Business Systems Analyst (RPA, Automation)

Autodesk

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Roblox - Senior Data Scientist - Creator

Roblox

San Mateo, California, United States (On-Site)
1 Month ago
truecaller - Senior Data Scientist

truecaller

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies spanend-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in ourFinLabswe develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more.Over the last20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of14,500+,and has58offices in 21 countrieswithin key global markets.For more information on the company, please visit ourwebsiteorLinkedIncommunity.

Bengaluru, Karnataka, India (On-Site)

Charlotte, North Carolina, United States (On-Site)

Belgrade, Serbia (Hybrid)

Hyderabad, Telangana, India (On-Site)

Montreal, Quebec, Canada (On-Site)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

View All Jobs

Get notified when new jobs are added by Synechron

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug