Software Senior Engineer - Bigdata

2 Months ago • 5-8 Years • Software Development & Engineering

Job Summary

Job Description

Boomi is looking for a Software Senior Engineer to join their team in Pune. This role involves designing, developing, and optimizing distributed data processing pipelines using PySpark and Kafka. The engineer will also be responsible for implementing solutions for streaming and batch data efficiently, utilizing Apache Airflow for workflow automation, managing relational and NoSQL databases, writing code in Python or Java, and leveraging AWS or GCP. The ideal candidate will work to ensure real-time and historical data accessibility while optimizing database performance and ensuring data integrity and security. This role offers the opportunity to work on large datasets and contribute to the company's mission of connecting everyone to everything, anywhere.
Must have:
  • Experience with PySpark and Kafka.
  • Proficiency in Apache Airflow.
  • Strong programming skills in Python or Java.
  • Experience with relational and NoSQL databases.
  • Understanding of data pipeline development.
Good to have:
  • Familiarity with time-series databases (Druid, InfluxDB, Prometheus).
  • Experience with AWS or GCP.

Job Details

About Boomi and What Makes Us Special

Are you ready to work at a fast-growing company where you can make a difference? Boomi aims to make the world a better place by connecting everyone to everything, anywhere. Our award-winning, intelligent integration and automation platform helps organizations power the future of business. At Boomi, you’ll work with world-class people and industry-leading technology. We hire trailblazers with an entrepreneurial spirit who can solve challenging problems, make a real impact, and want to be part of building something big. If this sounds like a good fit for you, check out boomi.com  or visit our Boomi Careers page to learn more.

Join us as a Software Sr. Engineer on our Software Engineering team in Pune to do the best work of your career and make a profound social impact.

About us

Boomi’s Cloud API Management, the pioneer in the API management space, was born out of key business needs in the market to enable faster app development and partner growth, provide better, secure API performance, and deliver data-powered insights. We help customers launch their API programs quickly to get new products and services to market faster and connect with business partners more easily to foster innovation and expand routes to market. We can also deliver successful API performance with integrated security, and ensure that analytics and a performance dashboard help users understand what works, what doesn’t, and how to improve governance for the API program.

We are looking for a skilled Big Data Engineer with 5-8 years of experience in managing and processing large datasets, particularly using Big Data technologies. The ideal candidate should have proficiency in tools like PySpark, Kafka, and Airflow, alongside a strong programming background in Python or Java. Additionally, experience with relational databases (e.g., MySQL) and NoSQL databases (e.g., Cassandra, MongoDB, Time-series DB) is essential. Familiarity with cloud platforms like AWS or GCP will be a plus.Key Responsibilities:
  • Big Data Processing: Design, develop, and optimize distributed data processing pipelines using technologies like PySpark and Kafka.
  • Data Integration: Implement solutions to process streaming and batch data efficiently, ensuring real-time and historical data are accessible.
  • Workflow Automation: Utilize Apache Airflow to orchestrate complex workflows and scheduling of data pipeline tasks.
  • Database Management: Work with both relational databases (MySQL) and NoSQL databases (e.g., Cassandra, MongoDB, Time-series DB) to design, maintain, and optimize database solutions for large datasets. Optimize database performance and ensure data integrity and security.
  • Programming: Write robust, efficient, and scalable code in Python or Java for data processing, manipulation, and transformation.
  • Cloud Platforms: Leverage AWS or GCP to build scalable cloud-based data architectures.
  • Debugging: Troubleshoot and resolve data-related issues in a timely manner.
Qualifications:
  • 5-8 years of hands-on experience as a Big Data Engineer, Data Engineer, or similar role.
  • Expertise in Big Data technologies like PySparkKafka, and Apache Airflow.
  • Strong programming skills in Python or Java.
  • Experience working with both relational databases (MySQL) and NoSQL databases (Cassandra, MongoDB, etc.).
  • Solid understanding of data pipeline development, ETL processes, and data warehousing concepts.
  • Familiarity with time-series databases is a plus. (Druid, InfluxDB, Prometheus)
  • Familiarity with Cloud platforms such as AWS (e.g., S3, EC2, EMR) or Google Cloud Platform (GCP).
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills.

#Li-VC1

 

Be Bold. Be You. Be Boomi. We take pride in our culture and core values and are committed to being a place where everyone can be their true, authentic self. Our team members are our most valuable resources, and we look for and encourage diversity in backgrounds, thoughts, life experiences, knowledge, and capabilities.  

All employment decisions are based on business needs, job requirements, and individual qualifications.

Boomi strives to create an inclusive and accessible environment for candidates and employees. If you need accommodation during the application or interview process, please submit a request to talent@boomi.com. This inbox is strictly for accommodations, please do not send resumes or general inquiries. 

Similar Jobs

Netomi - Senior Implementation Consultant

Netomi

Gurugram, India (Remote)
2 Months ago
Prophecy - Delivery Solution Architect

Prophecy

Leeds, England, United Kingdom (On-Site)
2 Months ago
Sonar Source - Research Engineer

Sonar Source

Singapore (On-Site)
6 Months ago
appzen - Data Scientist

appzen

Pune, Maharashtra, India (On-Site)
3 Weeks ago
Rippling - Benefits Operations Analyst, Carrier Connections

Rippling

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Glocomms - Desktop Engineer

Glocomms

New York, United States (On-Site)
2 Weeks ago
Tesla - Fire Sprinkler Engineer

Tesla

Brandenburg, Germany (On-Site)
5 Months ago
Apple - GPU Design Engineer – Memory Hierarchy

Apple

Santa Clara, California, United States (On-Site)
2 Months ago
Progress - Sales Engineer II

Progress

Burlington, Massachusetts, United States (Hybrid)
1 Month ago
Aristocrat - Sr Engineer II

Aristocrat

Noida, Uttar Pradesh, India (Hybrid)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Warner Bros Discovery - Senior Programmer, Rendering

Warner Bros Discovery

Montreal, Quebec, Canada (Hybrid)
2 Months ago
Adyen - AML & Screening Investigations Team Lead

Adyen

Madrid, Community Of Madrid, Spain (On-Site)
1 Week ago
Axon - Senior Electrical Engineer II

Axon

Boston, Massachusetts, United States (On-Site)
2 Months ago
Google - Software Engineer III, Infrastructure, Platforms Infrastructure Engineering

Google

Sunnyvale, California, United States (On-Site)
7 Months ago
Ethos Life - Senior / Staff Product Analyst

Ethos Life

United States (Remote)
1 Month ago
Qualcomm - Staff Embedded Software Development Engineer

Qualcomm

San Diego, California, United States (On-Site)
1 Month ago
Qualcomm - Sr Engineer - C++/Android Framework

Qualcomm

Hyderabad, Telangana, India (On-Site)
2 Months ago
Salesforce - Forward Deployed Engineer - Deployment Strategist (Multiple Levels)

Salesforce

Bellevue, Washington, United States (Remote)
1 Week ago
Scanline VFX - Senior Machine Learning Workflow Engineer

Scanline VFX

Vancouver, British Columbia, Canada (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Pune, Maharashtra, India

Assystems - Senior Urban Planner

Assystems

Hyderabad, Telangana, India (On-Site)
9 Months ago
Qualcomm - Staff Engineer - Developer Advocate

Qualcomm

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Autodesk - Software Engineer

Autodesk

Pune, Maharashtra, India (On-Site)
3 Weeks ago
Ajmera Infotech - CI/CD Pipeline Engineer

Ajmera Infotech

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
Toast - Senior Software Engineering Manager

Toast

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Capgemini - BMC Developer

Capgemini

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Rackspace Technology - Data Engineer III

Rackspace Technology

India (Remote)
1 Week ago
Capgemini - Software Engineer - B

Capgemini

Noida, Uttar Pradesh, India (On-Site)
3 Months ago
Enphase Energy - Engineer - Customer Service Spanish

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Dream Sports - Engineering Manager - Backend

Dream Sports

Mumbai, Maharashtra, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Software Development & Engineering Jobs

Shield AI - Senior Staff Autonomy Engineer, Planning (R2879)

Shield AI

San Diego, California, United States (Remote)
1 Week ago
Crowd Strick - Engineering Manager, Workflow Automation Platform (Remote)

Crowd Strick

United States (Remote)
1 Week ago
Next Level Business Services - SDE 2 (KNOCKOUT Experience)

Next Level Business Services

Redmond, Washington, United States (On-Site)
9 Months ago
Capgemini - SAP CAR Consultant

Capgemini

Tiruchirappalli, Tamil Nadu, India (On-Site)
3 Weeks ago
Google - Software Engineer (For Women in Tech Candidates)

Google

Belo Horizonte, State Of Minas Gerais, Brazil (On-Site)
9 Months ago
NVIDIA - ASIC Design Engineer - Hardware

NVIDIA

Texas, United States (On-Site)
4 Months ago
illumio - Staff Technical Account Manager

illumio

Seoul, South Korea (On-Site)
2 Weeks ago
Apple - Sr. Software Engineer, App Store Engineering

Apple

Seattle, Washington, United States (On-Site)
2 Months ago
Gigamon - Senior Sales Engineer

Gigamon

Seattle, Washington, United States (On-Site)
1 Month ago
CyberArk - Team Leader, Engineering

CyberArk

Sofia, Sofia City Province, Bulgaria (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

At Boomi, we believe in accountability and transparency, and proudly enable innovation. When you work at Boomi, you can be your true, authentic self in our unique, independent culture. Be boldWe take ownership of our work and results, continuously improve, exceed expectations, stay curious, and create for the future while learning from the past. Be youWe build authentic relationships, lead with integrity, and bring our whole selves to our work and interactions with customers, partners, and communities.

Vancouver, British Columbia, Canada (Hybrid)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Conshohocken, Pennsylvania, United States (Hybrid)

View All Jobs

Get notified when new jobs are added by Boomi

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug