PySpark Backend Engineer – AI Security
Job Summary
Job Description
Varonis is seeking a skilled PySpark Backend Engineer to join their expanding team focused on developing cutting-edge cybersecurity products. The role involves designing and implementing backend logic using PySpark within Databricks, focusing on data processing with Spark Structured Streaming. Responsibilities include developing and maintaining microservices and backend components in Python and C#, deployed in Kubernetes environments, and collaborating with product managers and backend teams. Engineers will optimize Spark jobs for performance, reliability, and cost-efficiency in cloud-native environments (Azure), and own features end-to-end, from requirements refinement to deployment and support.
Must have:
- 5+ years backend development experience
- Hands-on PySpark & Spark Structured Streaming
- Solid understanding of Spark internals
- Proficiency in Python
- Microservices with Docker/Kubernetes
Good to have:
- Experience with C#
- Cloud platforms (Azure/AWS/GCP)
- Experience working in Databricks
- Cybersecurity or real-time data processing
9 skills required
Job Details
Summary
Data has never been more valuable and vulnerable. As cybercriminals become more sophisticated and regulations more strict, organizations struggle to answer one key question: “Is my data safe?“
At Varonis, we see the world of cybersecurity differently. Instead of chasing threats, we believe the most practical approach is protecting data from the inside out. We’ve built the industry’s first fully autonomous Data Security Platform to help our customers dramatically reduce risk with minimal human effort.
At Varonis, we move fast. We’re an ultra-collaborative company with brilliant people who care deeply about the details. Together, we’re solving interesting and complex puzzles to keep the world’s data safe.
We work in a flexible, hybrid model, so you can choose the home-office balance that works best for you.
We are seeking a skilled PySpark Backend Engineer to join our expanding team dedicated to developing cutting-edge cybersecurity products from the ground up.
If you possess exceptional programming skills and have a passion for creating new applications or enhancing existing ones, we would love to meet you.
Responsibilities
- Design and implement backend logic using PySpark within Databricks, focusing on data processing using Spark Structured Streaming.
- Develop and maintain microservices and backend components in Python and C#, deployed in Kubernetes environments.
- Collaborate with product managers and backend teams to translate business requirements into Spark-based logic and services.
- Optimize Spark jobs for performance, reliability, and cost-efficiency in a cloud-native environment (Azure).
- Own features end-to-end: from refining requirements with product managers, through design and implementation, to deployment and support.
Requirements
- 5+ years of experience in backend development, with a strong focus on data-intensive applications.
- Hands-on experience with PySpark and Spark Structured Streaming in production environments – must
- Solid understanding of Spark internals, job optimization, and streaming semantics.
- Proficiency in Python. Experience with C# is an advantage.
- Experience building and deploying microservices in Docker/Kubernetes environments. Familiarity with cloud platforms (Azure/AWS/GCP)
- Experience working in Databricks
- Experience in cybersecurity or real-time data processing domains - advantage.
Similar Jobs
UPF Industries
Clinton, North Carolina, United States (On-Site)
• 2 Months ago
Greenworks Sunrise Global Marketing
Morristown, Tennessee, United States (On-Site)
• 1 Week ago
Interactive Brokers
Mumbai, Maharashtra, India (Hybrid)
• 1 Month ago
bytedance
San Jose, California, United States (On-Site)
• 4 Months ago
Varonis
Melbourne, Victoria, Australia (On-Site)
• 3 Weeks ago
bytedance
San Jose, California, United States (On-Site)
• 9 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Foster and partners
London, England, United Kingdom (On-Site)
• 4 Weeks ago
Electronic Arts
Vancouver, British Columbia, Canada (On-Site)
• 1 Month ago
Luma
Palo Alto, California, United States (Hybrid)
• 5 Months ago
Get notifed when new similar jobs are uploaded
Jobs in Herzliya, Tel Aviv District, Israel
NVIDIA
Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
• 5 Months ago
Get notifed when new similar jobs are uploaded
Cyber Security Jobs
Microsoft
(On-Site)
• 3 Months ago
Take-Two Interactive
Las Vegas, Nevada, United States (On-Site)
• 2 Weeks ago
Kirkland, Washington, United States (On-Site)
• 7 Months ago
.png%3F1676067498&w=256&q=50)
Get notifed when new similar jobs are uploaded
