Big Data Engineer

4 Months ago • 8 Years + • Data Analysis

Job Summary

Job Description

As a Big Data Engineer at Ness, you will design and develop software using cutting-edge technologies like web applications, data pipelines, big data, machine learning, and multi-cloud platforms. Responsibilities include building ingestion pipelines using ELT and schema on read in Databricks Delta Lake, designing data transformations at scale, and working with AWS services (S3, Hive, Databricks). You'll ensure data governance, quality, and lineage, collaborate with data and data science teams, and stay updated on big data and cloud trends. The role requires expertise in Scala, Python, Spark, and experience with high-volume data and computationally intensive systems.
Must have:
  • 8+ years application development experience
  • Experience with AWS (S3, Hive, Databricks)
  • Proficiency in Scala, Python, Spark
  • ELT framework and Delta Lake expertise
  • Data governance and quality implementation
Good to have:
  • Financial industry domain knowledge
  • Experience with Java garbage collection tuning
Perks:
  • Access to trainings and certifications
  • Bonuses and aids
  • Socializing activities
  • Attractive compensation

Job Details

Description

Position at Ness Romania SRL

Why Ness

We know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most innovative software companies in the world.

You’ll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression.

You’ll also benefit from an array of advantages like access to trainings and certifications, bonuses, and aids, socializing activities, and attractive compensation.

Requirements and responsibilities

We are looking for a self-motivated, enthusiastic, and passionate software engineer to develop technology solutions for the Ness marketplace product.

The ideal candidate thrives in a highly technical role and will design and develop software using cutting-edge web applications, data pipelines, big data, machine learning, and multi-cloud technologies.

The development is already underway, so the candidate would be expected to get up to speed quickly and start contributing.

You will enable Ness business to showcase our proprietary Ness data, combine it with “curated” alternative data, further enrich it with value-add services from Kensho and others, and deliver it via the clients’ channel of choice to help them make better investment and business decisions, with confidence.

What you can expect: An unmatched experience in handling huge volumes of data, analytics, visualization, and services over cloud technologies along with appreciation in product development life cycle to convert an idea into revenue generating stream.

What you'll do

  • Design & Build ingestion pipelines using ELT and schema on read in Databricks Delta lake;
  • Design & Develop “Transformations” aspects using ELT framework to modernize the Ingestion pipelines and build data transformations at scale;
  • Provide technical expertise in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and Spark;
  • Build and maintain a data environment for speed, accuracy, consistency, and "up" time;
  • Work closely with other data teams & Data Science team and participate in the development of Ingestion pipelines;
  • Ensure data governance principles are adopted, data quality checks and data lineage are implemented in each hop of the data;
  • Be in tune with emerging trends Big data and cloud technologies and participate in the evaluation of new technologies;
  • Ensure compliance through adopting enterprise standards and promoting best practices/guiding principles aligned with organization standards.

What you'll bring

  • A minimum of 8+ years of significant experience in application development;
  • Previous experience in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and Spark;
  • Development, design, and architecture exposure & the ability to ensure quality across various technology components that are developed by geographically diversified software engineers with superior knowledge of system architecture, object-oriented design, and design patterns;
  • Proficient with software development lifecycle (SDLC) methodologies like Agile and test-driven development;
  • Experience working with high-volume data and computationally intensive systems;
  • Garbage collection friendly programming experience - tuning Java garbage collection & performance is a must;
  • Proficiency in the development environment, including IDE, web & application server, GIT, Continuous Integration, unit-testing tools, and defect management tools Domain knowledge in the Financial Industry and Capital Markets is a plus;
  • Excellent communication skills are essential, with strong verbal and writing proficiencies;
  • Mentor teams, innovate and experiment, give a face to business ideas, and present to key stakeholders.

Not checking every single requirement?

If this role sounds good to you, even if you don’t meet every single bullet point in the job description, we encourage you to apply anyway. For most of the candidates that applied, we found a role that was a very good fit with their skills.

Let’s meet and you may just be the right candidate for one of our roles.

At Ness Digital Engineering we are willing to build a work culture that is based on diversification, inclusion, and authenticity.

Similar Jobs

Ion - Services Director

Ion

New York, New York, United States (On-Site)
8 Months ago
PwC - Financial Services GRC Senior Associate

PwC

Makati City, Metro Manila, Philippines (On-Site)
8 Months ago
Sleeper - Motion Graphic Designer (Mid-level)

Sleeper

Seattle, Washington, United States (Remote)
3 Months ago
Canva - Frontend Engineer – Export Team

Canva

Auckland, Auckland, New Zealand (Remote)
3 Months ago
Tesla - Sales Advisor

Tesla

Berlin, Berlin, Germany (On-Site)
4 Months ago
GoTo Group - Lead Data Scientist - KYC

GoTo Group

Singapore (On-Site)
6 Months ago
Rovio  - Lead/Principal Data Engineer

Rovio

Helsinki, Uusimaa, Finland (On-Site)
1 Month ago
Ion - Data Engineer

Ion

Budapest, Hungary (On-Site)
8 Months ago
Wildlife Studios - Senior Data Scientist

Wildlife Studios

São Paulo, Brazil (On-Site)
1 Month ago
Saviynt - Senior Data Analyst, Sales

Saviynt

United States (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NCR Voyix - Information Security Engineer III

NCR Voyix

Gurugram, India (On-Site)
1 Month ago
Qualcomm - Staff, Mobile Game Product Management

Qualcomm

San Diego, California, United States (On-Site)
1 Month ago
Tesla - Service Team Lead, Order Preparation & Remote Diagnostics

Tesla

Hanover, Lower Saxony, Germany (On-Site)
4 Months ago
WebTech Corporation - Plant Manager

WebTech Corporation

Erie, Pennsylvania, United States (On-Site)
2 Weeks ago
Neolytix - Sales Development Representative (Healthcare Services)

Neolytix

Chicago, Illinois, United States (Hybrid)
2 Weeks ago
NVIDIA - Senior SWQA Test Development Engineer

NVIDIA

Shanghai, Shanghai, China (On-Site)
3 Months ago
Riot Games - Manager, Software Engineering - Teamfight Tactics, Gameplay

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
USE Insider - Client Partner Director

USE Insider

Istanbul, İstanbul, Türkiye (On-Site)
4 Months ago
Optiv - Consultant - Enterprise Incident Management

Optiv

Fort Worth, Texas, United States (Remote)
2 Weeks ago
Match Group - Director, Marketing

Match Group

Seoul, South Korea (Hybrid)
7 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Timișoara, Timiș, Romania

Playtech - Greek Dealer

Playtech

Bucharest, Bucharest, Romania (On-Site)
8 Months ago
EveryMatrix - Incident Manager

EveryMatrix

Bucharest, Bucharest, Romania (Hybrid)
2 Months ago
Tide - Senior Engineer, Python (Data & AI)

Tide

Romania (Hybrid)
1 Month ago
GoDaddy - Product Manager

GoDaddy

Iași, Iași County, Romania (Remote)
3 Weeks ago
luxsoft - Senior Java/Kotlin developer

luxsoft

Bucharest, Bucharest, Romania (On-Site)
1 Month ago
endava - Network Support Engineer

endava

Timișoara, Timiș, Romania (On-Site)
4 Weeks ago
endava - Senior Python Automation Tester

endava

Bucharest, Bucharest, Romania (On-Site)
2 Weeks ago
London stock Exchange - Lead Quality Engineer

London stock Exchange

Bucharest, Bucharest, Romania (On-Site)
1 Month ago
Ubisoft - Engine Programmer

Ubisoft

Bucharest, Bucharest, Romania (Hybrid)
2 Months ago
Amber - Senior 2D Artist - Casual

Amber

Bucharest, Bucharest, Romania (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Springer Group - Data Engineer

Springer Group

Groningen, Groningen, Netherlands (On-Site)
1 Month ago
endava - Senior Data Analyst

endava

Cali, Valle Del Cauca, Colombia (On-Site)
3 Weeks ago
Capco - Data Analyst

Capco

Rio De Janeiro, Brazil (Hybrid)
4 Weeks ago
Razer - Senior Data & Reporting Engineer

Razer

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
3 Weeks ago
Bestex Research - Senior Data Engineer

Bestex Research

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Marsh McLennan - Intern, Data Analyst

Marsh McLennan

Singapore (Hybrid)
1 Month ago
Qualcomm - Systems/Data Staff Engineer – Sensors

Qualcomm

Shanghai, China (On-Site)
1 Month ago
PwC - Solution Data Architect – Technology Consulting

PwC

Prague, Prague, Czechia (On-Site)
8 Months ago
Thumbtack - Senior Data Engineer

Thumbtack

Ontario, Canada (Remote)
1 Month ago
ib3 global sol - SPA Data Scientist SME II

ib3 global sol

Albuquerque, New Mexico, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Prague, Prague, Czechia (Hybrid)

Iași, Iași County, Romania (On-Site)

United States (Remote)

Iași, Iași County, Romania (On-Site)

Iași, Iași County, Romania (On-Site)

Prague, Czechia (On-Site)

Ontario, Canada (On-Site)

Ontario, Canada (Hybrid)

View All Jobs

Get notified when new jobs are added by ness digital

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug