Big Data Engineer

3 Weeks ago • 8 Years + • Data Analyst

Job Summary

Job Description

Ness Romania SRL seeks a Big Data Engineer (T6) to design and develop software solutions for their marketplace product. This role involves building data pipelines using ELT and schema on read in Databricks Delta Lake, developing data transformations at scale, and working with AWS cloud technologies (S3, Hive, Databricks), Scala, Python, and Spark. Responsibilities include modernizing ingestion pipelines, ensuring data quality and governance, and collaborating with data and data science teams. The ideal candidate possesses 8+ years of application development experience, expertise in Ratings Data Ingestion pipelines, and proficiency in various SDLC methodologies. Experience with high-volume data and computationally intensive systems is crucial, along with strong communication and mentorship skills.
Must have:
  • 8+ years application development experience
  • Experience with AWS, Databricks, Scala, Python, Spark
  • ELT framework and schema on read expertise
  • Data governance and quality experience
  • Agile and test-driven development experience
Good to have:
  • Financial Industry/Capital Markets knowledge
  • Java garbage collection tuning
Perks:
  • Training and certifications
  • Bonuses
  • Socializing activities
  • Attractive compensation

Job Details

Description

Position at Ness Romania SRL

Why Ness

We know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most innovative software companies in the world.

You’ll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression.

You’ll also benefit from an array of advantages like access to trainings and certifications, bonuses, and aids, socializing activities, and attractive compensation.

Requirements and responsibilities

We are looking for a self-motivated, enthusiastic, and passionate software engineer to develop technology solutions for the Ness marketplace product.

The ideal candidate thrives in a highly technical role and will design and develop software using cutting-edge web applications, data pipelines, big data, machine learning, and multi-cloud technologies.

The development is already underway, so the candidate would be expected to get up to speed quickly and start contributing.

You will enable Ness business to showcase our proprietary Ness data, combine it with “curated” alternative data, further enrich it with value-add services from Kensho and others, and deliver it via the clients’ channel of choice to help them make better investment and business decisions, with confidence.

What you can expect: An unmatched experience in handling huge volumes of data, analytics, visualization, and services over cloud technologies along with appreciation in product development life cycle to convert an idea into revenue generating stream.

What you'll do

  • Design & Build ingestion pipelines using ELT and schema on read in Databricks Delta lake;
  • Design & Develop “Transformations” aspects using ELT framework to modernize the Ingestion pipelines and build data transformations at scale;
  • Provide technical expertise in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and Spark;
  • Build and maintain a data environment for speed, accuracy, consistency, and "up" time;
  • Work closely with other data teams & Data Science team and participate in the development of Ingestion pipelines;
  • Ensure data governance principles are adopted, data quality checks and data lineage are implemented in each hop of the data;
  • Be in tune with emerging trends Big data and cloud technologies and participate in the evaluation of new technologies;
  • Ensure compliance through adopting enterprise standards and promoting best practices/guiding principles aligned with organization standards.

What you'll bring

  • A minimum of 8+ years of significant experience in application development;
  • Previous experience in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and Spark;
  • Development, design, and architecture exposure & the ability to ensure quality across various technology components that are developed by geographically diversified software engineers with superior knowledge of system architecture, object-oriented design, and design patterns;
  • Proficient with software development lifecycle (SDLC) methodologies like Agile and test-driven development;
  • Experience working with high-volume data and computationally intensive systems;
  • Garbage collection friendly programming experience - tuning Java garbage collection & performance is a must;
  • Proficiency in the development environment, including IDE, web & application server, GIT, Continuous Integration, unit-testing tools, and defect management tools Domain knowledge in the Financial Industry and Capital Markets is a plus;
  • Excellent communication skills are essential, with strong verbal and writing proficiencies;
  • Mentor teams, innovate and experiment, give a face to business ideas, and present to key stakeholders.

Not checking every single requirement?

If this role sounds good to you, even if you don’t meet every single bullet point in the job description, we encourage you to apply anyway. For most of the candidates that applied, we found a role that was a very good fit with their skills.

Let’s meet and you may just be the right candidate for one of our roles.

At Ness Digital Engineering we are willing to build a work culture that is based on diversification, inclusion, and authenticity.

Similar Jobs

Google - Staff Software Engineer, Performance Debugging, YouTube, Developer Infrastructure

Google

Bengaluru, Karnataka, India (On-Site)
1 Day ago
PwC - IN-Senior Associate – SAP– SAP ABAP HANA – Advisory - Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Google - Software Engineer III, Infrastructure, Google Cloud

Google

San Francisco, California, United States (On-Site)
1 Day ago
Next Level Business Services - Angular JS Developer

Next Level Business Services

Milwaukee, Wisconsin, United States (On-Site)
6 Months ago
ByteDance - Software Development Engineer - Distributed NoSQL Database Systems

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Springer Nature - Senior Data Engineer

Springer Nature

Pune, Maharashtra, India (Hybrid)
5 Months ago
Riot Games - Insights Analyst II, Wild Rift

Riot Games

Singapore (On-Site)
5 Months ago
G5 Games - Strategic Product Analyst

G5 Games

Limassol, Limassol, Cyprus (Remote)
3 Days ago
PwC - Senior Associate_Power BI/Tableau_Data &Analytics_Advisory_PAN India

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
ByteDance - Risk Data Analytics Business Partner - E-Commerce - Seattle

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Google - Software Engineer, Core, Dagger and TikTok

Google

Mexico City, Mexico City, Mexico (On-Site)
1 Day ago
Overwolf - Frontend Developer

Overwolf

Nottingham, England, United Kingdom (On-Site)
3 Weeks ago
Google - Software Engineering Manager II, Google Cloud Platform

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Day ago
Playrix - Technical Director (Game Project)

Playrix

Portugal (Remote)
5 Months ago
Demonware - Expert Engineer, Accounts and Authentication

Demonware

Dublin, County Dublin, Ireland (Hybrid)
1 Week ago
Dream Sports - Director System IT

Dream Sports

Mumbai, Maharashtra, India (On-Site)
4 Months ago
ByteDance - Senior Site Reliability Engineer, CDN

ByteDance

Singapore (On-Site)
5 Months ago
Canva - Senior Backend Engineer - AI Enablement

Canva

Surry Hills, New South Wales, Australia (Remote)
2 Weeks ago
ByteDance - Software Development Engineer in Test

ByteDance

San Jose, California, United States (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Timișoara, Timiș, Romania

Amber - Junior Puzzle Level Designer (Project Based)

Amber

Bucharest, Bucharest, Romania (On-Site)
10 Months ago
Ness Digital - AI/ML Engineer

Ness Digital

Iași, Iași County, Romania (Remote)
3 Weeks ago
Ness Digital - Lead .Net Full-stack Engineer

Ness Digital

Timișoara, Timiș, Romania (Remote)
1 Month ago
Global Step - Senior 3D Animator

Global Step

Bucharest, Bucharest, Romania (Remote)
5 Months ago
Every matrix - Security Engineer

Every matrix

Bucharest, Bucharest, Romania (Hybrid)
3 Months ago
Google - Software Engineer, Android, CoreOS

Google

Bucharest, Bucharest, Romania (On-Site)
1 Day ago
Maximum Games - Senior Video Game Backend Developer

Maximum Games

Bucharest, Bucharest, Romania (On-Site)
2 Weeks ago
Every matrix - Legal Counsel

Every matrix

Bucharest, Bucharest, Romania (Hybrid)
3 Months ago
Google - Technical Program Manager, Pixel Watch and Fitbit Device

Google

Bucharest, Bucharest, Romania (On-Site)
1 Day ago
Google - Performance Sales Specialist (Fixed-Term-Contract)

Google

Bucharest, Bucharest, Romania (On-Site)
1 Day ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Metacore - Data Lead, Merge Mansion

Metacore

Berlin, Berlin, Germany (Hybrid)
1 Month ago
ByteDance - Senior Data Scientist

ByteDance

Seattle, Washington, United States (On-Site)
3 Days ago
Tencent - Data Science Intern

Tencent

Amsterdam, North Holland, Netherlands (On-Site)
1 Month ago
Push Gaming - Data Engineer

Push Gaming

Poland (Hybrid)
1 Week ago
Amanotes - Product Data Analyst

Amanotes

Ho Chi Minh City, Ho Chi Minh City, Vietnam (On-Site)
3 Weeks ago
Microsoft - Senior Data Engineer

Microsoft

Hyderabad, Telangana, India (On-Site)
1 Day ago
PlayStation Global - Senior Technical Program Manager

PlayStation Global

San Francisco, California, United States (On-Site)
2 Months ago
The Walt Disney Company - Senior Analyst, Audience Measurement and Insight, Disney+ Advertising

The Walt Disney Company

London, England, United Kingdom (Hybrid)
1 Day ago
PwC - PowerBI Lead

PwC

Toronto, Ontario, Canada (On-Site)
6 Months ago
ByteDance - Asset Manager, Datacenter Infrastructure and Services

ByteDance

Singapore (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

United States (Remote)

Iași, Iași County, Romania (Remote)

United States (Remote)

Timișoara, Timiș, Romania (Remote)

Romania (Remote)

Timișoara, Timiș, Romania (Remote)

Timișoara, Timiș, Romania (Remote)

Timișoara, Timiș, Romania (Remote)

Timișoara, Timiș, Romania (Remote)

Timișoara, Timiș, Romania (Remote)

View All Jobs

Get notified when new jobs are added by Ness Digital

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug