Big Data Engineer

8 Months ago • 8 Years + • Data Analysis

Job Summary

Job Description

The Big Data Engineer will design and develop software solutions for the Ness marketplace product. They will work with cutting-edge web applications, data pipelines, big data, machine learning, and multi-cloud technologies. Responsibilities include building ingestion pipelines, developing transformations, providing technical expertise in data ingestion, and ensuring data governance and quality. They will also collaborate with other data teams, stay updated with emerging technologies, and promote best practices. The role offers experience in handling large data volumes, analytics, and cloud technologies, converting ideas into revenue-generating streams.
Must have:
  • 8+ years of application development experience
  • Experience with Ratings Data Ingestion pipelines
  • Exposure to design and architecture
  • Proficiency in SDLC methodologies
  • Experience working with high-volume data
  • Garbage collection friendly programming experience
  • Proficiency in the development environment
  • Excellent communication skills
Good to have:
  • Domain knowledge in the Financial Industry
  • Capital Markets is a plus
Perks:
  • Access to trainings and certifications
  • Bonuses, and aids
  • Socializing activities
  • Attractive compensation

Job Details

Job ID 4312

Why Ness

We know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As a Ness employee, you will be working on products and platforms for some of the most innovative software companies in the world.

You’ll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression.

You’ll also benefit from an array of advantages like access to trainings and certifications, bonuses, and aids, socializing activities, and attractive compensation.

Requirements and responsibilities

We are looking for a self-motivated, enthusiastic, and passionate software engineer to develop technology solutions for the Ness marketplace product.

The ideal candidate thrives in a highly technical role and will design and develop software using cutting-edge web applications, data pipelines, big data, machine learning, and multi-cloud technologies.

The development is already underway, so the candidate would be expected to get up to speed quickly and start contributing.

You will enable Ness business to showcase our proprietary Ness data, combine it with “curated” alternative data, further enrich it with value-add services from Kensho and others, and deliver it via the clients’ channel of choice to help them make better investment and business decisions, with confidence.

What you can expect: An unmatched experience in handling huge volumes of data, analytics, visualization, and services over cloud technologies along with appreciation in product development life cycle to convert an idea into revenue generating stream.

What you'll do

  • Design & Build ingestion pipelines using ELT and schema on read in Databricks Delta lake;
  • Design & Develop “Transformations” aspects using ELT framework to modernize the Ingestion pipelines and build data transformations at scale;
  • Provide technical expertise in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and Spark;
  • Build and maintain a data environment for speed, accuracy, consistency, and "up" time;
  • Work closely with other data teams & Data Science team and participate in the development of Ingestion pipelines;
  • Ensure data governance principles are adopted, data quality checks and data lineage are implemented in each hop of the data;
  • Be in tune with emerging trends Big data and cloud technologies and participate in the evaluation of new technologies;
  • Ensure compliance through adopting enterprise standards and promoting best practices/guiding principles aligned with organization standards.

What you'll bring

  • A minimum of 8+ years of significant experience in application development;
  • Previous experience in the areas of design and implementation of Ratings Data Ingestion pipelines with modern AWS cloud and other technologies such as S3, Hive, Databricks, Scala, Python, and Spark;
  • Development, design, and architecture exposure & the ability to ensure quality across various technology components that are developed by geographically diversified software engineers with superior knowledge of system architecture, object-oriented design, and design patterns;
  • Proficient with software development lifecycle (SDLC) methodologies like Agile and test-driven development;
  • Experience working with high-volume data and computationally intensive systems;
  • Garbage collection friendly programming experience - tuning Java garbage collection & performance is a must;
  • Proficiency in the development environment, including IDE, web & application server, GIT, Continuous Integration, unit-testing tools, and defect management tools Domain knowledge in the Financial Industry and Capital Markets is a plus;
  • Excellent communication skills are essential, with strong verbal and writing proficiencies;
  • Mentor teams, innovate and experiment, give a face to business ideas, and present to key stakeholders.

Not checking every single requirement?

If this role sounds good to you, even if you don’t meet every single bullet point in the job description, we encourage you to apply anyway. For most of the candidates that applied, we found a role that was a very good fit with their skills.

Let’s meet and you may just be the right candidate for one of our roles.

At Ness Digital Engineering we are willing to build a work culture that is based on diversification, inclusion, and authenticity.

Similar Jobs

Antarctica Global - Research & Sustainability Analyst

Antarctica Global

Mumbai, Maharashtra, India (Remote)
3 Months ago
cyara - Support Engineer

cyara

United States (Remote)
3 Months ago
NCR Voyix - Territory Manager

NCR Voyix

Singapore (On-Site)
2 Weeks ago
Adyen - Account Manager

Adyen

Milan, Lombardy, Italy (On-Site)
1 Month ago
Haleon - Dental Territory Manager: South East England

Haleon

England, United Kingdom (On-Site)
4 Days ago
luxsoft - Senior/Lead Data Engineer

luxsoft

Türkiye (Remote)
1 Month ago
Riot Games - Manager, Data Science - League Studio, League Data Central

Riot Games

Los Angeles, California, United States (On-Site)
7 Months ago
Autodesk - Principal Data Scientist, Generative AI

Autodesk

United States (Hybrid)
1 Year ago
Morning Star - Senior Data Research Analyst

Morning Star

Mumbai, Maharashtra, India (Hybrid)
3 Weeks ago
Workato - Senior Java Engineer (Data Integration Team)

Workato

Nicosia, Nicosia, Cyprus (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Visa - Legal Counsel

Visa

Almaty, Almaty Region, Kazakhstan (Hybrid)
1 Month ago
Rolls-Royce - Business Controller (Data) - Submarines

Rolls-Royce

Faslane, Scotland, United Kingdom (Hybrid)
2 Weeks ago
Rippling - Associate HR Business Partner

Rippling

San Francisco, California, United States (On-Site)
1 Month ago
Argus - Site Reliability Engineer (LATAM)

Argus

(Remote)
3 Months ago
Vertx Inc. - Account Executive III

Vertx Inc.

(Remote)
1 Month ago
Zones - Bid Specialist

Zones

Islamabad, Islamabad Capital Territory, Pakistan (On-Site)
1 Month ago
SparkCognition - Recruiter

SparkCognition

Bengaluru, Karnataka, India (On-Site)
9 Months ago
Apple - Senior Business Development Manager, Apple Pay Access

Apple

New York, United States (On-Site)
1 Month ago
Toast - Territory Account Executive

Toast

Port St. Lucie, Florida, United States (On-Site)
1 Month ago
Wind River - Senior Cloud Solution Architect - GSIs

Wind River

Bengaluru, Karnataka, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Timișoara, Timiș, Romania

PwC - Developing Senior Auditor

PwC

Cluj-Napoca, Cluj County, Romania (Hybrid)
3 Months ago
Amazon games  - SDE - Gameplay

Amazon games

Bucharest, Bucharest, Romania (On-Site)
1 Month ago
luxsoft - Lead C/C++ developer

luxsoft

Romania (Remote)
2 Weeks ago
Playtika - Senior C# Developer/Tech Lead

Playtika

Romania (Hybrid)
2 Months ago
luxsoft - QA Java Automation Engineer

luxsoft

Bucharest, Bucharest, Romania (On-Site)
1 Week ago
Tide - Senior CRM Marketing Associate

Tide

Romania (On-Site)
1 Month ago
London stock Exchange - Lead Associate, Infrastructure Control and Audit

London stock Exchange

Bucharest, Bucharest, Romania (On-Site)
1 Month ago
endava - Senior Cloud Operations Engineer

endava

Timișoara, Timiș, Romania (On-Site)
2 Weeks ago
Ceragon Networks - Financial Controller

Ceragon Networks

Romania (On-Site)
1 Month ago
Assist software  - Python Developer

Assist software

Suceava, Suceava County, Romania (Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Anthology  Inc  - Enterprise Data Architect

Anthology Inc

United States (Remote)
3 Months ago
NinjaVan - Staff Data Engineer

NinjaVan

Hyderabad, Telangana, India (On-Site)
8 Months ago
Haleon - Data Engineer

Haleon

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Jane Street - Data Centre Engineer

Jane Street

Mumbai, Maharashtra, India (On-Site)
1 Month ago
The Mill Adventure - BI Analyst

The Mill Adventure

St. Julian's, Malta (Remote)
2 Weeks ago
Illumina - Staff, SAP Quality Business Process Analyst (SAP QM)

Illumina

San Diego, California, United States (On-Site)
1 Month ago
Apple - Data Scientist - Apple Ads

Apple

Cupertino, California, United States (On-Site)
3 Weeks ago
GoTo Group - Senior Data Analyst - Growth

GoTo Group

Jakarta, Indonesia (On-Site)
3 Months ago
Nagarro - Associate Staff Engineer, Big Data

Nagarro

(On-Site)
8 Months ago
zoox - Senior Data Scientist - Hardware & Reliability

zoox

Foster City, California, United States (Hybrid)
4 Years ago

Get notifed when new similar jobs are uploaded

About The Company

Since 2019, Papaya has been committed to shaping the future of gaming through an innovative and forward-thinking approach to game development. We believe that gaming should be about more than just luck, which is why our games are designed to reward skill, strategy, and perseverance. Our primary focus is transforming single-player games into rewarding, multi-player skill-based tournaments. Whether it's our users or employees, we challenge everyone to take risks, try new things, and push themselves to new heights of achievement.

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)

View All Jobs

Get notified when new jobs are added by Papaya Gaming

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug