Client Services Datalake - Staff Data Engineer

3 Months ago • 6-7 Years • Data Analyst

Job Summary

Job Description

As a Client Services Datalake - Staff Data Engineer at Visa, you will be responsible for managing the design, development, and maintenance of corporate applications. You will work closely with product owners, stakeholders, and internal teams to understand business requirements and contribute to data asset development. You will build and maintain robust data engineering pipelines using Big Data technologies like Hadoop, Spark, Hive, and MapReduce. Your expertise in Pyspark and Scala, combined with experience in cloud platforms like AWS, GCP, or Azure, will be crucial in this role. You will also be responsible for optimizing existing solutions, creating self-service tools for business users, and ensuring high code quality and timely deliverables.
Must have:
  • 7+ years relevant experience with Bachelor's or 6+ years with Advanced Degree
  • 5+ years building data engineering pipelines
  • Expertise in Big Data technologies (Hadoop, Spark, Hive, MapReduce)
  • Mastery in Pyspark or Scala
  • Experience with cloud platforms (AWS, GCP, Azure)
  • Strong problem-solving and critical thinking skills
Good to have:
  • Experience with ETL tools (Informatica, SSIS, Pentaho, Azure Data Factory)
  • Knowledge of real-time and batch systems
  • Experience with data warehousing and RDBMS (SQL Server, Oracle)
  • Reporting skills on PowerBI, Tableau, or QlikView
  • Understanding of cloud architecture and services
  • Experience with Agile/Scrum and Jira
  • Understanding of CI/CD functionality and Git concepts

Job Details

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

We are seeking a hands-on Data Engineer with a strong background in data engineering. This role involves managing system requirements, design, development, integration, quality assurance, implementation, and maintenance of corporate applications.

 

Ø Work with product owners, business stakeholders and internal teams to understand business requirements and desired business outcomes.

Ø Assist in scoping and designing analytic data assets, implementing modelled attributes and contributing to brainstorming sessions.

Ø Build and maintain a robust data engineering process to develop and implement self-serve data and tools for Visa’s product management teams and data scientists.

Ø Find opportunities to create, automate and scale repeatable analyses or build self-service tools for business users.

Ø Execute data engineering projects ranging from small to large either individually or as part of a project team.

Ø Set the benchmark in the team for good data engineering practices and assist leads and architects in solution design.

Ø Exhibit a passion for optimizing existing solutions and making incremental improvements.

 

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Ø 7 or more years of relevant work experience with a Bachelor’s Degree or 6 or more relevant years of experience with an Advanced Degree (e.g. Masters, MBA, MD).
Ø Minimum of 5+ years’ experience in building data engineering pipelines.
Ø Design and coding skills with Big Data technologies like Hadoop, Spark, Hive and Map reduce.
Ø Mastery in Pyspark or Scala.
Ø Expertise in any programming like Java or Python. Knowing OOP concepts like inheritance, polymorphism and implementing Design Patterns in programming is needed.
Ø Experience with cloud platforms like AWS, GCP, or Azure is good to have.
Ø Excellent problem-solving skills and ability to think critically.
Ø Experience with any one ETL tool like Informatica, SSIS, Pentaho or Azure Data Factory.
Ø Knowledge of successful design, and development of data driven real time and batch systems.
Ø Experience in data warehousing and an expert in any one of the RDBMS like SQL Server, Oracle, etc.
Ø Nice to have reporting skills on PowerBI/Tableau/QlikView.
Ø Strong understanding of cloud architecture and service offerings including compute, storage, databases, networking, AI, and ML.
Ø Passionate about delivering zero defect code that meets or exceeds the proposed defect SLA and have high sense of accountability for quality and timelines on deliverables.
Ø Experience developing as part of Agile/Scrum team is preferred and hands on with Jira.
Ø Understanding basic CI/ CD functionality and Git concepts is must.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Similar Jobs

Microsoft - Senior Applied Scientist, Microsoft AI

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Unity - Developer Support Engineer

Unity

Pereira, Risaralda, Colombia (On-Site)
3 Months ago
Fliff  Inc  - Senior DevOps Engineering Manager

Fliff Inc

Sofia, Sofia City Province, Bulgaria (Remote)
5 Months ago
Luxoft - Azure Enterprise Architect

Luxoft

(On-Site)
3 Months ago
Assurant - Lead DevOps Cloud Engineer

Assurant

Kolkata, West Bengal, India (Remote)
3 Months ago
PwC - Ingenieros y Programadores - PwC

PwC

Granada, Andalusia, Spain (On-Site)
4 Months ago
PwC - Data Engineering – Senior Manager

PwC

Zürich, Zurich, Switzerland (On-Site)
4 Months ago
Evolution - Business Intelligence Data Analyst

Evolution

Riga, Latvia (On-Site)
1 Month ago
Bluevine - Senior Product Manager

Bluevine

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Ubisoft - QA Analyst - Cinematic

Ubisoft

Montreal, Quebec, Canada (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Microsoft - Data Scientist II

Microsoft

Hyderabad, Telangana, India (On-Site)
1 Month ago
Microsoft - Solution Area Specialist - Azure Infrastructure

Microsoft

Al Asimah Governate, Kuwait (On-Site)
1 Month ago
Paypal - Staff Engineer, Backend (Java)

Paypal

San Jose, California, United States (Hybrid)
4 Months ago
Netflix - Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

Netflix

Los Gatos, California, United States (Remote)
1 Month ago
Microsoft - Senior and Principal Applied Scientists (Multiple Positions) - Office Product Group

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Rush Street Interactive - Full-Stack Automation Engineer

Rush Street Interactive

Serbia (On-Site)
1 Month ago
The Walt Disney Company - Senior Principal Software Engineer

The Walt Disney Company

San Francisco, California, United States (On-Site)
3 Months ago
Hitachi - Dynamics CE Functional Architect (remote/must be Peru- or LATAM-based)

Hitachi

Lima, Callao Region, Peru (Remote)
4 Months ago
Microsoft - Research Intern - Genomics

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Warsaw, Masovian Voivodeship, Poland

SuperPlay - SENIOR UNITY DEVELOPER

SuperPlay

Poland (Remote)
3 Months ago
Techland - Senior Gameplay Animator

Techland

Wrocław, Lower Silesian Voivodeship, Poland (Remote)
2 Months ago
PwC - Backend Developer/Consultant with German (freelance)

PwC

Warsaw, Masovian Voivodeship, Poland (Hybrid)
4 Months ago
PwC - Experienced Team Leader | Financial Crime Unit

PwC

Lublin, Lublin Voivodeship, Poland (On-Site)
4 Months ago
Social Discovery Group - Senior Frontend Developer (Core Business)

Social Discovery Group

Poland (Remote)
4 Weeks ago
Visa - Senior Consultant - Software Engineer

Visa

Warsaw, Masovian Voivodeship, Poland (Hybrid)
3 Months ago
Social Discovery Group - People Partner

Social Discovery Group

Poland (Remote)
2 Months ago
Techland - CEO Personal Assistant

Techland

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Keywords Studios (Player Support) - Regional Service Delivery Manager

Keywords Studios (Player Support)

Silesian Voivodeship, Poland (On-Site)
2 Months ago
Wargaming - Senior Gameplay Programmer (Steel Huters)

Wargaming

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

ION - Debt Restructuring Analyst

ION

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Netflix - Distributed Systems Engineer (L5) - Data Platform

Netflix

United States (Remote)
3 Months ago
PwC - IN_Senior Associate _Java Developer _Data & Analytics _Advisory _PAN India

PwC

Kolkata, West Bengal, India (On-Site)
4 Months ago
Argus Media - Senior Data Scientist - Optimization (FTC)

Argus Media

Maharashtra, India (Hybrid)
4 Months ago
GameChanger  - Analytics Engineer Intern

GameChanger

United States (Remote)
1 Month ago
Meta - Data Engineer, Product Analytics

Meta

Menlo Park, California, United States (On-Site)
3 Months ago
King - Senior Staff Software Engineer (Data)  - Activision Blizzard Media

King

San Francisco, California, United States (On-Site)
7 Months ago
N-iX - Senior Data Engineer

N-iX

Ukraine (Remote)
1 Month ago
EXUSIA - Data Governance Specialist - Collibra

EXUSIA

India (Remote)
4 Months ago
Warner Bros Games - Principal Analytics Engineer (Data Platform)

Warner Bros Games

Hyderabad, Telangana, India (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Ashburn, Virginia, United States (Remote)

Amsterdam, North Holland, Netherlands (Remote)

Austin, Texas, United States (Hybrid)

Auckland, Auckland, New Zealand (On-Site)

Auckland, Auckland, New Zealand (Hybrid)

Ashburn, Virginia, United States (Hybrid)

Ashburn, Virginia, United States (Hybrid)

Amsterdam, North Holland, Netherlands (Hybrid)

View All Jobs

Get notified when new jobs are added by VISA

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug