Client Services Datalake - Staff Data Engineer

1 Month ago • 6-7 Years • Data Analyst

About the job

Summary

As a Client Services Datalake - Staff Data Engineer at Visa, you will be responsible for managing the design, development, and maintenance of corporate applications. You will work closely with product owners, stakeholders, and internal teams to understand business requirements and contribute to data asset development. You will build and maintain robust data engineering pipelines using Big Data technologies like Hadoop, Spark, Hive, and MapReduce. Your expertise in Pyspark and Scala, combined with experience in cloud platforms like AWS, GCP, or Azure, will be crucial in this role. You will also be responsible for optimizing existing solutions, creating self-service tools for business users, and ensuring high code quality and timely deliverables.
Must have:
  • 7+ years relevant experience with Bachelor's or 6+ years with Advanced Degree
  • 5+ years building data engineering pipelines
  • Expertise in Big Data technologies (Hadoop, Spark, Hive, MapReduce)
  • Mastery in Pyspark or Scala
  • Experience with cloud platforms (AWS, GCP, Azure)
  • Strong problem-solving and critical thinking skills
Good to have:
  • Experience with ETL tools (Informatica, SSIS, Pentaho, Azure Data Factory)
  • Knowledge of real-time and batch systems
  • Experience with data warehousing and RDBMS (SQL Server, Oracle)
  • Reporting skills on PowerBI, Tableau, or QlikView
  • Understanding of cloud architecture and services
  • Experience with Agile/Scrum and Jira
  • Understanding of CI/CD functionality and Git concepts
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

We are seeking a hands-on Data Engineer with a strong background in data engineering. This role involves managing system requirements, design, development, integration, quality assurance, implementation, and maintenance of corporate applications.

 

Ø Work with product owners, business stakeholders and internal teams to understand business requirements and desired business outcomes.

Ø Assist in scoping and designing analytic data assets, implementing modelled attributes and contributing to brainstorming sessions.

Ø Build and maintain a robust data engineering process to develop and implement self-serve data and tools for Visa’s product management teams and data scientists.

Ø Find opportunities to create, automate and scale repeatable analyses or build self-service tools for business users.

Ø Execute data engineering projects ranging from small to large either individually or as part of a project team.

Ø Set the benchmark in the team for good data engineering practices and assist leads and architects in solution design.

Ø Exhibit a passion for optimizing existing solutions and making incremental improvements.

 

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Ø 7 or more years of relevant work experience with a Bachelor’s Degree or 6 or more relevant years of experience with an Advanced Degree (e.g. Masters, MBA, MD).
Ø Minimum of 5+ years’ experience in building data engineering pipelines.
Ø Design and coding skills with Big Data technologies like Hadoop, Spark, Hive and Map reduce.
Ø Mastery in Pyspark or Scala.
Ø Expertise in any programming like Java or Python. Knowing OOP concepts like inheritance, polymorphism and implementing Design Patterns in programming is needed.
Ø Experience with cloud platforms like AWS, GCP, or Azure is good to have.
Ø Excellent problem-solving skills and ability to think critically.
Ø Experience with any one ETL tool like Informatica, SSIS, Pentaho or Azure Data Factory.
Ø Knowledge of successful design, and development of data driven real time and batch systems.
Ø Experience in data warehousing and an expert in any one of the RDBMS like SQL Server, Oracle, etc.
Ø Nice to have reporting skills on PowerBI/Tableau/QlikView.
Ø Strong understanding of cloud architecture and service offerings including compute, storage, databases, networking, AI, and ML.
Ø Passionate about delivering zero defect code that meets or exceeds the proposed defect SLA and have high sense of accountability for quality and timelines on deliverables.
Ø Experience developing as part of Agile/Scrum team is preferred and hands on with Jira.
Ø Understanding basic CI/ CD functionality and Git concepts is must.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

View Full Job Description

About The Company

Georgia, United States (On_site)

Georgia, United States (Hybrid)

Georgia, United States (Hybrid)

Georgia, United States (Hybrid)

Georgia, United States (Hybrid)

Virginia, United States (Remote)

Almaty Region, Kazakhstan (Hybrid)

Almaty Region, Kazakhstan (Hybrid)

View All Jobs

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug