Data Engineer - Sr. Consultant

1 Month ago • 8-9 Years • Full Stack Development

About the job

Summary

As a Senior Consultant Data Engineer, you'll join Visa's Value Added Services – Digital Marketing & Engagement organization. You'll design, enhance, and build our Visa data token platform within an agile development environment. You'll take on leadership roles in multiple projects, building full-stack development of real-time scoring services, RESTful APIs, and container-based distributed services. These services are designed to be highly available, secure, scalable, and resilient. You'll also spearhead the development of next-generation software, incorporating machine learning and deep learning technologies.
Must have:
  • 8+ years of relevant work experience
  • Experience in big data engineering (Hadoop, Apache Spark, Python, SQL)
  • Expertise in Java, REST APIs, container technologies (Docker, Kubernetes)
  • Experience in creating and managing large-scale data pipelines
  • Experience developing ETL processes and maintaining Spark pipelines
  • Proficient in technologies like Kafka, Redis, Flink, TensorFlow, Triton, AWS services
  • Strong Unix/Shell or Python scripting skills
  • Experience with UI technologies (Redux, React.js, HTML5, CSS4, jQuery/JavaScript)
  • Familiarity with Agile development, TDD, CI/CD, relational and non-relational databases
Good to have:
  • 9+ years of relevant work experience
  • Experience with machine learning and deep learning models
  • Experience productizing AI/ML models
  • Experience with scheduling tools like Airflow and Control-M
  • Experience maintaining OPS tools
  • Component security analysis experience
  • Experience mentoring junior team members
  • Strong communication and interpersonal skills
Not hearing back from companies?
Unlock the secrets to a successful job application and accelerate your journey to your next opportunity.

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

As a Senior Consultant Data Engineer, you'll join our Value Added Services – Digital Marketing & Engagement organization. You'll help design, enhance, and build our Visa data token platform within an agile development environment. You'll collaborate with colleagues who will both support and challenge you daily.

You will take on leadership roles in multiple projects, building full-stack development of real-time scoring services, RESTful APIs, and container-based distributed services. These services are designed to be highly available, secure, scalable, and resilient.

You'll also spearhead the development of next-generation software, incorporating machine learning and deep learning technologies. We believe in self-managing Agile teams that build end-to-end products, emphasizing unit testing, code reviews, and continuous integration for excellent code quality. You'll witness the code you write move to production within just a few days.

This role involves driving innovation to differentiate our products from competitors and delight customers with accelerated time-to-market delivery. It demands proficiency in containerization technologies like Docker and Kubernetes, expertise in Java, Spring Boot, React, and both relational and non-relational databases. A strong background in data engineering with experience in Hadoop, Spark, and Scala is also essential for effective performance in this role.

If this sounds exciting, we'd love to chat with you further about our work culture, environment, and whether this would be a good fit for you

 

Essential Functions:

  • You’ll be the face of the team representing us in various technical forums. 

  • You’ll help our customers achieve their business goals by understanding their requirements. You will build deep partnerships with product management to make sure that the products we are building deliver real value.

  • You’ll analyze business requirements and architect highly secure, robust, and scalable solutions.

  • You’ll drive internal proof of concept initiatives. When needed, quickly design and implement a prototype of a system or component with a proper architecture, and then lead or hand over to engineering team to implement.

  • You’ll champion efforts to architect, design and implement various components of our global transaction processing systems.

  • Your DNA will include following and creating software best practices and processes.

  • You’ll coach and mentor your team members and help them grow professionally. You will also create an atmosphere of mutual accountability.

  • You’ll play key role in meetings and discussions with cross-functional and non-technical teams.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Visa is not offering relocation assistance for this role.

 

Qualifications

Basic Qualifications:
• 8 or more years of relevant work experience with a Bachelor Degree or at least 5 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 2 years of work experience with a PhD

Preferred Qualifications:
• 9 or more years of relevant work experience with a Bachelor Degree or 7 or more relevant years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 3 or more years of experience with a PhD
• Demonstrated leadership in teams delivering high-quality, large-scale, enterprise-class applications.
• Solid experience in big data engineering, with working knowledge of Hadoop, Apache Spark, Python, and SQL.
• Expertise in Java, with experience in REST APIs, container-based technologies, and implementing containerization strategies using Docker and Kubernetes.
• Proficiency in creating and managing large-scale data pipelines, handling complex, high-volume, multi-dimensional data, and machine learning models.
• Expertise in developing ETL processes, maintaining Spark pipelines, and productizing AI/ML models.
• Proficient in popular technologies and cloud services, such as Kafka, Redis, Flink, TensorFlow, Triton, AWS services, and containerized environments (Docker, K8s).
• Skilled in Unix/Shell or Python scripting, using scheduling tools like Airflow and Control-M, and maintaining OPS tools.
• Strong experience with UI technologies, including Redux, React.js, HTML5, CSS4, and jQuery/JavaScript standards.
• Familiarity with Agile development incorporating TDD, CI/CD, and relational and non-relational databases.
• Proven track record of building applications adhering to industry best practices for reliability, availability, scalability, and operability.
• Ability to manage component security analysis and collaborate with security teams.
• Strong work ethic, focus on immediate goals, and proven experience as a technical leader.
• Passion for mentoring juniors and helping them reach new heights.
• Demonstrated proficiency with programming languages, scripting languages, code quality initiatives, and operating systems.
• Excellent communication and interpersonal skills, and a strong team player.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

View Full Job Description

About The Company

Georgia, United States (On_site)

Georgia, United States (Hybrid)

Georgia, United States (Hybrid)

Georgia, United States (Hybrid)

Georgia, United States (Hybrid)

Virginia, United States (Remote)

Almaty Region, Kazakhstan (Hybrid)

Almaty Region, Kazakhstan (Hybrid)

View All Jobs

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug