Staff Data Engineer

2 Days ago • 5-8 Years

About the job

Summary_{By Outscal}

Design and develop mission-critical systems, deliver high-availability and performance. Build ETL pipelines, work with distributed data processing & Hadoop ecosystem. Experience in Apache Kafka, Apache Flume, Apache Nifi, Apache Flink, & SQL.

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Design and develop mission-critical systems, delivering high-availability and performance.
Work on development of new products and enhancements to existing systems iteratively by building quick POCs and converting ideas into real products.
Work closely with architects, business, and technical stakeholders to develop high quality products and services that meet business requirements and expectations while applying the latest available tools and technology.
Instill best practices for software development and deliver high quality work on tight schedules.
Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements.
Identify opportunities for further enhancements and refinements to standards and processes
Coordinate Continuous Integration activities, testing automation frameworks, and other related items in addition to contributing core product code.

This is a hybrid position. Hybrid employees can alternate time between both remote and office. Employees in hybrid roles are expected to work from the office 2-3 set days a week (determined by leadership/site), with a general guidepost of being in the office 50% or more of the time based on business needs.

Qualifications

Basic Qualifications
* 5+ years of relevant work experience with a Bachelor’s Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD, OR 8+ years of relevant work experience.

Preferred Qualifications
* 6 or more years of work experience with a Bachelors Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD
* 8+ years of software development experience, with demonstrated expertise in leveraging development best practice methodologies and at least 2+ years’ experience in a lead role.
* Expert in one of the Java or Scala programming language
* Experience in building batch and streaming ETL pipelines.
* Experience in Distributed data processing and Hadoop eco system.
* Experience in Building Low Latency and High Performing Data APIs to serve Petabytes of data.
* Dockers & Kubernetes Container experience
* Experience in streaming technologies Apache Kafka, Apache flume, Apache Nifi and Apache Flink.
* Advanced working SQL knowledge and experience working with non-relational databases (Hbase, Rocks DB,Cassandra,Mongo,Redis, Hazel cast) as well as working familiarity with a variety of relational databases like DB2,Oracle etc.
* Strong foundation in computer science, with strong competencies in data structures, algorithms and software design optimized for building highly distributed and parallelized systems
* Experience in GIT, Maven, Jenkins build tools.
* Solid understanding of distributed system concepts, non-functional requirements like logging, monitoring, debugging, alerting, performance.
* Excellent analytical and troubleshooting skills.
* Passionate about delivering zero defect code that meet or exceed the proposed defect SLA and have high sense of accountability for quality and timeliness.
* Ability to deliver on multiple projects and manage priorities based on changing directions.
* Excellent presentation, collaboration and communication skills required.
* Experience being part of an Agile/Scrum team and following processes.
* Experience with GenAI a plus

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.