Site Reliability Engineer 2 - Hadoop

4 Months ago • 1-4 Years

Job Description

The Site Reliability Engineer 2 - Hadoop role at PhonePe involves managing and maintaining Hadoop infrastructure, ensuring high data quality and availability. Responsibilities include Linux/Unix administration, managing cloud infrastructure (Azure/AWS/GCP), Hadoop administration, networking, and open-source technologies. The role involves capacity planning, performance tuning, troubleshooting production issues, and collaborating with various teams. The engineer will also develop tools, apply updates, and optimize the Hadoop ecosystem. The job requires experience with the Hadoop stack, monitoring tools, and configuration management. The candidate must have strong communication skills and be able to participate in on-call rotations.
Good To Have:
  • Experience with ELK stack administration.
  • Experience with administering Kerberos and LDAP.
  • Experience with Design, develop and maintain Airflow DAGs.
  • Familiarity with configuration management tools like Puppet, Salt, or Ansible.
Must Have:
  • 1+ year experience in Linux/Unix administration.
  • 2+ years experience managing cloud infra (Azure/AWS/GCP).
  • 4+ years experience in Hadoop administration.
  • Strong understanding of networking and open-source technologies.
  • Experience with Hadoop stack: Hdfs, HBase, Hive, Pig, Airflow, YARN.
  • Proficient in scripting languages like Perl, Golang, or Python.
Perks:
  • Insurance Benefits: Medical, Critical Illness, Accidental, and Life Insurance
  • Wellness Program: Employee Assistance Program, Onsite Medical Center, Emergency Support
  • Parental Support: Maternity, Paternity, Adoption Assistance, Day-care Support
  • Mobility Benefits: Relocation, Transfer Support, Travel Policy
  • Retirement Benefits: Employee PF Contribution, Gratuity, NPS, Leave Encashment
  • Other Benefits: Higher Education Assistance, Car Lease, Salary Advance

Add these skills to join the top 1% applicants for this job

hadoop
networking
elk
linux
communication
puppet
yarn
grafana
unix
azure
load-balancing
nosql
reverse-proxy
aws
python

About PhonePe Group: 

PhonePe is India’s leading digital payments company with 50 crore (500 Million) registered users and 3.7 crore (37 Million) merchants covering over 99% of the postal codes across India. On the back of its leadership in digital payments, PhonePe has expanded into financial services (Insurance, Mutual Funds, Stock Broking, and Lending) as well as adjacent tech-enabled businesses such as Pincode for hyperlocal shopping and Indus App Store which is India's first localized App Store. The PhonePe Group is a portfolio of businesses aligned with the company's vision to offer every Indian an equal opportunity to accelerate their progress by unlocking the flow of money and access to services.

Culture

At PhonePe, we take extra care to make sure you give your best at work, Everyday! And creating the right  environment for you is just one of the things we do. We empower people and trust them to do the right  thing. Here, you own your work from start to finish, right from day one. Being enthusiastic about tech is a  big part of being at PhonePe. If you like building technology that impacts millions, ideating with some of  the best minds in the country and executing on your dreams with purpose and speed, join us!

JOB DESCRIPTION

  • Minimum of 1 year of experience in Linux/Unix Administration.
  • Minimum of 2 years of hands on experience with managing infra on public cloud i.e Azure/AWS/GCP
  • Over 4+ years of experience in Hadoop administration.
  • Strong understanding of networking, open-source technologies, and tools.
  • Familiar with best practices and IT operations for maintaining always-up, always-available services.
  • Experience and participation during on-call rotation.Excellent communication skills.
  • Solid expertise in Linux networking, including IP, iptables, and IPsec.Proficient in scripting and coding with languages such as Perl, Golang, or Python.
  • Strong Knowledge of databases like Mysql,Nosql,Sql serverHand on experience with setting up , configuring and Managing Nginx as reverse proxy and load balancing in high traffic environments.
  • Hands-on experience with both private and public cloud environments.
  • Strong troubleshooting skills and operational expertise in areas such as system capacity, bottlenecks, memory, CPU, OS, storage, and networking.
  • Practical experience with the Hadoop stack, including Hdfs,HBase,Hive, Pig, Airflow, YARN, HDFS, Ranger, Kafka, and Druid.
  • Good to have experience with Design,develop and maintain Airflow DAGs and tasks to automate BAU processes,ensuring they are robust,scalable and efficient.
  • Good to have experience with ELK stack administration.
  • Experience in administering Kerberos and LDAP.
  • Familiarity with open-source configuration management and deployment tools like Puppet, Salt, or Ansible.Responsible for the implementation and ongoing administration of Hadoop infrastructure.
  • Experience in capacity planning and performance tuning of Hadoop clusters.
  • Collaborate effectively with infrastructure, network, database, application, and business intelligence teams to ensure high data quality and availability.
  • Develop tools and services to enhance debuggability and supportability.Work closely with security teams to apply Hadoop updates, OS patches, and version upgrades as needed.
  • Troubleshoot complex production issues, identify root causes, and provide mitigation strategies.
  • Work closely with teams to optimize the overall performance of the PhonePe Hadoop ecosystem.
  • Experience with setting up & managing monitoring stack like OpenTsdb,Prometheus,ELK,Grafana,Loki

PhonePe Full Time Employee Benefits (Not applicable for Intern or Contract Roles)

  • Insurance Benefits - Medical Insurance, Critical Illness Insurance, Accidental Insurance, Life Insurance
  • Wellness Program - Employee Assistance Program, Onsite Medical Center, Emergency Support System
  • Parental Support - Maternity Benefit, Paternity Benefit Program, Adoption Assistance Program, Day-care Support Program
  • Mobility Benefits - Relocation benefits, Transfer Support Policy, Travel Policy
  • Retirement Benefits - Employee PF Contribution, Flexible PF Contribution, Gratuity, NPS, Leave Encashment 
  • Other Benefits - Higher Education Assistance, Car Lease, Salary Advance Policy

Working at PhonePe is a rewarding experience! Great people, a work environment that thrives on creativity, the opportunity to take on roles beyond a defined job description are just some of the reasons you should work with us. Read more about PhonePe on our blog.

Life at PhonePe

PhonePe in the news

Set alerts for new jobs by PhonePe
Set alerts for new jobs in India
Contact Us
hello@outscal.com
Made in INDIA 💛💙