Senior Data Engineer

2 Months ago • 5-5 Years • Data Analyst • Undisclosed

About the job

Job Description

Senior Data Engineer needed to design, implement and maintain high-performance big data infrastructure. 5+ years experience in distributed computing, Python, SQL, Apache Airflow and Google Cloud Platform is required.
Must have:
  • Big Data Systems
  • Python Programming
  • Google Cloud
  • Apache Airflow
Good to have:
  • Kubernetes
  • REST APIs
  • Object Oriented
  • Network Programming

About the job

Equal Opportunity Employer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status, or disability status. EEO/AA/M/F/Disabled/Vets

Job Description :

Senior Data Engineer

One of the most innovative and high-profile teams in News Corp is looking for a seasoned data engineer to help accelerate its vision. The role will involve combining all of News Corp’s data across categories, countries and organizations into a singular view of a customer enabling engagement, measurement and targeting. The HQData Senior Data Engineer will partner closely with product, data & engineering teams to help make this data available and accessible to our businesses, teams and partners in order to drive revenue and improve the customer experience.

Responsibilities

  • Design, implement and maintain high performance big data infrastructure/systems & big data processing pipelines scaling to billions of structured and unstructured events daily
  • Design, implement and maintain deep integration with up-stream systems
  • Monitor performance of the data platform and optimize as needed
  • Monitor and provide transparency into data quality across systems (accuracy, consistency, completeness, etc)
  • Support product with the overall roadmap and ensure updates to senior leadership are 100% technically correct.
  • Data analysis, understanding of business requirements and translation into logical pipelines & processes
  • Conduct timely and effective research in response to specific requests (e.g. data collection, summarization, analysis, and synthesis of relevant data and information)
  • Evaluate and prototype new technologies in the area of data processing
  • Think quickly, communicate clearly and work collaboratively with product, data, engineering, QA and operations teams
  • High energy level, strong team player and good work ethic

Technologies we use

  • Google Cloud Platform (Storage, Dataflow, BigQuery, DataStudio, DataTransfer, Composer)
  • Python, R, Spark (PySpark)
  • Kubernetes
  • Airflow
  • Git for source code management
  • Jira

Qualifications

  • BS in Computer Science or other technical discipline
  • 5+ years of experience in designing and developing big data processing systems using distributed computing
  • 5+ years in Python Programming
  • 5+ years experience in SQL
  • 4+ years experience in Apache Airflow
  • Working with REST APIs
  • 5+ years of Hands on experience in Google Cloud Platform
  • Expert knowledge in optimizing complex SQL queries
  • Experience with job orchestration tools
  • An affinity for automation
  • Familiarity with networking and network application programming, including HTTP/HTTPS, JSON, and REST APIs
  • Experience with at least one object oriented language (ex: Java)
  • Strong OO design, data structure, and algorithm design skills

This job is posted with NTS Technology Services Pvt. Ltd.

Job Category:

View Full Job Description

Add your resume

80%

Upload your resume, increase your shortlisting chances by 80%

About The Company

Bengaluru, Karnataka, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Karnataka, India (On-Site)

Bengaluru, Karnataka, India (Hybrid)

Bengaluru, Karnataka, India (On-Site)

Bengaluru, Karnataka, India (Hybrid)

View All Jobs

Get notified when new jobs are added by News Corp

Similar Jobs

Meta - Software Engineer, Infrastructure

Meta, United States (Remote)

ByteDance - Tech Lead - Global E-Commerce Logistics

ByteDance, United States (On-Site)

Info Stretch - Senior Java Engineer

Info Stretch, Germany (On-Site)

Microsoft - Data Scientist: Opportunities - PhD - Redmond

Microsoft, United States (On-Site)

HoYoverse - Legal Counsel (Privacy and Data Protection)

HoYoverse, Singapore (On-Site)

Career Stone Consultant - Manager - Data Engineer

Career Stone Consultant, India (On-Site)

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Get notifed when new similar jobs are uploaded

Jobs in Bengaluru, Karnataka, India

Assystems - Deputy Team Leader

Assystems, India (On-Site)

Oil and Gas Job Search  - HREX IS Project and Release Manager

Oil and Gas Job Search , India (On-Site)

Biz Millennium - Sponsorship Manager

Biz Millennium, India (On-Site)

Paytm - Sales Team Lead - Nizamabad

Paytm, India (On-Site)

Nisum - Mobile Engineer A5828

Nisum, India (Hybrid)

Pro5 AI - Senior Data Scientist

Pro5 AI, India (Remote)

Gamemano - Wordpress Developer

Gamemano, India (On-Site)

Vigaet - 3D Modelling Artist-Full time

Vigaet, India (On-Site)

Hunarstreet Technologies   - 3D Designer & Visualizer-ASP

Hunarstreet Technologies , India (On-Site)

Pollen - Influencer Marketing Manager

Pollen, India (On-Site)

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Playtech - Data Scientist

Playtech, Cyprus (On-Site)

Fairmatic - Senior Data Scientist

Fairmatic, Israel (Hybrid)

Sandsoft Games - Game Data Analyst

Sandsoft Games, Saudi Arabia (On-Site)

IGT - Senior Data Engineer (iGaming)

IGT, Serbia (On-Site)

Comscore,  Inc  - Data Scientist

Comscore, Inc , India (On-Site)

Oportun - Senior Data Scientist (R11845)

Oportun, India (Remote)

Crunchyroll - Principal Data Analyst

Crunchyroll, India (On-Site)

ESL FACEIT Group - EFG - Data Analyst (Analytics Engineer)

ESL FACEIT Group - EFG, (On-Site)

Token Metrics - Crypto Senior Backend Engineer (Remote)

Token Metrics, Colombia (Remote)

Fluence - Battery Data Scientist

Fluence, India (Hybrid)

Get notifed when new similar jobs are uploaded