News Corp

Senior Data Engineer

Video Research Specialist

Data Engineer

Senior Engineer, Wordpress Development

Senior Data Engineer needed to design, implement and maintain high-performance big data infrastructure. 5+ years experience in distributed computing, Python, SQL, Apache Airflow and Google Cloud Platform is required. 

<div class="jobs-box__html-content jobs-description-content__text t-14 t-normal
 jobs-description-content__text--stretch" id="job-details" tabindex="-1">
 <h2 class="text-heading-large">
 About the job
 </h2>

 <div class="mt4">
 
 Equal Opportunity Employer All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status, or disability status. EEO/AA/M/F/Disabled/Vets Job Description : Senior Data Engineer One of the most innovative and high-profile teams in News Corp is looking for a seasoned data engineer to help accelerate its vision. The role will involve combining all of News Corp’s data across categories, countries and organizations into a singular view of a customer enabling engagement, measurement and targeting. The HQData Senior Data Engineer will partner closely with product, data &amp; engineering teams to help make this data available and accessible to our businesses, teams and partners in order to drive revenue and improve the customer experience. Responsibilities <ul><li>Design, implement and maintain high performance big data infrastructure/systems &amp; big data processing pipelines scaling to billions of structured and unstructured events daily</li><li>Design, implement and maintain deep integration with up-stream systems</li><li>Monitor performance of the data platform and optimize as needed</li><li>Monitor and provide transparency into data quality across systems (accuracy, consistency, completeness, etc)</li><li>Support product with the overall roadmap and ensure updates to senior leadership are 100% technically correct.</li><li>Data analysis, understanding of business requirements and translation into logical pipelines &amp; processes</li><li>Conduct timely and effective research in response to specific requests (e.g. data collection, summarization, analysis, and synthesis of relevant data and information)</li><li>Evaluate and prototype new technologies in the area of data processing</li><li>Think quickly, communicate clearly and work collaboratively with product, data, engineering, QA and operations teams</li><li>High energy level, strong team player and good work ethic </li></ul>
Technologies we use <ul><li>Google Cloud Platform (Storage, Dataflow, BigQuery, DataStudio, DataTransfer, Composer)</li><li>Python, R, Spark (PySpark)</li><li>Kubernetes</li><li>Airflow</li><li>Git for source code management</li><li>Jira </li></ul>
Qualifications <ul><li>BS in Computer Science or other technical discipline</li><li>5+ years of experience in designing and developing big data processing systems using distributed computing</li><li>5+ years in Python Programming</li><li>5+ years experience in SQL</li><li>4+ years experience in Apache Airflow</li><li>Working with REST APIs</li><li>5+ years of Hands on experience in Google Cloud Platform</li><li>Expert knowledge in optimizing complex SQL queries</li><li>Experience with job orchestration tools</li><li>An affinity for automation</li><li>Familiarity with networking and network application programming, including HTTP/HTTPS, JSON, and REST APIs</li><li>Experience with at least one object oriented language (ex: Java)</li><li>Strong OO design, data structure, and algorithm design skills </li></ul>
This job is posted with NTS Technology Services Pvt. Ltd. Job Category:
 
 </div>
 </div>