Technical Lead / Senior Data Engineer
Job Summary
Job Description
- Role Qualifications and Requirements
- Bachelor degree
- At least 5 years of experience leading and managing engineering teams
- 7+ years of experience with data at scale (Kafka, Spark, Hadoop/YARN, MySQL CDC, Airflow, Snowflake, S3, Kubernetes)
- Strong working experience with Data engineering platforms (PySpark, Python)
- Experience with public cloud providers (Snowflake, AWS)
- Experience working with complex stakeholder organizations
- Deep understanding of software/big data solution development and leading teams
- Strong technical skills (Coding & System design)
- Excellent communicator with strong stakeholder management
- Proven success in driving technical, business, and people initiatives
- Humble and thoughtful technology leader
- Exceptional leadership capabilities in creating unified and motivated teams
- n/a
12 skills required
Job Details
Project description
As a Data & Application Engineer, you are responsible for the engineering team and the technology that the team owns. You will not only work as a coach for your team but also as a technical leader, ensuring that the right technical decisions are made when building our data and reporting product(s).
As a data and analytics team, we are responsible for building a cloud-based Data Platform for our client and its stakeholders across brands. We aim to provide our end users from different Finance departments, e.g.., Risk, FPA, Tax, Order to Cash, the best possible platform for all of their Analytics, Reporting & Data needs.
Collaborating closely with a talented team of engineers and product managers, you'll lead the delivery of features that meet the evolving needs of our business on time. You will be responsible to conceptualize, design, build and maintain data services through data platforms for the assigned business units. Together, we'll tackle complex engineering challenges to ensure seamless operations at scale and in (near) real-time.
If you're passionate about owning the end-to-end solution delivery, thinking for future and driving innovation and thrive in a fast-paced environment, join us in shaping the future of the Data and Analytics team!
Responsibilities
Strategy and Project Delivery
Together with the business Subject Matter Experts and Product Manager, conceptualize, define, shape and deliver the roadmap to achieving the company priority and objectives
Lead business requirement gathering sessions to translate into actionable delivery solutions backlog for the team to build
Lead technical decisions in the process to achieve excellence and contribute to organizational goals.
Lead the D&A teams in planning and scheduling the delivery process, including defining project scope, milestones, risk mitigation and timelines management including allocating tasks to team members and ensuring that the project stays on track.
Have the full responsibility in ensuring successful delivery by the D&A teams to deliver new products on time, set up processes and operational plans from end to end, e.g., collecting user requirement, design, build & test solution and Ops Maintenance
Technical leader with a strategic thinking for the team and the organization. Visionary who can deliver strategic projects and products for the organization.
Own the data engineering processes, architecture across the teams
Technology, Craft & Delivery
Experience in designing and architecting data engineering frameworks, dealing with high volume of data
Experience in large scale data processing and workflow management
Mastery in technology leadership
Engineering delivery, quality and practices within own team
Participating in defining, shaping and delivering the wider engineering strategic objectives
Ability to get into the technical detail (where required) to provide technical coach, support and mentor the team
Drive a culture of ownership and technical excellence, including reactive work such as incident escalations
Learn new technologies and keep abreast of existing technologies to be able to share learnings and apply these to a variety of projects when needed
Skills
Must have
Role Qualifications and Requirements:
Bachelor degree
At least 5 years of experience leading and managing one or multiple teams of engineers in a fast-paced and complex environment to deliver complex projects or products on time and with demonstrable positive results.
7+ years' experience with data at scale, using Kafka, Spark, Hadoop/YARN, MySQL (CDC), Airflow, Snowflake, S3 and Kubernetes
Solid working experience working with Data engineering platforms involving languages like PySpark, Python or other equivalent scripting languages
Experience working with public cloud providers such as Snowflake, AWS
Experience to work in a complex stakeholders' organizations
A deep understanding of software or big data solution development in a team, and a track record of leading an engineering team in developing and shipping data products and solutions.
Strong technical skills (Coding & System design) with ability to get hands-on with your team when needed
Excellent communicator with strong stakeholder management experience, good commercial awareness and technical vision
You have driven successful technical, business and people related initiatives that improved productivity, performance and quality
You are a humble and thoughtful technology leader, you lead by example and gain your teammates' respect through actions, not the title
Exceptional and demonstrable leadership capabilities in creating unified and motivated engineering teams
Nice to have
n/a
Other
Languages
English: B2 Upper Intermediate
Seniority
Lead
Similar Jobs
London stock Exchange
Minecast
Accenture
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Comscore
Penumbrainc
Sony Pictures Entertainment
Get notifed when new similar jobs are uploaded
Jobs in Italy, New York, United States
CyberArk
Nintendo
Apple
.png%3F1676067498&w=256&q=50)
Get notifed when new similar jobs are uploaded
Data Analysis Jobs
Get notifed when new similar jobs are uploaded
About The Company
Get notified when new jobs are added by luxsoft
