Database Engineer (Lakehouse)

8 Months ago • 5 Years +
Devops

Job Description

As a Database Engineer (Lakehouse), you'll be responsible for deploying, maintaining, and enhancing the company's Lakehouse and Data Platform. This involves ensuring platform security, scalability, and high availability. You will collaborate with various teams (product, analytics, engineering, data science) to build Big Data and Fast Analytics solutions. Key responsibilities include administering Lakehouse and Fast Analytics Platforms, supporting the development lifecycle, driving automation, leading complex database tasks, staying current with industry trends, collaborating across teams, cross-training peers, and providing production support. The role requires experience with the Hadoop ecosystem, infrastructure as code, automation tools, and scripting languages.
Good To Have:
  • Experience with containerization (Docker/Kubernetes)
  • System administration and tuning of Linux servers
Must Have:
  • 5+ years IT experience, 3+ years in DataOps/SRE/DevOps/Hadoop Admin/Linux Admin/DBA roles
  • Production support of Hadoop ecosystem (HDFS, YARN, etc.) in Linux
  • Experience with Infrastructure as Code and automation tools
  • Proficiency in scripting languages (Bash, Python, etc.)
  • Strong communication and collaboration skills
Perks:
  • Private health insurance
  • Remote work option
  • Gym reimbursement
  • Company bus lines
  • Relocation package
  • Learning budget
  • Flexible hours
  • Volunteering days
  • Referral program
  • Gaming room and other workplace amenities

Add these skills to join the top 1% applicants for this job

linux
hadoop
data-analytics
communication
java
bash
github
kubernetes
puppet
yarn
python
docker
svn
git
ansible

Who we are

The Workshop is a tech company that develops intuitive software for the online gaming industry. Our motto is to move “Fearlessly Forward” together. Cooperative innovation is at the center of everything we do – from our games, new products and technologies, to how we collaborate and share inspiration with one another.


Your mission

As part of the Data Group Platform team, you will be deploying, maintaining and enhancing our Lakehouse and Data Platform initiatives, fostering cross functional collaboration, shape the future of our Data and Analytics Platform and bring data knowledge closer to our decision makers and supporters. You will collaborate with stakeholders; including, product, analytics, engineering and data scientists, to build and deliver secure, highly scalable and optimised Big Data, Lakehouse and Fast Analytics solutions to achieve our business goals.

What you'll do

  • Administer Lakehouse and Fast Analytics Platforms: Ensure our data platforms remain online, secure, appropriately sized, and equipped with robust High Availability (HA) and Disaster Recovery (DR) solutions.
  • Support Development Lifecycle: Collaborate throughout the feasibility, design, and delivery phases to ensure our solutions are automated, scalable, maintainable, and secure.
  • Drive Automation and Consistency: Promote and contribute to creating solutions that drive automation, ensure environment consistency, and facilitate continuous delivery, embodying an “everything as code” mentality.
  • Lead Complex Database Tasks: Take the lead on complex tasks, including Information Lifecycle Management, large table modifications, advanced query tuning, and data migrations.
  • Stay Current with Trends: Utilize your training budget and work time to stay updated on industry trends and technology adoption, sometimes leading the charge on implementing new data platform technologies.
  • Collaborate Across Teams: Work closely with colleagues, data product, data engineering teams, data analytics and business stakeholders to ensure alignment and effectiveness in database solutions.
  • Cross-Train Peers: Engage in knowledge sharing by cross-training peers in database development and administration, fostering a culture of mutual learning.
  • Provide Production Support: Participate in providing out-of-hours production support as part of a 24/7 rotation, ensuring system reliability and performance at all times.


What you'll bring

  • 5+ years IT experience with 3+ years’ experience in one of the following roles supporting mission critical production environments:
    • DataOps; SRE (Site Reliability Engineer); DevOps; Hadoop Administrator; Linux Administrator; Database Administrator
  • Experience of providing Production Support of the following within Linux environments:
    • Hadoop ecosystem: HDFS, YARN, Zookeeper, Ranger, Knox, Hive, Hbase, Kerberos, etc
    • Kafka
  • Infrastructure as Code
    • Automation tools (Puppet, Ansible, etc)
    • Code versioning tools (GIT, SVN, etc)
    • Scripting languages or programming frameworks (Bash, Python, Java, etc)
  • Strong interpersonal skills
  • Excellent English verbal and written communication skills
  • Open minded, willing to share knowledge and learn new skills
  • Experience of the following would be useful but is not essential:
    • Containerisation (Docker/ Kubernetes)
    • System admin and tuning of Linux based servers


What's in it for you (Spain)

    • Private life and health insurance for you and your family.
    • Four weeks per year to work from anywhere for eligible employees.
    • Gym reimbursement.
    • Company bus lines for convenient transportation applicable for employees Malaga based.
    • Relocation package for you and your family including soft-landing package services to help you settle in (applicable for relocation to Malaga, if you are moving from a different city/country)
    • Learning Pocket for personal development.
    • A hybrid working model with flexible hours.
    • 3 volunteering paid days each year.
    • Generous referral programme.
    • Workplace perks such as gaming room with darts, pool, ping pong table ,foosball, consoles and much more! We also enjoy massages and a kitchen stocked with coffee, fruits, nuts and ice cream.

Our values

We understand that great ideas come from great people, and great people thrive when they’re trusted to challenge, change, improve, and perfect our products and processes. Our forte lies in the diversity of our skills – and that comes from the diversity of our people.

The Workshop is committed to being a diverse and inclusive workplace, where we all learn together, trust each other, and value collaboration. We welcome candidates of all genders, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age, nationality, belief (or lack thereof), and programming language preference. As an equal opportunity employer, we offer a friendly, supportive working environment for all. It’s a place where you can try new ideas, take risks, and enjoy the support to move Fearlessly Forward.

Set alerts for more jobs like Database Engineer (Lakehouse)
Set alerts for new jobs by The Workshop
Set alerts for new Devops jobs in Spain
Set alerts for new jobs in Spain
Set alerts for Devops (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙