Technical Librarian

DATA ENGINEERING

What We Do

Our mission is to provide a world-class platform that empowers the business to leverage data that will enhance, monitor, and support our products. We are responsible for data ingestion systems, processing pipelines, and various data stores all operating in the cloud. We operate at a petabyte scale, and support near real-time use cases as well as more traditional batch approaches.

What You'll Do

The Technical Librarian will be the first dedicated member of the Data Management team, supporting 3Lateral Services and the R&D groups within both the MetaHuman product department and the wider Epic Games group. You will be instrumental in ensuring that all captured data is managed efficiently and that a consistent approach is provided to data management. A successful candidate not only has strong technical expertise but also excels in communication and teamwork.

In this role, you will

• Propose, drive, develop, and implement data management and storage process improvements, optimization, and best practices, including writing scripts to automate data deletion processes
• Have a great understanding of storage infrastructure (data locations, server features, archive, capacity, availability, projections, etc) and pipeline.
• Manage data access across multiple sites: database queries, sorting, naming, optimizing, structuring, moving, and ingesting data to fulfill conventional and unconventional requests from Service and R&D teams.
• Ensure data flow for capture and processing pipeline, maintaining an overview of storage capacity on multiple sites in parallel.
• Establish data deletion policies and execute data deletions in close collaboration with the MH team.
• Manage archive, including data restoration
• Support metadata tagging process

What we're looking for

• Experience in handling big data projects and processing large amounts of data with accurate indexing and storage
• Strong understanding of storage protocols (NFS, SMB, S3) and storage concepts
• Proficient knowledge of Python, Bash shell scripting, command-line tools (e.g., find, du, rsync, robocopy, rclone), SQL or data query tools
• Proficiency in Windows, Linux, and macOS environments
• Strong organizational skills, flexibility, and curiosity
• Excellent communication skills and the ability to respectfully interact with co-workers at all levels in a professional environment
• Problem-solving skills and the ability to show initiative and proactively engage in implementing solutions when appropriate
• Ability to work independently or as part of a team and without direct supervision
• A methodically consistent approach to repetitive tasks; values accuracy and acute attention to detail
• Bachelor's degree 6.2 or relevant industry experience

EPIC JOB + EPIC BENEFITS = EPIC LIFE

We pay 100% for benefits for both employees (EEs) and dependents (deps). Our current benefits package includes coverage for private medical insurance (inc. dental/vision), supplemental life, supplemental accident, and disability. We also offer a robust mental well-being program through Modern Health, which provides free therapy and coaching for employees & dependents.