Data Management Specialist

Job Description

DATA ENGINEERING
What We Do
Our mission is to provide a world-class platform that empowers the business to leverage data that will enhance, monitor, and support our products. We are responsible for data ingestion systems, processing pipelines, and various data stores all operating in the cloud. We operate at a petabyte scale, and support near real-time use cases as well as more traditional batch approaches.
What You'll Do
The Technical Librarian will be the first dedicated member of the Data Management team, supporting 3Lateral Services and the R&D groups within both the MetaHuman product department and the wider Epic Games group. You will be instrumental in ensuring that all captured data is managed efficiently and that a consistent approach is provided to data management. A successful candidate not only has strong technical expertise but also excels in communication and teamwork.
In this role, you will
• Propose, drive, develop, and implement data management and storage process improvements, optimization, and best practices, including writing scripts to automate data deletion processes
• Have a great understanding of storage infrastructure (data locations, server features, archive, capacity, availability, projections, etc) and pipeline.
• Manage data access across multiple sites: database queries, sorting, naming, optimizing, structuring, moving, and ingesting data to fulfill conventional and unconventional requests from Service and R&D teams.
• Ensure data flow for capture and processing pipeline, maintaining an overview of storage capacity on multiple sites in parallel.
• Establish data deletion policies and execute data deletions in close collaboration with the MH team.
• Manage archive, including data restoration
• Support metadata tagging process
What we're looking for
• Experience in handling big data projects and processing large amounts of data with accurate indexing and storage
• Strong understanding of storage protocols (NFS, SMB, S3) and storage concepts
• Proficient knowledge of Python, Bash shell scripting, command-line tools (e.g., find, du, rsync, robocopy, rclone), SQL or data query tools
• Proficiency in Windows, Linux, and macOS environments
• Strong organizational skills, flexibility, and curiosity
• Excellent communication skills and the ability to respectfully interact with co-workers at all levels in a professional environment
• Problem-solving skills and the ability to show initiative and proactively engage in implementing solutions when appropriate
• Ability to work independently or as part of a team and without direct supervision
• A methodically consistent approach to repetitive tasks; values accuracy and acute attention to detail
• Bachelor's degree 6.2 or relevant industry experience

Note to Recruitment Agencies: Epic does not accept any unsolicited resumes or approaches from any unauthorized third party (including recruitment or placement agencies) (i.e., a third party with whom we do not have a negotiated and validly executed agreement). We will not pay any fees to any unauthorized third party. Further details on these matters can be found here.

Jobcode: Reference SBJ-vew9nj-18-218-195-15-42 in your application.