Senior Data Engineer

Job Description

THE TEAM

Core Data Services team is at the center of Data and Analytics initiative. We are in the beginning of our journey to build and enterprise data platform capable to be a true underpinning of any data needs for the enterprise. Our mission is to make reliable data available and enable value creation by the data community of engineers, analysts and decision makers. Core Data Services team consists of Platform engineering team, Data Engineering, Data Enablement and ultimate owner and operator – the Data Operations team. We have plenty of opportunities to make a difference for the business and for the Ops team in all aspects - from tech to processes to developing Center of excellence

THE ROLE

As an Operations Data Engineer in Core Data Services you will work on defining and implementing operational practices in the area of data investigation, forensic and summarizing the findings and working with the end users, operations of reports and dashboards, data quality, performance, scalability, cost control and management of critical production incidents.

Core Data Services has made good progress of adopting Spark as main ETL engine and realizing the value of highly functional, performant and transparent Data Lake, all this while maintaining and streamlining existing data infrastructure and doing careful migration. Team's focus is on maximizing the functionality, value and content, optimizing cost of ownership and usability of delivered data services. You need to be curious and enjoy problem solving in the data world using Data Science tools stack.

We are looking for a seasoned professional who has experience owning and operating large scale systems at enterprise level, continuously improving operational metrics. In other words, running a center of excellence with stability and discipline practices as a bedrock of continuous innovation.

If you are looking for a challenge and a sense of ownership and have experience running large scale data operations, including performing analysis on large scale data lake, EDW, low latency data delivery for operational reporting as well as analytical use cases - we are looking for you!

This is a unique opportunity to establish world class operational center of excellence in the area of data engineering management at a company that has demands for exceptional reliability in low latency data processing at high volumes and high bursts at time of on sale for live events. Joining now at the onset of platform development also gives you a chance to provide input into architecture, help establish processes for effective cost control and governance practices.

WHAT THIS ROLE WILL DO
• Perform data forensics of the user queries and derived the root cause for the problem and propose acceptable resolution and implement them.
• Proactively monitor data processes and systems, deep dive into query and data issues ,identifying and resolving complex issues and anomalies.
• Build and maintain Inventory of ETL artifacts such as jobs, report, credentials, and dashboards.
• Define and implement operational best practices, observability, managing change and mitigating risk for enterprise data systems
• Manage and support production processes for our ETL tools and BI tools running on large scale low latency databases including Delta lake, S3, Teradata and Snowflake.
• Create and maintain Git workflows for version control along with automated CI/CD workflows and tools for code deployments.
• Document your work and help maintain our existing documents using Confluence, Google Docs, Lucid Charts and other such tools stack
• Manage technical documentation and systems providing transparency in platform functionality using live meta-data and operational dashboards
• Develop and oversee data backup, recovery, and disaster recovery procedures, ensuring high availability and data integrity.
• Develop and maintain advanced automation scripts and workflows to streamline and optimize data operations processes.
• Identify opportunities for process improvement and implement efficiency measures.
• Contribute to strategic planning and decision-making related to data operations.
• Work with our vendors and data providers

WHAT THIS PERSON WILL BRING (TECHNICAL SKILLS/COMPETENCIES)
• Experience with technical stack which includes
• Data Lake technologies like S3, AWS Data Lake, Databricks Delta lake, Google BigQuery, MySQL;
• BI Tools like DOMO, Cognos, Tableau, Business objects
• Data warehousing tech like Snowflake, Teradata, EMR, Oracle EDW;
• Experience supporting business analysis and forensics and issue triage
• Experience with workflow automation, orchestration using Airflow, Rundeck, GoAnywhere or the equivalent
• Experience with cloud services from Amazon AWS, Google GCP
• Experience with using version control systems such as git and CI/CD workflows and practices
• Experience with compliance, privacy related functionality such as CCPA, GDPR
• Ability to solve complex technical issues through debugging, research, and investigation.
• Create and maintain comprehensive documentation for data operations processes, procedures, and best practices.
• Works independently on complex projects while mentoring junior team members.
• Consistently delivers high-quality solutions and is integral to the delivery of high-quality data operations.
• 5 or more years of experience in data engineering operations, databases, and BI support in a SaaS, cloud, or technology services company managing data pipelines and analysis across multiple international time zones.
• Bachelors or Masters in engineering or computer science.
• Strong communication and problem-solving skills.
• Strategic thinker with very strong focus on operational practices and service delivery
• Highly self-motivated with excellent problem-solving skills

BENEFITS & PERKS
Our motto is 'Taking Care of Our Own' through 6 pillars of benefits:
• HEALTH: Medical, Vision and Dental benefits for you and your family, including Flexible Spending Accounts (FSA) and Health Savings Accounts (HSAs)
• YOURSELF: Generous paid time off policy including paid holidays, sick time and paid days off for your birthday, Free concert tickets
• WEALTH: 401(k) program with company match, Stock Program
• FAMILY: New parent programs & support including caregiver leave and childcare cash, infertility support
• CAREER: Tuition reimbursement, student loan repayment internal growth and development programs & trainings
• OTHERS: Volunteer time off, crowdfunding network

Live Nation's policy regarding vaccinations and masking related to a pandemic or other infectious disease control measures, acts of God, health and safety mandates and/or restrictions imposed by applicable local, state or federal governments has evolved over time. Currently, we strongly encourage employees to be fully vaccinated from such infectious diseases for which vaccinations are available. You are expected to follow Live Nation's health and safety protocols and policies as they change from time to time.

Jobcode: Reference SBJ-d2z0yy-3-135-188-88-42 in your application.