Principal Data Engineer

Job Description

Principal Data Engineer (Databricks Platform)

THE TEAM

Core Data Services team is at the center of Data and Analytics initiatives. We are building a modern data platform to support enterprise data needs. Our mission and yours too should you choose to, is to empower and enable our data community of data engineers, data scientists, analysts, product teams and decision makers to create value.

The Core Data Services team consists of Platform Engineering, Data Engineering, Data Enablement and Operations teams. We are building a highly functional, performant modern enterprise Data Lake while supporting our current data platforms, so the focus is on maximizing functionality, creating value and content/data assets, cost optimizations and usability of the data delivery and services and all this is our measure of our success and defines us The Core Data Services Team! We are looking for a Data Engineer - Platform, You!

WHAT THIS ROLE WILL DO

This is a hands-on Data role with strong Python/PySpark coding skills
• Collaborate with stakeholders to understand and translate business requirements into technical specifications and designs.
• Design, develop, and maintain scalable data pipelines, ETL processes, and data warehouses to support data ingestion, transformation, and storage.
• Evaluate and select appropriate technologies, tools, and frameworks for data processing, storage, and analytics, considering security, scalability, performance, and cost factors.
• Define and enforce data engineering best practices, standards, and guidelines to ensure data quality, reliability, and consistency.
• Architect and implement solutions for real-time data processing, streaming analytics, and batch processing.
• Conduct performance optimization, tuning, and troubleshooting of data infrastructure components to ensure optimal performance and resource utilization.
• Stay abreast of emerging trends, technologies, and best practices in data engineering, cloud computing, and big data analytics.
• Consistent exercise of independent judgment and discretion in matters of significance.
• Participate in on-call rotations/Pagerduty for data platform support.
• Other duties and responsibilities as assigned.

WHAT THIS PERSON WILL BRING: TECHNICAL SKILLS/COMPETENCIES
• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
• 12+ years of software engineering experience, with a focus on designing and implementing data platforms.
• Proven track record of successfully architecting and delivering large-scale data solutions, e.g. platforms that process millions of streaming events per second or Petabytes of data daily.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Hands-on experience with data processing frameworks like Apache Spark or Apache Flink.
• Hands on experience using version control systems such as Git and CI/CD workflows and practice
• Extensive knowledge of data warehousing, data modeling, relational databases, and NoSQL databases.
• Hands-on experience with AWS and cloud-based data services and solutions (e.g., Databricks).
• Hands-on experience with data compliance (eg. CCPA, GDPR, etc) and governance
• Excellent problem-solving skills, analytical thinking, and the ability to thrive in a fast-paced, dynamic environment.
• Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.

BENEFITS & PERKS
Our motto is 'Taking Care of Our Own' through 6 pillars of benefits:
• HEALTH: Medical, Vision and Dental benefits for you and your family, including Flexible Spending Accounts (FSA) and Health Savings Accounts (HSAs)
• YOURSELF: Generous paid time off policy including paid holidays, sick time and paid days off for your birthday, Free concert tickets
• WEALTH: 401(k) program with company match, Stock Program
• FAMILY: New parent programs & support including caregiver leave and childcare cash, infertility support
• CAREER: Tuition reimbursement, student loan repayment internal growth and development programs & trainings
• OTHERS: Volunteer time off, crowdfunding network

Live Nation's policy regarding vaccinations and masking related to a pandemic or other infectious disease control measures, acts of God, health and safety mandates and/or restrictions imposed by applicable local, state or federal governments has evolved over time. Currently, we strongly encourage employees to be fully vaccinated from such infectious diseases for which vaccinations are available. You are expected to follow Live Nation's health and safety protocols and policies as they change from time to time.

#LI-RemoteUnitedStates
#LI-EF1

The expected compensation for this position is:
$163,000.00 USD - $204,000.00 USD
** Pay is based on a number of factors including market location, qualifications, skills, and experience.

Jobcode: Reference SBJ-gx43m1-3-144-122-20-42 in your application.