Job Description
We are seeking a Senior Data Engineer who will partner with business, analytics and infrastructure teams to design and build data pipelines to facilitate forecasting and measuring advertising campaign effectiveness. Collaborating across disciplines, you will identify internal/external data sources to design table structure, define ETL strategy & automated Data Quality checks.
Responsibilities:
• Partner with technical and non-technical colleagues to understand data and reporting requirements.
• Work with engineering teams to collect required data from internal and external systems.
• Design table structures and define ETL strategy to build performant Data solutions that are reliable and scalable in a fast growing data ecosystem.
• Develop Data Quality checks and visualizations/dashboards
• Develop and maintain ETL routines using ETL, Spark and orchestration tools such as Airflow and Nifi.
• Implement database deployments using tools like Liquibase
• Perform ad hoc analysis as necessary.
• Perform SQL and ETL tuning as necessary.
• Develop and maintain Dashboards/reports using Looker
Basic Qualifications:
• 3+ years of relevant Professional experience.
• 2+ years of work experience implementing and reporting on business key performance indicators in data warehousing environments. Strong understanding of data modeling principles including Dimensional modeling, data normalization principles etc.
• 2 + years of experience using analytic SQL, working with traditional relational databases and/or distributed systems such as Snowflake or Redshift.
• 1+ Years of experience programming languages (e.g. Python, Pyspark) preferred.
• 1+ years of experience with workflow management tools (Airflow, Nifi).
• 1+ years of experience working with Spark on EMR or Databricks.
• Good understanding of SQL Engines and able to conduct advanced performance tuning
• Familiarity with data exploration / data visualization tools like Tableau, Looker, Chartio, etc.
• Ability to think strategically, analyze and interpret market and consumer information.
• Strong communication skills – written and verbal presentations.
• Excellent conceptual and analytical reasoning competencies.
• Degree in an analytical field such as economics, mathematics, or computer science is desired.
• Comfortable working in a fast-paced and highly collaborative environment.
• Familiarity with Agile Scrum principles and ceremonies
Preferred Qualifications:
• Bachelor's degree – Computer Science or equivalent
Jobcode: Reference SBJ-g638b8-52-91-177-91-42 in your application.