Full Time Job
Senior Data Engineer
NBC News
- Paid
- Full Time
- Senior (5-10 years) Experience
Job Description
ResponsibilitiesThis is an opportunity to play a critical role in the digital evolution of NBC News, one of the world's best known and most trusted news organizations. We are looking for a Sr. Data Engineer for the Data Engineering team, a part of NBC News Digital Technology.
You will be responsible for designing and maintaining efficient, flexible, and extensible data frameworks to build advanced analytics pipelines and data applications across the business. You will operate as leader within the data engineering team and work with other development teams to facilitate the extraction of data and maintain data pipelines across the NBC News Digital portfolio. You should have experience working with and mentoring Jr. developers and working to foster a culture of adaptability, respect and ownership.
This position reports to the Senior Manager, Data Engineering.
Responsibilities
- Possess an in-depth understanding of the data structures and governance
- Deep understanding of modern cloud computing platforms and concepts (AWS
preferred)
- Work with modern schema-less big data storage solutions
- Work closely with machine learning and data science teams to create scale and
efficiency
- Work closely with DevOps to foster a culture of collaboration
- Demonstrate critical thinking for potential roadblocks; comprehend a bigger
picture of the business and effectively communicate these issues to stakeholders
- Work closely with internal stakeholders to implement solutions that adhere to
solution designs and schema
Qualifications/Requirements
- Embrace a 'builder' mentality to push the business
forward
- 5+ years experience in a software developer role
- Proficient with AWS, Python and Pyspark
- Experience with EMR, S3, SNS, Kafka and Databricks
- Experience with distributed data technologies (e.g.
Spark)
- Proficient with Linux environment
- Familiarity with SQL and Presto
- Passion for media and news
- B.S. degree in Computer Science, Information
Technology, or equivalent experience
- Must submit an attestation disclosing your COVID-19
vaccination status and, if partially or fully vaccinated,
submitting your vaccination record no later than 7 days
following commencement of employment.
- Must be fully vaccinated against COVID-19 at the
commencement of employment or adhere to enhanced
protocols if Company determines your job position
requires accessing an NBCUniversal worksite.
- Must be willing to adhere to all Company COVID-19
workplace safety policies and protocols.
Desired Characteristics
- Working experience on Airflow and DAG is a plus.
- Experience building scalable and reliable Data Streaming
Pipeline using Sparkand Kafka.
Jobcode: Reference SBJ-r1bj40-54-225-1-66-42 in your application.