The Data Management and BI Team is seeking a Sr. Staff Data Engineer to join our team. We build data pipelines to land, profile, and store multiple internal & external datasets. We also build applications that surface this data to support our business partners’ strategic decision-making. We're an AWS shop that uses open-source technologies including Scala, Python, Pandas, Spark, Hive, and Postgres as well as BI tools, such as Tableau and MicroStrategy. We work in a very agile environment, where product specifications are flexible and often change rapidly over time. We're seeking people who are comfortable with ambiguity, can drive towards clarity, and define execution plans. While the key focus for this role is on backend engineering, engineers who have full-stack expertise will be especially considered.
Responsibilities:
- Designs, builds, and oversees the deployment and operation of technology architecture, solutions and software to capture, manage, store, and utilize structured and unstructured data from internal and external sources
- Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions
- Develops technical tools and programming that leverage artificial intelligence, machine learning, and big-data techniques to cleanse, organize and transform data and to maintain, defend and update data structures and integrity on an automated basis
- Leverage prototyping methodologies to propose and design creative business solutions that exploit our broad toolset of technologies (Big Data, MicroStrategy, Tableau, Python, Spark etc).
- Creates and establishes design standards and assurance processes for software, systems, and applications development to ensure compatibility and operability of data connections, flow,s and storage requirements.
- Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs.
- Design, develop, and maintain CI/CD pipelines using GitHub Actions to automate deployment, testing, and monitoring of applications.
- Implement and manage serverless solutions (e.g., AWS Lambda, EMR Serverless, Kafka, SNS, SQS, Athena etc.) as part of the application architecture.
- Implement infrastructure as code (IaC) practices using tools like Terraform, AWS CloudFormation, or similar to manage cloud infrastructure.
- Work with development teams to set up automated testing frameworks, ensuring high test coverage and code quality.
- Must understand the basics of relational data modeling and be able to clearly articulate the reasons for using to non-relational systems in our architecture. Experience in desired but relevant experience in any of the following is acceptable: Singlestore, MySQL, Redshift, Athena, MSSQL Server, Oracle.
- Decent understanding for the digital media ad sales business and ad serving technologies with experience working with ad serving transactional data logs or Nielsen demographic data.
- Educate and inform business partners on architecture, capabilities, best practices and solutions to build out future enhancements
- Assist in analyzing business requirements, source systems, understand underlying data sources, transformation requirements, data mapping, data model and metadata for reporting solutions
- Writing easily understood documentation and architecture diagrams and keeping them up to date as code and frameworks change over time.
- Strong Computer Science/Engineering/Information Systems background
- 10+ Years of Experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL, and Data Warehouse methodologies and technologies.
- 5+ years experience with AWS technologies.
- Strong experience using Python and Pandas in an AWS Lambda framework is highly desired. Experience using EMR and/or DataBricks or the ability to read EMR code and translate it into Lambdas.
- Proven experience (3+ years) in designing and managing CI/CD pipelines, specifically using GitHub Actions.
- Demonstrated experience with Python, APIs, Spark, and Scala.
- Experience with with advanced SQL, Linux, MicroStrategy, Tableau, and Pandas.
- Strong problem-solving skills.
- Strong oral and written communication and influencing skills, with the ability to communicate new concepts and drive change in processes and behaviors and to communicate complex technical topics to management and non-technical audiences.
- Bachelor’s degree in Engineering, Computer Science, Information Systems or related field with 10+ years of relevant experience.
Desired Characteristics:
- 1+ years in Digital Media Publisher Industry with a solid understanding of Digital Research
- Experience with various digital platforms such as Omniture (Site Catalyst), Rentrak, comScore, Operative One, Google DoubleClick, Freewheel, Ad-Juster, MOAT, Nielsen, Facebook, Twitter, etc
- Understanding of how to manage code in the Enterprise Git repository with appropriate branching and documentation skills
- Ability to design optimized, performant, and visually appealing reports, user interfaces, mockups, and documentation
- Ability to read external API documentation and write pipelines to extract data from our partners’ systems
- Ability to write and stand up internal API endpoints to share data with other internal teams.
- Strong analytical focus, results-oriented, and execution driven.
- Ability and desire to work within a cross-functional team environment with people from multiple business units, vendors, countries, and cultures.
- Self-driven/self-initiator and resourceful to achieve goals independently as well as in teams and promotes an open flow of information so that all stakeholders are well informed.
- Flexibility to adjust to changing requirements, schedules, and priorities.
- Ability to work independently under minimum supervision and be proactive in solving issues
- Energetic, committed, and solution-focused with the ability to perform under pressure and meet targets
Additional Requirements:
- Fully Remote: This position has been designated as fully remote, meaning that the position is expected to contribute from a non-NBCUniversal worksite, most commonly an employee’s residence.
This position is eligible for company sponsored benefits, including medical, dental and vision insurance, 401(k), paid leave, tuition reimbursement, and a variety of other discounts and perks. Learn more about the benefits offered by NBCUniversal by visiting the Benefits page of the Careers website. Salary range: $150,000 - $185,000 (bonus eligible)
We are accepting applications for this position on an ongoing basis.
As part of our selection process, external candidates may be required to attend an in-person interview with an NBCUniversal employee at one of our locations prior to a hiring decision. NBCUniversal's policy is to provide equal employment opportunities to all applicants and employees without regard to race, color, religion, creed, gender, gender identity or expression, age, national origin or ancestry, citizenship, disability, sexual orientation, marital status, pregnancy, veteran status, membership in the uniformed services, genetic information, or any other basis protected by applicable law.
If you are a qualified individual with a disability or a disabled veteran, you have the right to request a reasonable accommodation if you are unable or limited in your ability to use or access nbcunicareers.com as a result of your disability. You can request reasonable accommodations by emailing AccessibilitySupport@nbcuni.com.
For LA County and City Residents Only: NBCUniversal will consider for employment qualified applicants with criminal histories, or arrest or conviction records, in a manner consistent with relevant legal requirements, including the City of Los Angeles' Fair Chance Initiative For Hiring Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, where applicable.
NBCUniversal is one of the world's leading media and entertainment companies. We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our global theme park destinations, consumer products, and experiences. We own and operate leading entertainment and news brands, including NBC, NBC News, NBC Sports, Telemundo, NBC Local Stations, Bravo, and Peacock, our premium ad-supported streaming service. We produce and distribute premier filmed entertainment and programming through our powerhouse film and television studios, including Universal Pictures, DreamWorks Animation, and Focus Features, and the four global television studios under the Universal Studio Group banner, and operate industry-leading theme parks and experiences around the world through Universal Destinations & Experiences, including Universal Orlando Resort, home to Universal Epic Universe, and Universal Studios Hollywood. NBCUniversal is a subsidiary of Comcast Corporation. Visit www.nbcuniversal.com for more information.
Our impact is rooted in improving the communities where our employees, customers, and audiences live and work. We have a rich tradition of giving back and ensuring our employees have the opportunity to serve their communities. We champion an inclusive culture and strive to attract and develop a talented workforce to create and deliver a wide range of content reflecting our world.
Originally posted on Himalayas