Home
/
Comprehensive
/
Senior Data Engineer
Senior Data Engineer-May 2024
Houston
May 31, 2025
About Senior Data Engineer

  Entity:

  Production & Operations

  Job Family Group:

  IT&S Group

  Job Summary:

  Grade H

  Responsible for supporting the delivery of business analysis and consulting processes and procedures for the defined specialism using sound technical capabilities, building and maintaining effective working relationships, ensuring relevant standards are defined and maintained, and supporting delivery of process and system improvements. Specialisms: Business Analysis; Data Management and Data Science; Digital Innovation.

  Job Description:

  Key Accountabilities

  Define approved patterns for data workflow, pipelines, security guidelines, policies, and procedures.

  Document the guidelines, policies, and procedures on the Digital Hub for Squad members to leverage.

  Engage in Pilot and Proof of Concepts as new platform features are released, or new data integration/ingestion use cases arise from Squad members.

  Provide oversight to ensure that Squad members are following the approved data patterns and best practices.

  Provide Data Engineering certification approval for Squad members.

  Evaluate, compare, and recommend new Data Platform enhancements, tools, and features.

  Partner and provide guidance to Squads on technical direction and approved integration patterns.

  Present recommendations for changes to the Data Platforms to the Architecture Review Board for approval.

  Ensure stable Data Platform infrastructure.

  Comfortable operating as an individual contributor and using influence and expertise to aid in the transformation of the organization.

  Knowledgeable of industry trends and best practices and staying current on new technology as it comes to market.

  Participation on the Data Platform Guild.

  Essential Experience

  5-7+ years of Data Engineering experience

  5-7+ years of relevant work experience in IT/Data and/or Analytics space

  Experience with cloud platforms, AWS preferred

  Experience in any cloud data warehouse, Snowflake preferred

  Experience with replication tools, Fivetran/LDP(prev. HVR) preferred

  Experience with transformation tools, dbt and ADF preferred

  Experience with programming languages, python preferred

  Experience with REST APIs for data ingestion

  Knowledge/Experience with Terraform, deploying IAC through CICD

  Strong understanding of ETL/ELT processing with large data stores

  Experience designing and delivering large scale, 24-7, mission-critical data pipelines and features using modern big data architectures

  Knowledge of stream processing services such as Kafka, AWS Kinesis, Apache Storm, Azure Event Grid, AWS Event Bridge, nice to have

  Demonstrated experience working in large-scale data environments which includes continuous and batch processing

  Experience working with JSON formats in Snowflake, preferred

  Strong data modeling skills

  Strong SQL skills, with attention to detail

  Enforcement of Data Mesh architecture

  Ability to aid in tuning and performance recommendations for poor performing SQL queries and/or python scripts

  Experience with CI/CD pipeline management/configuration

  Experience with Azure DevOps repositories, git experience

  Ability to work with multiple external teams and accomplish shared goals by building consensus

  Knowledge of Data Virtualization tools, preferred Denodo

  Strong communication (written/verbal) and collaboration skills

  Consulting, negotiation, and relationship skills

  Problem solving skills

  Enthusiastic, high-energy individual, self-motivated, people-oriented, and self-directed

  Must be an articulate and persuasive leader who can communicate concepts to technical & non-technical colleagues

  Must be able to maintain focus on achieving results, whilst being patient and pragmatic

  Desirable Criteria & Qualifications

  Experience working in a development role on an Agile team

  Experience with monitoring and troubleshooting cloud infrastructure

  Knowledge of Snowflake configuration, administration, and setup best practices (security, external stores, cloning, etc)

  Desire to continually learn outside of a classroom environment, and successfully apply learnings

  Demonstrated willingness to both teach others and learn new techniques

  Compensation

  We offer a reward and wellbeing package to enable your work to fit with your life. These can include, but not limited to, access to health, vision and dental insurance, flexible working schedule, paid time off policy, discretionary annual bonus program, long-term incentive program, and a generous 401K matching program. How much do we pay (Base)? $135,000 - $175,000

  *Note that the pay range listed for this position is a good faith and reasonable estimate of the range of possible base compensation at the time of posting.

  Travel Requirement

  Up to 10% travel should be expected with this role

  Relocation Assistance:

  This role is not eligible for relocation

  Remote Type:

  This position is a hybrid of office/remote working

  Skills:

  Business Acumen, Commercial acumen, Communication, Data Analysis, Data cleansing and transformation, Data domain knowledge, Data Integration, Data Management, Data Manipulation, Data Sourcing, Data strategy and governance, Data Structures and Algorithms, Data visualization and interpretation, Digital Security, Extract, transform and load, Problem Solving

  Legal Disclaimer:

  We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, socioeconomic status, neurodiversity/neurocognitive functioning, veteran status or disability status. Individuals with disabilities may request a reasonable accommodation related to bp’s recruiting process (e.g., accessing the job application, completing required assessments, participating in telephone screenings or interviews, etc.). If you would like to request an accommodation related to the recruitment process, please contact us to request accommodations.

  If you are selected for a position and depending upon your role, your employment may be contingent upon adherence to local policy. This may include pre-placement drug screening, medical review of physical fitness for the role, and background checks.

Comments
Welcome to zdrecruit comments! Please keep conversations courteous and on-topic. To fosterproductive and respectful conversations, you may see comments from our Community Managers.
Sign up to post
Sort by
Show More Comments
SIMILAR JOBS
Bilingual Spanish Field Sales Representative
Job Description: Our Field Sales Representatives earn between $48,300–$69,000 + up to $20,000 in commissions yearly if all sales goals are met. Not to mention all the other amazing rewards that worki
Area Supervisor
Our values start with our people, join a team that values you! We are the nation’s largest off-price retailer with over 2,000 stores, and a strong track record of success and growth. Our focus has al
Global Services Manager
Internal Title: Global Services Manager What you can expect You will be responsible for driving growth of our Services revenue. We build strategic partnerships with our Zoom Account Executives in ord
Principal Software Developer - C Developer - Oracle Database
Job Description We are the central team within the Oracle database development organization, entrusted with managing semi-structured data such as JSON, XML, Full-text search, and large objects. We wr
Executive Administrative Assistant
Careers that Change Lives We are a learning culture.  An inventive and collaborative group.  We are dedicated to making sure that every patient gets the best product — when they need it.  We have str
LEAF Copywriter
Overview This job is responsible for will work closely with the Lead Copywriter to develop and edit copy for marketing material while adhering to current brand standards. This Copywriter will support
Swing Manager, starting wages based on experience
Benefits of joining our team.... * Each team member is eligible for $3000 annually in FREE TUITION money! * ** This position has healthcare benefits. ** This position is based on a 40-hour work week
Upcoming Oracle Cloud Applications Delivery Architect, Program Advisor
Job Description Upcoming Oracle Cloud Delivery Architect, Program Advisor North American Application Consulting, Delivery ConfidenceLocation, US Nationwide, remote Practice Management: Support the st
Financial Consultant Manager
WARNING: Please beware of phishing scams that solicit interviews or promote work-at-home opportunities, some of which may pose as legitimate companies. Elevance Health requires a completed online app
General Utility Worker - The Den - Florida State University
Job Description Are you self-motivated and proud of the work you do? Here at Aramark, we take pride in the level of service and safety we provide! As a General Utility Worker on our team of other ser
Copyright 2023-2025 - www.zdrecruit.com All Rights Reserved