Skip to main content

BrightDrop - Senior Data Engineer – Delivery Intelligence Group

  • Palo Alto
  • Engineering
  • Full time
  • Added
  • JR-000101346

Description

As a Senior Data Engineer within our Delivery Intelligence Group, you will be responsible for designing, developing, and maintaining efficient data workflows and associated cloud infrastructure that support BrightDrop’s core analytic products and services. You will work closely with our data scientists, DevOps, and software engineers to automate pipelines that transform data in the BrightDrop data lakehouse into deployable data models that power our automated fleet insights and visualizations as well as emerging machine learning, optimization, and AI applications. The ideal candidate will have experience standing up ELT pipelines to handle massive volumes of spatiotemporal data, designing enterprise data warehouse models, implementing robust data quality tests, and using data pipeline-as-code integration systems to ensure the smooth and efficient orchestration of the workflows powering our analytics platform.

Responsibilities:

  • Architect, implement, and maintain ELT pipelines in our cloud-native data lakehouse platform.

  • Work with data scientists to turn exploratory analyses into production data transformation workflows within our multihop data lakehouse architecture.

  • Support enterprise-wide use of BI tools and assist in developing internal and external analytics products (e.g., dashboards).

  • Generate and deploy feature engineering pipelines to power internal and customer-facing machine learning-based products.

  • Maintain data quality testing and monitoring tools.

  • Work with information security, DevOps, and DataOps to maintain data classification, auditing, and access and cost control policies.


Additional Description

Required:

  • Bachelors degree (Master’s preferred) or equivalent experience in computer science, data science, engineering, or related quantitative field

  • 5+ years of industry experience developing, implementing, and maintaining solutions for Big Data or data warehousing systems

  • 3+ years of industry experience working in a cloud environment (Azure preferred)

  • 3+ years experience working with SQL query authoring for automated data transformation (familiarity with dbt preferred, but not required).

  • 2+ years of experience developing streaming data loading pipelines (use of Spark/pySpark preferred)

  • Basic understanding of machine learning/statistical learning principles

  • Experience implementing and maintaining data workflow orchestration and integration tools (e.g.  Airflow/Astro, Prefect, dbt cloud, etc.)

  • Understanding of and experience with application of data quality tools integrated with CI/CD automation frameworks in functional deployment environments (e.g., Github Actions/Azure DevOps pipelines).

  • Familiarity with data quality testing frameworks (Great Expectations, Deequ)

  • Self-driven with an interest in on-the-job learning.

Preferred:

  • Familiarity with enterprise warehouse data modeling techniques (e.g., Kimball)

  • Experience integrating simulation systems with distributed, data-intensive processing or analytics applications

Desired:

  • Working familiarity with terraform

  • Domain knowledge in transportation and energy systems, graph algorithms, convex optimization, and/or reinforcement learning

  • Engagement with modern data stack community (open source and commercial)

  • Passion for transportation decarbonization

  • High degree of attention to software craftsmanship and professionalism

  • Experience working with containerization technologies and orchestration platforms (specifically Docker and Kubernetes)

#LI - Hybrid

The expected base compensation for this role is: ($106,460 - $161,240 USD Annual). Actual base compensation within the identified range will vary based on factors relevant to the position.

Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.

Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more.


About BrightDrop

BrightDrop is a tech company transforming commercial delivery and logistics. Its portfolio of electric delivery vehicles, smart eCarts, and software solutions are designed to create a smarter, safer, more sustainable future. BrightDrop is a wholly owned subsidiary of General Motors. For more information, visit gobrightdrop.com.

Why Join Us 

We aspire to be the most inclusive company in the world. We believe we all must make a choice every day – individually and collectively – to drive meaningful change through our words, our deeds and our culture. Our Work Appropriately philosophy supports our foundation of inclusion and provides employees the flexibility to work where they can have the greatest impact on achieving our goals, dependent on role needs. Every day, we want every employee, no matter their background, ethnicity, preferences, or location, to feel they belong to one General Motors team.

Benefits Overview

The goal of the General Motors total rewards program is to support the health and well-being of you and your family. Our comprehensive compensation plan incudes, the following benefits, in addition to many others:
• Paid time off including vacation days, holidays, and parental leave for mothers, fathers and adoptive parents;
• Healthcare (including a triple tax advantaged health savings account and wellness incentive), dental, vision and life insurance plans to cover you and your family;
• Company and matching contributions to 401K savings plan to help you save for retirement;
• Global recognition program for peers and leaders to recognize and be recognized for results and behaviors that reflect our company values; 
• Tuition assistance and student loan refinancing;
• Discount on GM vehicles for you, your family and friends.

Diversity Information

General Motors is committed to being a workplace that is not only free of discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that workforce diversity creates an environment in which our employees can thrive and develop better products for our customers.   We understand and embrace the variety through which people gain experiences whether through professional, personal, educational, or volunteer opportunities. GM is proud to be an equal opportunity employer.


We encourage interested candidates to review the key responsibilities and qualifications and apply for any positions that match your skills and capabilities.

Equal Employment Opportunity Statements

The policy of General Motors is to extend opportunities to qualified applicants and employees on an equal basis regardless of an individual's age, race, color, sex, religion, national origin, disability, sexual orientation, gender identity/expression or veteran status. Additionally, General Motors is committed to being an Equal Employment Opportunity (EEO) Employer and offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us at Careers.Accommodations@GM.com or call us at 800-865-7580. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.