Senior Software Engineer (Data Engineer)

• Plume’s Data Services team is looking for engineers to build and operate data pipelines that power the gamut of Plume products and analytics. Due to the massive scale and performance requirements of many of our use cases, you will be solving challenging problems on a daily basis using a variety of cutting-edge technologies

• Partner with stakeholders to define data requirements and translate them into robust pipeline designs

• Build and maintain high-quality data pipelines with strong reliability and data integrity standards

• Own data warehouse schema documentation and keep it current as systems evolve

• Write clean, well-structured code and contribute to a culture of rigorous peer review

• Continuously refactor and optimize pipelines for performance, cost efficiency, and operational simplicity

• Triage and resolve production issues related to data quality and availability

• Mentor junior engineers and new hires, helping them ramp up quickly and contribute confidently

• Uphold data governance requirements including access controls, retention policies, residency rules, and de-identification

• Contribute to the technology roadmap and drive best practice adoption across the team

• Orchestrate complex workflows in Apache Airflow writing DAGs, managing dependencies, and building in automated error handling

• Implement granular access controls and data security policies using AWS Lake Formation

• Integrate automated data quality checks into deployment pipelines so issues are caught before they reach production

Benefits

• Retirement savings contributions

• Plume employee referral bonus program

• Allowance for home-office set up

• Lifetime Plume HomePass membership

• Monthly data or phone allowance

• Public transportation reimbursement

• Competitive and comprehensive health insurance coverage and extended benefits such as dental, vision, life, short/long-term disability insurance, and FSA/HSA (detailed coverage may vary by location)

• Employee assistance program

• Employee discounts

• Patent submission support and incentive award program

• Professional development opportunities

• Immigration support

• PlumeStrong - our corporate social responsibility program designed to apply our resources (time, brainpower, product, money) for good

• Generous parental leave policy

• Generous vacation policy to ensure time to recharge (open paid time off or generous accrued paid time off based on location)

• Remote/flexible work arrangements

• Online and in-person team-building events

• Holistic health platform through Walking on Earth

• Health and wellness reimbursement and a Premium Strava membership- Strong Python skills for scripting, automation, and Airflow orchestration; proficiency in Java or Scala for core pipeline development

• Deep understanding of large-scale data processing frameworks, preferably Apache Spark (Flink experience a plus)

• 5+ years of software development experience building, scaling, and supporting production data pipelines

• Solid grasp of data warehousing concepts and design patterns

• A DataOps mindset comfortable with CI/CD for pipelines, environment monitoring, IAM/permissions management, and owning what you ship

• High proficiency in SQL across data warehousing technologies

• Strong analytical thinking and clear, effective communication written and verbal

• Solid Apache Airflow experience: writing DAGs, managing task dependencies, and debugging runtime failures

• Hands-on expertise with AWS big data services particularly Athena for distributed querying and Lake Formation for security, cataloging, and access management