
Senior Data Engineer
Flow Control Group
Job description
FCG is seeking a Senior Data Engineer to work on our Central Data Platform team, utilizing Snowflake, dbt, and Fivetran, and responsible for end-to-end ELT development from ingestion of raw source system data through our integrated and data consumption layers in Snowflake. This role provides data analysis of raw and transformed data, documents source-to-target mappings, provides Snowflake platform expertise, develops and tests data transformations in dbt, and continues to evolve our dbt and Snowflake environments, including architecture, performance tuning, job monitoring, troubleshooting, and environment management.ย The Senior Data Engineer works as part of a multi-functional team of data professionals focused on delivering data and evolving our technical infrastructure and processes to help deliver reliable, quality data to our business stakeholders.
Key Responsibilities:
Technical Expertise: Provide technical expertise in all capabilities of dbt and Snowflake.ย
Development: Design, build, and manage data transformations in dbt. Create reusable components and templates and proof-of-concept solutions. Develop and manage data pipelines as needed.ย Implement functionality in Snowflake.
Source to Target Mappings: Work with data team members to analyze source data and identify transformation requirements to move data to our data warehouse and data marts.
Data Integration: Design robust, reliable, scalable, and performant systems for large-volume data processing.ย Help drive decisions on data architecture and engineering best practices.
Data Observability: Develop and enhance monitoring of workflows and processes.
Solution Design: Collaborate with technical teams to design and implement solutions that meet business requirements and align with best practices.
Security: Design security standards and ensure proper implementation of security.
Performance: Ensure our data warehouse processing is optimized for performance. Collaborate with team members to ensure data loads and transformations flow through the system to deliver data according to requirements.
Support: Provide comprehensive technical support for data warehouse processing.
Testing and Validation: Develop testing frameworks for solutions to ensure that solutions meet requirements and perform as expected.
Metadata: Work with business users, technical teams, and data stewards to create documentation and metadata to support understanding of data warehouse processing.
Continuous Improvement: Identify opportunities for process improvements and system enhancements to increase efficiency and effectiveness.
Qualifications:
Experience:
Minimum 5+ years of experience developing and scaling dbt projects.
Minimum 5+ years of experience with Snowflake.
Proven experience designing and implementing dbt transformations in large-scale enterprise analytics environments.
Deep knowledge of all aspects of the Snowflake environment, from databases to security and AI capabilities.
Experience working with data pipeline tools like Fivetran.
Proven experience designing and managing security requirements.
Experience in supporting data engineering applications.
Minimum of 5 years working with cross-functional teams and managing multiple projects and priorities.
Additional Technical Skills:
Expert in SQL and data analysis.
Experience with Python and AI.
Strong understanding of data integrations, data warehousing, data modeling, and data engineering.
Expert at creating architecture diagrams and documenting requirements and design details.
Familiarity with Azure and cloud architectures.
Required Analytical Skills:
Excellent problem-solving skills and attention to detail.
Ability to analyze complex business processes and translate them into technical requirements.
Evaluate performance, traceability, and usability in all designs.
Expertise working to implement data warehouses, data marts, and analytic datasets that align with business objectives.
Ability to analyze data from disparate sources to identify gaps in data or definitions.
Ability to effectively test data products and analyze data by looking for patterns and anomalies in the data that impact deliverables.
Ensure alignment with data standards and data governance.
Communication Skills:
Strong verbal and written communication skills.
Ability to effectively communicate with technical and non-technical stakeholders.
Personal Attributes:
Team Player: Ability to work collaboratively in a team environment.
Adaptability: Comfortable working in a fast-paced and dynamic environment.
Self-Motivated: Proactive and able to work independently with minimal supervision.
Customer Focus: Strong commitment to delivering high-quality service to internal and external customers.