
Principal Data Engineer
Aderant
Job description
Aderant is a global industry leading software company providing comprehensive business management solutions for law firms and other professional services organizations with a mission to help them run a better business. We are motivated by a collective desire to drive the legal industry to the forefront of innovation. With over 2,500 clients around the world, including 95 of the top AmLaw 100 firms, we are changing the outside perception of the legal sphere; where there was once resistance to modernization, we are creating a culture that embraces new ideas and technology.
At Aderant, the โAโ is more than just a letter. It is a representation of how we fulfill our foundational purpose, serving our clients. It embodies our core values and reminds us that to achieve success, every day must start with the โAโ. We bring the โAโ to life by fostering a culture of innovation, collaboration, and personal growth. We encourage our diverse teams to bring their whole selves to work โ ideas, experience, and passion โ to drive our mission forward.
Our people are our strength.
Principal Data Engineer
About the Role
We are seeking a Principal Data Engineer to lea d the design , development , and optimization of our clou d-native data platform. You will be responsible for archit ecting scal able ET L pipelines, ment oring engineers , and driving technical decisions that shape our data infrastructure . This is a hands-on leadership role requiring deep expertise in AWS data services, distribute d computing, and modern data lak ehouse architect ures.
Responsibilities
Technical Leadership
-
Architect and evol ve our medall ion -based data lakehouse (Bronze/Silver/Gold tiers ) on AWS
-
Design and implement data transformation pipelines that scale to handle petabytes of data
-
Establish best practices for data modeling , including dimensional modeling (Fact/Dimension tables ) and slowly changing dimensions
-
Define and enforce data quality , governance , and security standards across the platform
-
Lea d technical design reviews and provide guidance on complex engineering challenges
Hands -On Engineering
-
Buil d and maintain production-grade ETL pipelines using AWS Glue , PySpark, and Apache Iceberg
-
Develop re usable Python libraries and frameworks for data processing and transformation
-
Implement data line age tracking and query optimization strategies
-
Design event -driven data architectures using Step Functions , Lambda, and S QS
-
Optimize Spark jobs for performance , cost efficiency , and reliability
Collaboration & Mentorship
-
Mentor an d coach data engineers , fos tering a culture of technical excellence
-
Partner with Data Scientists , Analytics Engineers, and Product teams to understan d data requirements
-
Collaborate with Platform an d Dev Ops teams on CI/CD , observability, and infrastructure automation
-
Contribute to architectural decisions and technical roa dmap planning
Required Qualifications
Experience
-
8+ years of experience in data engineering, with 3+ years in a senior or lead capacity
-
Proven track record of designing and operating large -scale data platforms in production
-
Experience leading technical projects an d mentoring engineers
AWS Data Engineering Expertise
Prof iciency with AWS data engineering services including but not limited to:
-
Data Movement & Integration: D MS (Database Migration Service), SQS, Lambda
-
Data Processing : AWS Glue, EM R, Step Functions
-
Data Storage: S3, D ynamoDB, Redshift
-
Governance & Observ ability: Data Z one, CloudWatch , Clou dTrail
Technical Skills
-
Expert -level proficiency in Python an d SQL (Spark SQL, T-SQL, or similar )
-
Deep experience with Apache Spark (PySpark) for distribute d data processing
-
Strong knowledge of data lake table formats : Apache Iceberg, Delta Lake , or Apache H udi
-
Prof iciency with dimensional modeling an d data warehouse design patterns
-
Experience with infrastructure as code an d CI /CD pipelines (GitHub Actions , Terraform , or Clou dFormation)
-
Famili arity with data serial ization formats (Parquet , Avro, JSON)
Architecture & Design
-
Experience designing medall ion architect ures or similar ti ered data processing patterns
-
Understanding of CDC (Change Data Capture) patterns and event-driven architectures
-
Knowledge of data lineage , catalog ing, and metadata management
-
Experience implementing row -level security and data access controls
Preferred Qualifications
-
Experience with observ ability frameworks such as OpenTelemetry
-
Familiarity with data validation libraries (Pydantic, Great Expectations)
-
Experience with async Python (asyncio, ai oboto3 ) for high -through put applications
-
Knowledge of Kubernetes and container ize d work loads
-
Experience with data mesh or data product architect ures
-
Backgroun d in legal , financial, or enterprise S aa S domains
Technical Environment
You will work with :
-
Languages : Python , SQL , Spark SQL
-
Compute : AWS Glue 5.0, Lambda , Step Functions
-
Storage: S3, D ynamoDB, Redshift Server less
-
Formats : Apache Iceberg , Parquet, JSON
-
Orchest ration: AWS Step Functions, Event Bridge
-
CI /CD: GitHub Actions, multi -environment deployments
-
Observ ability: Clou dWatch, Open Telemetry, custom metrics pip elines