
Data Lake Engineer
Base-2 Solutions, LLC
Visa & sponsorship
- A US security clearance is required, which effectively means citizens only.
Job description
Position Summary
Base-2 Solutions is seeking a Data Lake Engineer to support USSOUTHCOM J26 ENHANCED DOMAIN AWARENESS task order. The role involves developing, maintaining, and optimizing data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data. The candidate must be proficient in Data Lakes platforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.
Essential Duties and Responsibilities
-
Develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for geospatial and structured data visualization.
-
Work with Data Lakes platforms including Databricks, Kubernetes, and ESRI ArcGIS environments.
-
Build scalable, secure web applications with metadata-driven search and retrieval features.
-
Integrate APIs for seamless data interoperability.
-
Develop and deploy full-stack applications enabling data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
-
Implement RESTful and GraphQL APIs for data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
-
Manage CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
-
Optimize database queries and indexing strategies for large-scale geospatial and structured datasets.
Required Qualifications
-
Bachelor's degree in Computer Science, Data Engineering, or a related field OR a minimum of 5 years of equivalent experience in full-stack development and data engineering.
-
Demonstrated experience developing and deploying full-stack applications for data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
-
Experience implementing RESTful and GraphQL APIs for data retrieval and integration.
-
Experience managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms.
-
Experience optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.
Preferred Qualifications
-
AWS Certified Data Analytics - Specialty.
-
Microsoft Certified: Azure Data Engineer Associate.
-
ESRI ArcGIS Developer Certification.
Required Education and Experience Equivalency
-
Bachelor's degree in Computer Science, Data Engineering, or a related field.
-
OR 5 years of equivalent experience in full-stack development and data engineering.
Required Certifications
- None specified.
Required Security Clearance
- Active Top Secret/SCI