Software Engineer III

Reflexive Concepts is seeking a skilled Software Engineer III to join our team!

In this role, the engineer will leverage extensive expertise in dataflow design, data transport mechanisms, and Apache Spark-based distributed processing to design, implement, and optimize data ingress/egress pathways, ensuring efficient, scalable, and reliable processing of the organization's analytics workloads.

Qualifications

• Active TS/SCI + FS Polygraph

• Master's degree in Computer Science or related discipline from an accredited college or university, plus 5 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity OR

• Bachelor's degree in Computer Science or related discipline from an accredited college or university, plus 7 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity OR

• 9 years of experience as a SWE, in programs and contracts of similar scope, type, and complexity.

Required Skills + Experience

:

• Experience using the Linux CLI and Linux tools

• Experience developing Bash scripts to automate manual processes

• Recent software development experience using Python and Java

• Experience using Apache Airflow (DAG design, scheduling, operators, sensors) to orchestrate, schedule, and monitor complex workflows

• Experience with Distributed Big Data processing engines including Apache Spark

• Familiar with SQL technologies such as MySQL, MariaDB, and PostgreSQL for querying, joining, and aggregating large datasets

• Experience using Jupyter Notebook

• Experience with data wrangling and preprocessing using tools such as pandas, NumPy

• Experience working with structured, semi-structured, and unstructured data such as Parquet, JSON, CSV, XML

• Familiarity with data quality concepts, data validation, and anomaly detection

• Experience with Git Source Control System

Desired Skills + Experience

• Familiar with HPC Job Scheduling tools including Slurm

• Experience using the Atlassian Tool Suite (JIRA, Confluence)