Software Engineer

About Our Client:

The organization operates in the design software industry, helping teams collaborate and streamline workflows from initial concepts through finished products. Its platform supports users across the globe and enables real-time collaboration across a wide range of business functions. The organization is also investing in governed, reliable, and reusable AI tools that help internal teams improve productivity and operational efficiency.

About the Opportunity:

The IT Engineer, Internal AI Infrastructure develops and maintains infrastructure that enables internal AI applications, bots, and agents across the organization. This role focuses on reliable model hosting, execution, routing, observability, security, and cost management. The position plays an important role in enabling internal teams to build and deploy AI solutions securely and efficiently while establishing scalable infrastructure standards.

Responsibilities:

• Design and build hosting infrastructure for internal AI applications, including long-running workflows and scheduled jobs.

• Develop model routing systems that direct workloads to appropriate AI models based on cost, capabilities, and organizational policies.

• Implement audit trails and controls for AI model routing and usage.

• Build observability, usage analytics, audit logging, and cost attribution capabilities for AI workloads.

• Integrate identity, access management, and security frameworks into internal AI applications and infrastructure.

• Collaborate with product AI infrastructure teams to share platform resources, telemetry, and operational insights.

• Establish reliable and scalable infrastructure patterns for internal AI applications and services.

• Contribute to platform strategy, technical roadmaps, engineering standards, and infrastructure best practices.

• Partner with internal engineering teams to support adoption and effective use of AI infrastructure.

Requirements:

• Minimum 5 years of experience in software engineering, with a focus on infrastructure, platform, or backend development.

• Proven experience building internal platforms used by multiple engineering or business teams.

• Strong system design skills with experience developing resilient, observable, and production-ready systems.

• Hands-on experience operating large language model (LLM) workloads, including model gateways, routing systems, or cost instrumentation.

• Experience with enterprise identity and access management systems.

• Strong understanding of infrastructure reliability, security, observability, and operational best practices.

• Ability to work collaboratively across technical teams and translate infrastructure requirements into scalable solutions.

Preferred Qualifications:

• Experience building internal AI or developer platforms at scale.

• Familiarity with agent orchestration frameworks or related architectural patterns.

• Experience supporting audit, security, or compliance programs.

• Experience as an early or foundational infrastructure engineer responsible for establishing technical standards and practices.

Pay Range and Compensation Package:

• Annual base salary range: $153,000–$296,000 USD.

Benefits & Perks:

• Health, dental, and vision insurance.

• Retirement benefits with company contributions.

• Paid maternity and paternity leave.

• Paid time off and flexible sick leave.

• Parental leave and family planning support.

• Mental health and wellness benefits.

• Recharge days and lifestyle spending accounts.

Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin.

Note:

TalentHop is not the Employer of Record (EOR) for this role. Our purpose in this opportunity is to connect exceptional candidates with leading employers. We help job seekers worldwide discover roles that match their goals and guide them to complete their full application directly through the hiring company’s career page or ATS.