Booz Allen Hamilton
See if you qualify before applying
Get your match score and detailed fit analysis in 10 seconds.
To achieve an organization’s mission, leaders need strong team members who can create and analyze processes, communicate requirements, and develop innovative solutions throughout the execution of the mission. Whether reviewing program-wide technical architecture or providing AI expertise, our clients need someone who combines deep technical understanding of software engineering with strong architectural judgment. That is why we need you, an experienced AI Software Engineer who can operate at a system-of-systems level to support clients in advancing AI-enabled systems within an R&D environment.
As part of our team, you'll serve as Software Development Engineer to the Advanced Research Projects Agency for Health (ARPA-H), helping conceptualize, create, and execute advanced government-funded research and development programs to accelerate better health outcomes for everyone. Work with world-class scientists and engineers to support the development of high-impact solutions to society's most challenging health problems. Leverage technical expertise to provide strategic assessments of new technologies in support to senior ARPA-H decision makers. Maintain responsibility for producing and presenting findings and recommendations to a team of colleagues and clients on the feasibility and potential impact of future research programs, assisting with the management of current programs, and facilitating commercialization of successfully developed technologies.
You'll serve as an AI Software Engineer advising program leadership and supporting software engineering to support the client mission. You will support clients in ensuring that program-wide technical architecture and engineering to rigorous AI development, evaluation, and long-term impact. Your attention to detail, flexibility, communication skills, understanding of the client's mission, and problem-solving will enable the mission's success.
Develop and implement core agentic systems and workflows by implementing tool-calling, multi-step reasoning, memory, and agent-to-agent (A2A) communication patterns.
Develop and implement LLM evaluation pipelines, and build and maintain Model Context Protocol (MCP) integrations.
Build LLM-powered features including prompt orchestration, RAG pipelines, grounding and evaluation systems, and context management across model families, such as OpenAI, Anthropic, or Google.
Design and implement backend features end-to-end, including APIs, integrations with data sources, such as Dimensions, Slack, or SharePoint, and robust error handling.
Implement and iterate on prompt engineering patterns and system prompts that drive quality and consistency across model families. Build LLM evaluation components such as grounding assessment, regression tests, safety check, and quality metrics.
Write prompts and pipelines with considerations to token economics.
Contribute to infrastructure and DevOps, working with Microsoft Azure, such as Functions, API Management, or Container Apps, and maintaining CI/CD, monitoring, and observability systems.
Collaborate cross-functionally with engineers, PMs, and researchers to deliver clear, user-focused solutions and communicate technical decisions effectively.
Ensure production reliability and privacy, meeting service-level objectives while maintaining security, compliance, and graceful degradation under failures.
3+ years of experience building and operating production-grade software systems
Experience with algorithms, data structures, distributed systems, design patterns, cloud platforms, such as Azure, AWS, or GCP, and containerization, such as Docker
Experience working with CI/CD pipelines and working in high-velocity, end-to-end delivery environments
Experience interacting and communicating with senior-level executives, including SES or GS-15
Experience with using Microsoft Office, Excel, Word, and PowerPoint
Knowledge of modern backend frameworks and asynchronous programming models
Ability to work in at least 2 backend programming languages, including Python and async patterns
Ability to operate independently within a fast-paced start-up environment involving CI/CD pipelines and produce clear, actionable product stories and specs
Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
Bachelor’s in Computer Science or Software Engineering
Experience with LLM integration, such as tool-calling, RAG, multi-step reasoning, and context management
Experience with multi-agent orchestration and Agent-to-Agent (A2A) communication patterns
Experience with prompt engineering, model behavior differences, and LLM evaluation methods
Experience with startup environments or regulated domains such as healthcare or life sciences
Experience with Microsoft Azure services, such as Azure Functions, API Management, Container Apps, or Azure OpenAI
Knowledge of token economics, cost optimization, and context budget management
Knowledge of Model Context Protocol (MCP) for tool discovery and invocation
Knowledge of security best practices, including secrets management and least-privilege access
Possession of excellent oral and written communication skills
Master’s degree in Computer Science, Software Engineering, or related field
Vetting:
Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client.
At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.
Salary at Booz Allen is determined by various factors, including but not limited to location, the individual’s particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $69,400.00 to $158,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen’s total compensation package for employees. This posting will close within 90 days from the Posting Date.As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.
AI is a part of our daily work at Booz Allen, and we are committed to the responsible and ethical use of AI tools. However, we want to ensure a fair candidate process based on your own skills and knowledge. As part of this commitment, the use of artificial intelligence (AI) or other tools to assist with responses during interviews (whether in-person or virtual) is prohibited unless permission is explicitly provided.
Work Model
Our people-first culture prioritizes the benefits of collaboration, whether it occurs in person or virtually. To support engagement and effective communication, employees working virtually are generally expected to have their cameras on during meetings.
Remote: If this position is listed as remote, there may still be occasions when you are required to work in person at a Booz Allen or customer facility.
Hybrid: If this position is listed as hybrid, you will be expected to work from a Booz Allen facility frequently, in alignment with leadership expectations and the needs of the role. You may also be required to work from or visit a customer facility.
Onsite: If this position is listed as onsite, work will primarily be performed at a Booz Allen office or customer facility, where employees will collaborate directly with colleagues and customers as required by the role.
All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.
Originally posted on Himalayas