Resaro builds advanced AI testing software to help organizations verify, validate, and trust their most critical AI systems — from computer vision to generative AI and autonomous systems. Our mission is to ensure that AI technologies deployed in real-world, high-stakes environments are robust, explainable, and secure.

We work closely with our customers through embedded delivery teams who operate on-site or in close collaboration. These teams tailor solutions to specific mission needs, helping organizations — especially in the public safety and national security sectors — evaluate and improve the performance of their AI-enabled systems.

About the Role

As a Solution Architect at Resaro, you will be embedded in customer projects, acting as the primary interface between the customer’s mission teams and our internal technical teams. You will shape the design and delivery of custom AI testing solutions for a variety of application types, from chatbots and RAG agents to perception systems, object detection models and autonomous systems.

You will define solutions, guide engineering efforts, and ensure smooth delivery in complex, high-security settings.

Key Responsibilities

Customer Engagement & Discovery
- Lead early discovery sessions and solution workshops with defence and law enforcement agencies focused on national security and public safety.
- Map out client workflows and environment relating to data, processes, tools and orchestration.
- Identify customer pain points and translate them into actionable solution concepts.
Solution Design
- Define the AI testing, evaluation, verification and valuation (TEVV) roadmaps tailored to GenAI or Computer Vision use cases.
- Adapt TEVV strategies for different modalities, such as image classification, segmentation, text generation, and autonomous perception.
- Prioritize features and tasks for the technical team based on mission value and delivery constraints.
- Contribute to the build, run and scale our Approved Intelligence Platform and AI Solution Quality Index (ASQI) incl. Our OSS project ASQI engineer for AI applications, e.g.:
  - GenAI systems: hallucination detection, prompt variability, multi-turn coherence.
  - CV systems: robustness to perturbations, real-world performance drift, fairness and edge case handling.
Collaboration & Delivery
- Work closely with Software Engineers, ML Scientists, and UI/UX designers to ensure solution quality.
- Build reusable project plans and proposals to accelerate engagement across clients with similar needs.
- Manage cross-functional teams and oversee project delivery, timelines, and deliverables.
- Act as the primary stakeholder interface and communicate progress and risks effectively.
Domain-Specific Insight
- Understand customer AI development/deployment priorities, concerns, and pain points to pre-empt their solution needs.
- Understand technical deployment constraints in high-security and high-sensitivity settings, such as air-gapped networks, compliance, and cyber/information security requirements.
- Navigate procurement processes and support proposal development or tender responses.
Domain and AI Expertise
- Guide the hardening of AI systems, identifying risks (e.g., hallucinations, prompt sensitivity) and potential solutions for defence and law enforcement teams.
- Provide insights on what and how to test Gen AI systems for use cases relevant to defence and national security clients.
- Evaluate and recommend AI testing tools, platforms, and methods (e.g., PromptBench, LangSmith, OpenAI evals, CVAT, FiftyOne, DeepChecks), understanding their trade-offs.

Must-Have Skills and Experience

Partner with Product Management to translate product vision, customer problems, and market opportunities into end‑to‑end solution architectures and technical roadmaps that support a product‑led growth strategy.
About 5+ years of experience as a Solution/Software/Cloud Architect or senior engineer designing customer‑facing digital products or platforms, or a similar role.
Strong foundation in Software Engineering - you are not just a \"concept\" person; you can read code ( e.g. Python), understand API structures, and validate overall technical feasibility by yourself.
Familiarity with common AI use cases like chatbots, RAG applications, agents, perception, surveillance and autonomous systems.
Strong skills in requirements gathering, stakeholder communication, and solution scoping.
Apply your ontology modeling expertise for Resaro's ASQI framework to deal with structured representations of business entities and AI workflows.
Demonstrated success in leading cross‑functional teams to deliver technical solutions.
Understanding of AI/ML lifecycle and the state‑of‑the‑art approaches and limitations of testing and validating complex models.
Prior exposure or experience with directly engaging senior stakeholders from Director to C‑suite level.

Nice‑to‑Have

Technical background in ML, AI engineering, or data science.
Hands‑on experience with AI tooling (e.g.LangChain, LlamaIndex, YOLO, Detectron2, Hugging Face, FiftyOne, Nvidia).
Familiarity with AI evaluation frameworks (e.g., LangSmith, PromptBench, OpenEval, VBench, MEVA).
Prior experience navigating government procurement processes (RFIs, RFPs, SBIRs).
Prior experience in high‑security, low‑visibility agencies involved with defence, national security, or public safety.
Knowledge of deployment constraints in high‑security or classified environments.
Prior security clearance at Government CONFIDENTIAL and above.

Why Join Resaro

Work on mission‑critical AI systems in defence, aerospace, and public safety.
Help define the future of AI testing and assurance in real‑world environments.
Collaborate with a tight‑knit, expert team working at the intersection of AI, systems engineering, and policy.
Shape product direction while being close to the operational reality of AI deployments.

#J-18808-Ljbffr

Resaro AI