AI Quality Architect

AI Quality Architect

Join Resaro as an AI Quality Architect. Resaro was founded on the belief that AI systems can only add value when deployed responsibly, backed by a clear understanding of the required characteristics and meaningful evidence that those requirements are met. We build scalable frameworks to capture this understanding and powerful test tools to generate evidence.

About Resaro

Resaro is a global AI assurance company, pioneering the field of AI testing and evaluation. Our mission is to ensure an AI market worthy of trust. We are a team of AI experts, engineers, and data scientists.

You Will

• Lead client projects to develop solution-level AI quality indicators with business/operational, governance and technical stakeholders across a diverse range of mission-critical use cases in areas such as law enforcement, defence, health, finance, aviation and public infrastructure.
• Develop product-based approaches and scalable advisory services to enable clients to set justifiable minimum quality levels and grow the adoption of AI quality indicators within an organisation.
• Develop the AI quality indicator library that will serve as a foundation for organisations seeking to scale AI adoption and assurance.
• Work with Resaro’s technical teams to develop automated and scalable ways of testing against quality indicators within Resaro’s Approved Intelligence Platform and integrate their insights into strategic roadmaps.
• Drive the mapping of quality indicators to global as well as customer-specific governance frameworks, e.g. EU AI Act with standards, NIST RMF, AI Verify, AITA, IEEE 7000/8000 etc., and derive minimum levels supporting compliance.
• Grow the market adoption of Resaro’s quality framework (“AI Solutions Quality Index” (ASQI)), including exploring certification, scalability and product sales pathways.
• Contribute to activities that grow the acceptance of ASQI framework amongst the open source and governance communities (resaro.ai/asqi).
• Serve as the internal expert on the latest advances in AI governance and quality frameworks in the commercial as well as the non-profit sector, and condense such knowledge for Resaro’s teams.
• Mentor colleagues, guiding them in building their capabilities in supporting the above tasks.
• Lead and write project proposals for both private and public sector calls and tenders related to AI governance and quality assessment.

You Are Able To

• Think from first principles and tackle the most challenging technical and business problems from a multi-disciplinary perspective.
• Lead by example, work with passionate and talented individuals, and forge a diversity of insights and views into a strong shared approach.
• Communicate in an effective, open, frank and respectful manner across teams in multiple locations.
• Thrive in a fast-paced environment.
• Navigate uncertainty by being willing to explore, while remaining laser focused on the mission at hand.

You Have

• A deep familiarity with well-known AI trustworthiness concepts, regulations, standards and other frameworks from multiple jurisdictions, and an appreciation of their commonalities and differences.
• A deep understanding of, and recent active participation in, standardisation committees or similar structures.
• An ability to craft precise and concise language that builds bridges between operational, governance and technical teams.
• An ability to craft convincing proposals with a stringent and irresistible narrative that responds to a call/tender while making full use of available capabilities and USPs.
• A broad understanding of different types of AI architectures and their strengths and limitations, with a focus on the discriminative and generative approaches of the past decade.
• An understanding of relational database design, including the ability to create, and work with, entity relationship diagrams or similar. Advanced SQL syntax knowledge is not needed.

Nice To Have

• Experience with a range of certification pathways based on various kinds of industry standards.
• Experience with non-AI quality management standards and practices in a variety of industries.
• Experience in building multi-national partnerships and coalitions, e.g. in response to major funding calls.
• Experience in hands-on development of AI systems.
• Exposure to testing of AI systems, in particular using synthetic and/or augmented test data sets.
• Publications in the area of AI trustworthiness, quality or testing.

Equal Opportunity Employer

Resaro is an Equal Opportunity Employer. We respect each individual and support the diverse cultures, perspectives, skills and experiences within our teams.

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Information Technology

Industries

Software Development and IT System Testing and Evaluation

#J-18808-Ljbffr