AI Model Observability

Project description

The IBM Research Laboratory is located just 40 minutes away from ETH Zurich. This creates a fantastic opportunity for highly motivated ETH Students to join our unique research-corporate environment for a Master Thesis, Semester Project or Internship.

Bringing a new AI system into a product environment involves different stakeholders, from business owners to risk officers and ethics officers. This implies gathering evidence from a multitude set of sources to justify that an AI model is fit for the defined intent and purpose. The AI model observability team is developing an end-to-end solution that advises stakeholders in estimating the risks of an AI model, by using genAI to extract the relevant information from these sources. Such a solution recommends to users the most appropriate model from their current inventory. In the context of this effort, we are looking for students that are interested in working on some of the following topics:

• Automatically map risks, summarize risk descriptions and linkage between risk and remediation between IBM Risk Atlas, and standards such as NIST, OWASP and others;
• Measure confidence and relevance of facts extracted from text to automatically populate a Knowledge Graph that represents a rich set of information about AI models;
• Build a RAG system that uses a Knowledge Graph to help determine the relevancy of information recovered from a data store to answer a query.

As part of our team, you will collaborate with experienced Research Scientists and AI Software Engineers that will lead and help you to successfully complete the challenges of the proposed task. The technology created in our team is powering IBM mainstream products.

Minimum qualifications

• Bachelor’s degree in computer science or machine learning, including equivalent practical experience
• Experience in software development with Python
• Experience with NLP
• Team player, self-motivated with a passion for technology and innovation

Preferred qualifications

• Experience with REST APIs, machine learning, deep learning, algorithms and data structures
• 3+ years of proved programming experience in Python (or equivalent C/C++ experience)
• Experience with LLMs and Transformer models
• Knowledge of graph databases
• Knowledge of RAG-type systems and AI frameworks, such as LangChain
• Independent worker with the ability to effectively operate with flexibility in a fast-paced, constantly evolving team environment

Diversity

IBM is committed to

diversity

at the workplace. With us you will find an open, multicultural environment. Excellent flexible working arrangements enable all genders to strike the desired balance between their professional development and their personal lives.

Please submit your application through the link below. This position is available starting immediately or at a later date.