Internship - GenAI and Agentic AI Monitoring & Evaluation

As Generative AI and agentic AI solutions are increasingly adopted across ING, we need a monitoring and evaluation framework that assess model behaviour beyond traditional business KPIs. Because these systems evolve and may act with varying levels of autonomy, it is essential to establish consistent methods to measure their performance over time and translate results into clear, interpretable risk indicators for 2nd line oversight.

Goal of the internship
As an intern in our team, you will design a set of quality metrics and evaluation approaches that can be systematically implemented by the 1st line and reliably used by the 2nd line for validation and continuous oversight. Your work will compare and combine two complementary evaluation paradigms:

• Human‑based assessment, and
• AI‑based assessment (LLM‑as‑a‑Judge).

The ING Model Risk Team
You will join ING’s Model Validation team - an international group with colleagues based in Amsterdam and Warsaw. We assess whether models and AI solutions developed across the bank are robust, secure, and compliant with ING’s internal standards. As a thesis or internship student, you will work on cutting‑edge topics such as Generative AI and Agentic AI. These technologies are currently explored across multiple business units, offering hands‑on exposure to real-world implementations and the associated emerging risks.

Key Research Questions

• How can Generative AI and Agentic AI use cases be logically categorized based on functionality, autonomy, and risk profile?
• Which model quality dimensions are essential to evaluate each category, regardless of business‑specific KPIs?
• How can these metrics be measured consistently across a heterogeneous landscape of use cases and autonomy levels?
• How should results be structured to enable effective 2nd line review without duplicating 1st line monitoring efforts?
• What are the strengths and limitations of human‑based evaluation versus LLM‑as‑a‑judge approaches?

Existing Materials
You will build on ING’s existing GenAI monitoring framework, which focuses on individual use cases and provides a solid foundation for extending toward multi‑dimensional, cross‑use‑case evaluation.

Rewards and benefits

This is a great opportunity to train with highly skilled people who are experts in their field. You’ll do a lot and learn a lot – not only about your specialist area and the bank, but also about yourself and whether this type of environment is right for you.

You’ll also benefit from:

• Internship allowance of 700 EUR based on 36 hours work week

• Your own work laptop

• Hybrid working to blend home working for focus and office working for collaboration and co-creation

• Personal growth and challenging work with endless possibilities

• An informal working environment with innovative colleagues

To apply, you must be enrolled at a Dutch university (or EU university for EU passport holders).

Applications
Ready to apply? Click the Apply button and upload your CV and motivation letter.

About our internships

Every year, more than 350 students join our internship program. While there are no guarantees about your future, many of our former interns move into a permanent role or onto our International Talent Programme (traineeship).

Whatever happens, an internship at ING is the ideal opportunity to meet a wide variety of people, to build up your own network, and to learn about many different aspects of banking – put simply, it’s a great start to your career.