""

“Iceland now has an ambitious mental health policy that emphasises early intervention and the responsibility of systems toward children and their families. At the same time, however, there is a need for more reliable assessment tools to identify children who are experiencing difficulties,” says Örnólfur Thorlacius, assistant professor at the Faculty of Psychology. Örnólfur leads a research project on the development of computerised adaptive testing (CAT) for assessing emotion regulation and social skills in children and adolescents. The tests are based on an assessment scale developed by Örnólfur during his doctoral studies at UI, which has received positive international evaluation.

Early intervention is essential for effective support

Although Iceland has set ambitious goals to improve young people’s mental health and strengthen early intervention, there remains a shortage of evidence-based assessment tools that can evaluate children’s and adolescents’ functioning both accurately and efficiently. This is something Örnólfur aims to address.

The project is grounded in the principle of early intervention, i.e. that services, support, or resources are provided before difficulties escalate and develop into more complex psychological problems. Örnólfur points out that early intervention is a central pillar of the government’s mental health policy through 2030 and is considered essential for ensuring equal opportunities and comprehensive support for children. The emphasis is on identifying difficulties early, before problems persist into adulthood. In this context, Örnólfur stresses that screening instruments play a key role and must be selected carefully.

He notes that many existing assessment tools are primarily designed to identify children with the most severe difficulties. Children who are beginning to develop problems often fall outside diagnostic thresholds and may not receive support until their difficulties become substantial. Örnólfur therefore asks: “Do we want assessment tools that only reach those who clearly require help, or do we also want to identify children who may be moving toward difficulties?” According to Örnólfur, it is important not to focus solely on the most distressed 5–10% of children. “We want to assess all children across developmental dimensions such as emotion regulation and social competence. This allows us to better understand where children are functioning well and where they may be approaching risk, before difficulties reach the lowest percentiles.”

Computerised adaptive testing (CAT) saves time and improves precision

Örnólfur’s research also focuses on the development of CAT tests. This method, commonly used in educational and standardised testing, adapts in real time to respondents’ answers. The test selects subsequent questions based on previous responses and omits items that are not relevant in the case of the individual being assessed. As a result, the assessment becomes both more efficient and more targeted than traditional fixed-length questionnaires. “Our aim with CAT tests is to shorten assessments while maintaining, or even improving, their accuracy,” Örnólfur explains. In Iceland, there is a clear need for teacher-based screening measures to assess students’ social and emotional functioning. According to Örnólfur, such instruments must have strong measurement properties and measure factors related to children‘s behaviour, emotional functioning, and educational development. “For example, if a child shows strong social skills, the teacher does not need to answer numerous questions about clinical difficulties in this area. This makes the task more manageable for teachers while still producing an equally accurate assessment,” he says. Using conventional screening tools, teachers are often required to answer up to 60 questions per student, sometimes twice per year. This can be time-consuming and may reduce accuracy, particularly when many items are not relevant for the individual child. A CAT test presents only questions that are informative for each child.

""
Örnólfur Thorlacius, assistant professor at the Faculty of Psychology, is leading a research project on the development of computerised adaptive testing to assess children and teenagers' emotional regulation and social skills.

Internationally recognised assessment tool as a foundation

The current research project is based on the assessment scale Örnólfur developed for his doctoral research, the Children’s Emotional Adjustment Scale (CEAS). The scale provides sensitive assessment of children’s emotion regulation, rather than focusing exclusively on symptoms or deviations. The measure has received international attention. In meta-analytic work, it has been classified among the strongest available emotion regulation instruments with respect to psychometric quality, including in an American study published in 2021 in the Journal of Clinical Child and Adolescent Psychology. In that study, researchers at the University of Pittsburgh School of Medicine evaluated 87 assessment tools used to measure emotional regulation in children and adolescents. Only seven received the highest rating, among them the CEAS. “This provides a strong foundation on which to build,” Örnólfur says.

Artificial intelligence requires an evidence-based psychometric foundation

A CAT test collecting information from both parents and teachers is now under development. Thousands of responses are required to accurately position children on the underlying scales and to ensure that the system functions as intended. “This process is necessary because adaptive tests are not based solely on a list of items, but on probabilistic measurement models that estimate how effectively individual items distinguish between children with differing levels of skills. Although CAT systems technically fall under machine learning, Örnólfur emphasises that artificial intelligence alone is not sufficient without scientific expertise in psychometric measurement. “For example, it is not possible to feed a computer model with millions of medical records and expect to obtain reliable information about people's mental health,” he explains.

Research with practical value for society

Örnólfur is conducting the project in close collaboration with international experts, including researchers affiliated with the International Association for Computerized Adaptive Testing (IACAT). He hopes to pilot the CAT system in applied settings in the near future, although the project remains in an early phase. According to Örnólfur, the development process is time-consuming, and extensive simulation studies must be completed before the test can be used in real-world conditions. Part of this work involves identifying which items are most informative for teacher-based assessment, a process expected to require considerable time. Örnólfur says there is an urgent need for such assessment tools, and that it is important to strengthen the assessment environment in Iceland and ensure that reliable, well-designed instruments are available. “Our aim is for this research to have real value for society. That is the core of this project,” he says. 
 

Author: Sigrún Björk Hjartardóttir, journalism student.

Share

Tags
Did this help?

Why wasn't this information helpful

Limit to 250 characters.