1314151617181916 of 91
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
ASTRA: A synthetic benchmark for trace-based evaluation of socially intelligent multi-agent tutoring and participation-balanced collaboration in introductory programming
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Computer Science. Department of Computer Science, University of Exeter, EX4 4PY, Exeter, United Kingdom; School of Computing, University of Eastern Finland, Joensuu, Finland; Research Group on Data, Artificial Intelligence and Innovations for Digital Transformation, Johannesburg Business School, University of Johannesburg, Johannesburg, South Africa.ORCID iD: 0000-0001-9895-6796
2026 (English)In: Computers and Education: Artificial Intelligence, E-ISSN 2666-920X, Vol. 11, article id 100633Article in journal (Refereed) Published
Abstract [en]

Generative AI is rapidly entering introductory programming, yet evidence about how learners coordinate with AI, especially in dyads, remains limited, and open datasets that support reproducible, trace-based evaluation are scarce. I present ASTRA (Adaptive Socially-intelligent Team Reasoning Agents), a multi-agent tutoring prototype and benchmark framework for studying collaborative programming with socially differentiated agents. ASTRA supports three configurations: alone_tutor (one learner with a Tutor agent), pair_tutor (two learners with a Tutor agent), and pair_multiagent (two learners with Tutor and Facilitator agents, where the Facilitator prompts coordination and balanced participation). As access to research participants is not yet available, I release an open synthetic benchmark dataset that mirrors ASTRA’s logging schema and a prespecified between-subjects design (𝑁 = 540 participants; 360 sessions; 1440 task episodes) across a bank of 20 short Python programming tasks. The dataset includes turn-level dialogue traces and task-level artefacts designed to support log-operational research questions about interaction dynamics, participation balance and reciprocal engagement in dyads, and performance and verification behaviours. Descriptive summaries and illustrative models indicate that the benchmark yields measurable condition-differentiated patterns consistent with the simulation assumptions. I emphasise that these findings are simulated evidence intended for benchmarking, measurement feasibility, and reproducible pipeline development, not causal estimates of learning effects, while providing a transparent analysis blueprint for future ethics-approved validation studies. 

Place, publisher, year, edition, pages
Elsevier B.V. , 2026. Vol. 11, article id 100633
Keywords [en]
Generative AI, Introductory programming, Multi-agent tutoring, Collaborative learning, Pair programming, Learning analytics, Trace data, Synthetic benchmark dataset
National Category
Computer Sciences Software Engineering
Research subject
Pervasive Mobile Computing
Identifiers
URN: urn:nbn:se:ltu:diva-118977DOI: 10.1016/j.caeai.2026.100633Scopus ID: 2-s2.0-105042601764OAI: oai:DiVA.org:ltu-118977DiVA, id: diva2:2084890
Note

Fulltext license: CC BY

Available from: 2026-07-07 Created: 2026-07-07 Last updated: 2026-07-07Bibliographically approved

Open Access in DiVA

fulltext(2842 kB)18 downloads
File information
File name FULLTEXT01.pdfFile size 2842 kBChecksum SHA-512
8ca913c0f4f1213378a2f97d6333baefe73c6903b121b0f3706b7c258d9c60f569b6bd79f71e490ac27c422d0c5a9f6558fbb415db270439907c7d856998dce0
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Oyelere, Solomon Sunday

Search in DiVA

By author/editor
Oyelere, Solomon Sunday
By organisation
Computer Science
In the same journal
Computers and Education: Artificial Intelligence
Computer SciencesSoftware Engineering

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 119 hits
1314151617181916 of 91
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf