Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Design Principles for Data-Driven Decision Evaluation
M3S, Faculty of Information Technology and Electrical Engineering, University of Oulu, Finland.
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Digital Services and Systems. M3S, Faculty of Information Technology and Electrical Engineering, University of Oulu, Finland.ORCID iD: 0000-0002-7477-0783
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering, Digital Services and Systems.ORCID iD: 0000-0003-4250-4752
Antell, Oulu Finland.
Show others and affiliations
2024 (English)In: CENTERIS 2023 - International Conference on ENTERprise Information Systems / ProjMAN 2023 - International Conference on Project MANagement / HCist 2023 - International Conference on Health and Social Care Information Systems and Technologies / [ed] Ricardo Filipe Gonçalves Martinho; Maria Manuela Cruz da Cunha, Elsevier B.V. , 2024, p. 563-574Conference paper, Published paper (Refereed)
Abstract [en]

Human-machine collaboration has potentially led to higher quality and more informed data-driven decisions. However, evaluating these decisions is necessary to measure the benefits, as well as enable experiential learning and posterior rationalization of the results and consequences. Nevertheless, the multiplicity of human-machine collaboration modes, as well as the multi-faceted nature of data-driven decisions complicates evaluation, and evaluation solutions are lacking both in research and in practice. This is further reflected in the complexity of incorporating evaluation in the design of such data-driven decision making systems, since developers are left without theoretically grounded and practically feasible principles to guide implementation. In this paper, we propose a set of five design principles, explicated from theory and practice, for systems implementing data-driven decision evaluation as the output of design science research cycles. The design principles are: 1) multi-faceted evaluation criteria, 2) unified viewpoint, 3) collaborative rationality, 4) processual ex-post evaluation, and 5) adaptive feedback and learning loops. They are further contextualized in the case of AI-enabled menu design at Antell, an innovative pioneer in the restaurant business in Finland, and consequently evaluated by the development managers of the project. Accordingly, the design principles contribute to the knowledge base on metahuman systems and data-driven decision evaluation, by concretizing existing normative concepts into prescriptive knowledge, also guiding future research and generalizing towards a design theory. Furthermore, they provide implementable statements for designing and developing such systems in practice and can be used as a checklist to compare and evaluate existing systems.

Place, publisher, year, edition, pages
Elsevier B.V. , 2024. p. 563-574
Series
Procedia Computer Science, ISSN 1877-0509 ; 239
Keywords [en]
data-driven decision making, human-machine collaboration, ex-post evaluation, collaborative rationality, design principles
National Category
Information Systems Production Engineering, Human Work Science and Ergonomics
Research subject
Information Systems
Identifiers
URN: urn:nbn:se:ltu:diva-109813DOI: 10.1016/j.procs.2024.06.208Scopus ID: 2-s2.0-85201255303OAI: oai:DiVA.org:ltu-109813DiVA, id: diva2:1896778
Conference
International Conference on ENTERprise Information Systems (CENTERIS 2023), International Conference on Project MANagement (ProjMAN 2023) and International Conference on Health and Social Care Information Systems and Technologies (HCist 2023), November 8-10, 2023, Porto, Portugal
Note

Full text: CC BY-NC-ND license;

Available from: 2024-09-11 Created: 2024-09-11 Last updated: 2024-09-11Bibliographically approved

Open Access in DiVA

fulltext(636 kB)86 downloads
File information
File name FULLTEXT01.pdfFile size 636 kBChecksum SHA-512
d6ba89080c8da9ceb463abdd92e7afbef3ee8395b33d31fb86005cc4ed4bb0ab1ae48f936ad54c503e999c337567616ba47663f00807233dea754ed8350f9328
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Päivärinta, TeroElragal, Ahmed

Search in DiVA

By author/editor
Päivärinta, TeroElragal, Ahmed
By organisation
Digital Services and Systems
Information SystemsProduction Engineering, Human Work Science and Ergonomics

Search outside of DiVA

GoogleGoogle Scholar
Total: 86 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 171 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf