Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Use of Kirkpatrick evaluation model in simulation-based trainings for the mining industry - A case study for froth flotation
Luleå University of Technology, Department of Civil, Environmental and Natural Resources Engineering, Minerals and Metallurgical Engineering.
Metso Outotec Oy, Rauhalanpuisto 9, 02230 Espoo, Finland.
Aalto University, 02150 Espoo, Finland.
Luleå University of Technology, Department of Civil, Environmental and Natural Resources Engineering, Minerals and Metallurgical Engineering.ORCID iD: 0000-0003-4861-1903
Show others and affiliations
2022 (English)In: Minerals Engineering, ISSN 0892-6875, E-ISSN 1872-9444, Vol. 188, article id 107825Article in journal (Refereed) Published
Abstract [en]

Trainings play a vital role in the transference of knowledge between skilled and novice operators in the mineral industry. Evaluation is an important part of those trainings, but many trainings rely solely on the trainees’ feedback. This paper presents how technology enhancement can help produce more effective training evaluations to the mineral industry. It describes a case study involving a froth flotation simulator-based training, including details of the simulation, user interface, and the training program. The training was delivered to sixteen mining operators and evaluated by both the traditional method (trainee's feedback) and with the simulation's learning evaluation. The feedback evaluation showed a high level of satisfaction with the learning results, while the learning evaluation showed a very different training outcome, putting established evaluation methods such as Kirckpatrick's “Four levels” into question. Correlations between the learning results and the operators’ personal information such as process work, and academic experience are also presented.

Place, publisher, year, edition, pages
Elsevier Ltd , 2022. Vol. 188, article id 107825
Keywords [en]
Minerals processing, Modelling, Simulation technology, Simulator-based training, Training evaluation
National Category
Mineral and Mine Engineering
Research subject
Mineral Processing
Identifiers
URN: urn:nbn:se:ltu:diva-93769DOI: 10.1016/j.mineng.2022.107825ISI: 000880183700003Scopus ID: 2-s2.0-85138453889OAI: oai:DiVA.org:ltu-93769DiVA, id: diva2:1707460
Funder
EU, Horizon 2020, 72267
Note

Validerad;2022;Nivå 2;2022-10-31 (joosat);

Available from: 2022-10-31 Created: 2022-10-31 Last updated: 2023-12-19Bibliographically approved
In thesis
1. On the use of immersive technologies in the professional education of mineral processing
Open this publication in new window or tab >>On the use of immersive technologies in the professional education of mineral processing
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

With the advance of technology, many educators started implementing immersive technologies like simulators and gamified learning applications to improve the trainings of process operators. However, it is noted that the minerals sector is significantly behind other industries, for instance, the chemical industry, especially when it comes to the evaluation of these types of trainings. Understanding how new technologies and concepts can improve the creation and evaluation of operator trainings, would perhaps create solutions for the lack of skilled operators in the mining sector, which is partly related to the challenge of evaluating time-dependent skills. In this scenario, this research aims to access the use of immersive technologies to increase the creation of operator talent in the minerals industry. In this context, an EU-funded network called “metalintelligence” exists. Its aim is to provide innovative research and equip a new generation of leaders in the minerals processing field providing lasting novel technological and training methods to build capacity in this growing area thus further establishing the EU’s leadership position in minerals processing. Hypothetically, the research in this field, backed by strong case studies, could provide valuable hints on how the trainings of operators could be made more efficient by using new technologies and concepts such as modelling and simulation and gamification. The study conducted within this thesis project can be divided into four parts, starting with a systematic review of how immersive technologies such as virtual reality (VR), educational games and simulation-based trainings have been used to teach different topics related to mining and mineral processing operations during the last 20 years. The current applications are mostly focused on hazard awareness and specific maneuvers of mining equipment, while only a few are related to the operation and management of the control rooms in mineral processing plants. During the review, it was noted that most papers found in the literature focus on the technical description of their solutions but fail to present an evaluation of the application by experts in the field. The review also found that further benefits can be achieved by employing tools like cloud solutions and gamification as these technologies can help with the collection of user data and improve the validation of technology-enhanced trainings. In the second part of this thesis, a case study is presented on how the current trainings of mineral process operators can benefit from immersive technologies. It involves the development and evaluation of a simulator-based training for froth flotation. The training was delivered to a group of operators at a greenfield process site and the analysis of the trainees’ evaluations were collected and discussed based on the first two levels of the Kirkpatrick evaluation model, a broadly used evaluation model. The reaction evaluation showed a strong satisfaction and a high learning perception from the trainees, while the learning evaluation, gathered with the help of the simulator, showed several weak spots in the training, especially when it came to teaching performance calculations. The disparity between the reaction and learning evaluations raises serious questions about evaluating trainings solely on the trainees’ feedback and goes against some principles of established evaluation methods such as Kirkpatrick’s. The third part of this study comprises the development of a training solution called “Minfloat”. It is an educational game developed in Unity3D focused on teaching the basic process behavior of froth flotation to operators and university students. It also describes the attempts to create a light-weight simulator core that could be run on a mobile device. After first testing a short-cut model, a model based on first principles was programmed and linked to the user interface. The game also includes an intelligent tutoring system (ITS) which presents concepts, examples, and questions pertinent to flotation performance calculations to the user. The principles of user experience (UX) design were used to produce assets (e.g., boxes, buttons, containers, and graphs) that could be re-used by other training developers, therefore promoting modularity, in a way that developers could use those to create their own educational games. The current game could be extended to basically every aspect of flotation, as also other mineral processes. In addition, the modules (such as assets, ITS, and graphs) could be re-used by other Unity3D developers to create trainings for topics in practically every process industry. The fourth and last part of the study involved the development of a questionnaire aiming to evaluate “Minfloat” in terms of overall quality, didactic efficacy, and inspiring character, besides having a better understanding of the target audience and outlook of the solution. To develop this questionnaire, the history of evaluation frameworks such as Kirkpatrick’s ‘Four levels’, Phillips’s ‘return on investment (ROI) based evaluation’ and Scriven’s ‘Goal-free evaluation’ are introduced to help clarifying the steps involved in assessing and evaluating a gamified educational solution like “Minfloat”.The questionnaire was applied to 25 experts in the minerals industry to access key aspects of the game-based training described earlier. From the results, three key lessons can be taken. The first is that users were, in general, satisfied with the game in terms of quality, efficacy and inspiring character. Second, users thought that the main target of the game should be university students, although novice industrial operators could also benefit from it. Third, the use of this short questionnaire, combined with the use of online forms, is a powerful tool for researchers who need a fast and efficient way to evaluate important aspects of a game and get feedback in written form.By analyzing the four parts of this research, some clear concluding benefits of the use of immersive technologies in operator training can be outlined. The first is that new engines such as Unity3D united with modelling and simulation, were proven to be powerful tools to create efficient, inspiring and non-expensive educational solutions for the process industry. Being a free software for personal or small companies, there is a big chance that, in the near future, engineering students will start using it to create their own educational trainings, and compete with larger companies which currently dominate that training market. Another contribution from this research is an evaluation form that provides training developers a way to get feedback for their application, improve their games or simulation-based trainings and produce more comprehensive articles about education in the minerals industry.The next step for this research would be to develop similar kinds of applications for other mineral beneficiation units and methods, such as comminution and hydrometallurgy. The game presented could even be expanded to teach the operation of an entire mineral processing plant. This way, university students and novice operators could learn and understand, in an inspiring way, important aspects of this type of operations, including material characterization, reagent usage, operational parameter setting, equipment design as well as financial and holistic operations of mineral processes. This development could revolutionize the teaching of mineral processes, the same way simulators leveled up the training of flight operators. However, this revolution will only occur if those immersive technologies are guided by the light of a proper and inexpensive evaluation, which will make sure that the technologies developed by academia are resonating in the same wavelength as the solutions of the industrial sector. Another aspect that immersive technologies could help with, is the declining rates of students entering university courses like mineral industry and geoscience. Digitalization solutions like the one described could help to inspire more students to choose a career in those fields, helping with the development of societies and their increasing needs for minerals. 

Place, publisher, year, edition, pages
Luleå: Luleå University of Technology, 2023. p. 104
Series
Doctoral thesis / Luleå University of Technology 1 jan 1997 → …, ISSN 1402-1544
Keywords
Mineral Processing, Training Evaluation, Modelling and Simulation, Gamification, User Experience
National Category
Metallurgy and Metallic Materials
Research subject
Mineral Processing
Identifiers
urn:nbn:se:ltu:diva-94200 (URN)978-91-8048-221-9 (ISBN)978-91-8048-222-6 (ISBN)
Public defence
2023-01-23, E632, Luleå tekniska universitet, Luleå, 09:30 (English)
Opponent
Supervisors
Funder
EU, Horizon 2020, 72267
Available from: 2022-11-22 Created: 2022-11-22 Last updated: 2024-08-27Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Bergamo, Pedro A. de S.Rosenkranz, JanGhorbani, Yousef

Search in DiVA

By author/editor
Bergamo, Pedro A. de S.Rosenkranz, JanGhorbani, Yousef
By organisation
Minerals and Metallurgical Engineering
In the same journal
Minerals Engineering
Mineral and Mine Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 127 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf