Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Reinforcement Learning Based Proactive Suspension Control for Enhanced Terrain Vehicle Performance
Luleå University of Technology, Department of Computer Science, Electrical and Space Engineering.
2024 (English)Independent thesis Advanced level (professional degree), 20 credits / 30 HE creditsStudent thesisAlternative title
Inlärningsbaserad Proaktiv Dämpningskontroll för Ökad Terrängfordons Framkomlighet (Swedish)
Abstract [en]

The ensuing project description was the inception to the academic adventure tasked with producing a controller that could regulate the suspension system on the CV90 MkIV platform with the use of a front looking, predictive, ground scanning sensor in addition to existing sensors. In other words, it was to create a pro-active suspension system for the BEA Systems Hägglunds’s made Combat Vehicle 90. The following report details the project of investigating, analysing and recreating the CV90 MkIV vehicle in theory and simulation. Thereafter it covers the implementation of two reinforcement learning algorithms, their corresponding training and subsequent results. Additionally the report discusses the possibility of a sensor technology with ground profiling properties as well as possible extension that the technology contains. The analysis of the vehicle used the newtonian approach whilst the recreation in simulation used the Python language as foundation. The simulation was then built by using the Python compatible MuJoCo physics engine. The MuJuCo model was constructed piecewise in a dedicated XML format, making it possible to quickly iterate over versions of the vehicle and environment. The reinforcement learning algorithms implemented were Policy Gradient and Proximal Policy Optimisation. The agents were then allowed complete control over the vehicle’s active suspension units whilst they learned by exploring their surroundings. The subsequent performance was then compared against a sky-hook control strategy implementation to determine their relative effectiveness. The proposed sensor technology was the ground penetrating radar system which has showed promise in a variety of fields and has the extended possibility of being used as an anti-tank mine detector. The project result showed that the feasibility of a reinforcement learning based controller is indeed possible, as it did achieve a marginal improvement in performance as compared to the baseline. However, further work is needed to reach a mature state since the final performance contained plenty of inefficiencies. Lastly there is an in depth discussion which provided a wide foundation on which future research could be built upon.

Place, publisher, year, edition, pages
2024. , p. 110
Keywords [en]
Reinforcement Learning, Proactive, Suspension, Terrain Vehicle, Controll, Sensor, GPR, AI, Simulation
Keywords [sv]
AI, Proaktiv, Dämpsystem, Terrängfordon, Sensorer, Kontroll, GPR, Simulation
National Category
Control Engineering
Identifiers
URN: urn:nbn:se:ltu:diva-110607OAI: oai:DiVA.org:ltu-110607DiVA, id: diva2:1909519
Educational program
Engineering Physics and Electrical Engineering, master's level
Supervisors
Examiners
Available from: 2024-10-31 Created: 2024-10-30 Last updated: 2025-10-21Bibliographically approved

Open Access in DiVA

No full text in DiVA

Search in DiVA

By author/editor
Sellin, Alexander
By organisation
Department of Computer Science, Electrical and Space Engineering
Control Engineering

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 139 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf