Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Unsupervised deep learning and analysis of harmonic variation patterns using big data from multiple locations
Department of Electrical Eng, Chalmers University of Technology, 412 96 Göteborg, Sweden.
Luleå University of Technology, Department of Engineering Sciences and Mathematics, Energy Science.ORCID iD: 0000-0001-5845-5620
Department of Electrical Eng, Chalmers University of Technology, 412 96 Göteborg, Sweden.
Luleå University of Technology, Department of Engineering Sciences and Mathematics, Energy Science.ORCID iD: 0000-0003-4074-9529
2021 (English)In: Electric power systems research, ISSN 0378-7796, E-ISSN 1873-2046, Vol. 194, article id 107042Article in journal (Refereed) Published
Abstract [en]

This paper addresses the issue of automatically seeking and identifying daily, weekly and seasonal patterns in harmonic voltage from measurement data at multiple locations. We propose a novel framework that employs deep autoencoder (DAE) followed by k-mean clustering. The DAE is used for extracting principal features from time series of harmonic voltages. A new strategy is used for training the encoder in DAE from data at one selected location that is effective for subsequent feature extraction from data at multiple locations. To analyze the patterns, several empirical analysis approaches are applied on the clustered principal features, including the distribution of daily patterns over the week and the year, representative waveform sequences of individual classes, and feature maps for visualizing high-dimensional feature space through low-dimensional embedding. The proposed scheme has been tested on a dataset containing harmonic measurements at 10 low-voltage locations in Sweden for the whole year of 2017. Results show distinct principal patterns for most harmonics that can be related to the use of equipment causing harmonic distortion. This information can assist network operators in finding the origin of harmonic distortion and deciding about mitigation actions. The proposed scheme is the first to provide a useful analysis tool and insight for finding and analyzing underlying patterns from harmonic variation data at multiple locations.

Place, publisher, year, edition, pages
Elsevier, 2021. Vol. 194, article id 107042
Keywords [en]
Electric Power distribution, Power quality, Power system harmonics, Variation data, Big data analytics, Pattern analysis, Unsupervised deep learning, Autoencoder, Clustering
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Electric Power Engineering
Identifiers
URN: urn:nbn:se:ltu:diva-82711DOI: 10.1016/j.epsr.2021.107042ISI: 000632386100011Scopus ID: 2-s2.0-85100014673OAI: oai:DiVA.org:ltu-82711DiVA, id: diva2:1523892
Funder
Swedish Energy Agency
Note

Validerad;2021;Nivå 2;2021-01-29 (alebob)

Available from: 2021-01-29 Created: 2021-01-29 Last updated: 2023-08-24Bibliographically approved
In thesis
1. Applications of Unsupervised Deep Learning for Analysing Time-Varying Power Quality Big Data
Open this publication in new window or tab >>Applications of Unsupervised Deep Learning for Analysing Time-Varying Power Quality Big Data
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Continuous power quality monitoring allows grid stakeholders to obtain information about the performance of the network and costumer facilities. Moreover, the analysis of continuous monitoring allows researchers to obtain knowledge on power quality phenomena. Power quality measurements result in a large amount of data. Power quality data can be classified as big data, not only for its volume, but also for the other complexities: velocity, variety, and veracity. Manual analysis of power quality data is possible but time-consuming. Moreover, data reports based on standardized indexes and classical statistical techniques might hide important information of the time-varying behaviour in power quality measurements. Artificial intelligence plays a role in providing automatic tools for proper analytics of big data.  A subset of artificial intelligence called machine learning has enabled computers to learn without explicit programming. Driven by the huge improvements in computer processing, a subset of machine learning based on multiple layers of artificial neural networks has been developed to tackle increasingly complex problems. The so-called deep learning applications teach themselves to perform a specific task by automatically extracting essential features from the raw data. Despite the possibilities of automatic feature extraction, most applications of deep learning to power quality are still the same as expert systems or earliest machine learning tools. Moreover, most of the applications are based on synthetic generated data and supervised techniques. In this context, the main motivation of this thesis is providing a new tool based on unsupervised deep learning to handle analytics of time-varying power quality big data. 

The unsupervised deep learning method proposed in this thesis combines a deep autoencoder with clustering for extracting patterns and anomalies in power quality big data. The deep autoencoder maps the original data to a compressed format that contains the principal features of the data. Automatic results are provided by the deep learning, and inferences can be obtained without requiring prior knowledge of deep learning. The outputs from unsupervised deep learning can serve as a guide for further data analysis, highlighting important time steps within large power quality datasets. By following these indications from the deep learning results, experts gain valuable insights into power quality phenomena, which can be referred to as "learning from deep learning". The interpretation of the deep learning results in this thesis allowed to making proper inferences for patterns and anomalies. For power quality measurements synchronised with 24-h, the results allowed making inferences concerning daily variations, seasonality, and the origins of power quality disturbances. For power quality measurements non-synchronised with 24-h, the results could be interpreted visually through the distribution of the patterns in a physical variable, such as the dynamic operating conditions of an electrical railway power system.

An important contribution of this thesis concerns the physical interpretation of the phenomena is related to the anomalies in harmonics caused by geomagnetically induced currents. An interesting finding by applying the deep anomaly detection to measurements in the Swedish transmission grid is the damping of the anomalies caused by geomagnetically induced currents in the winter due to the heating load. This thesis also demonstrated that the signatures for anomalies in harmonic measurements in a Swedish transmission location are similar to the ones found in a low-latitude transmission location at the South Atlantic Anomaly due to geomagnetically induced currents. Moreover, by cross-checking the anomalies at the South Atlantic Anomaly with protection trips with undetermined causes, this thesis demonstrated that anomaly harmonics due to geomagnetically induced currents can cause protection mal trips.

This thesis demonstrates that unsupervised deep learning can serve as an additional tool for compressing time-varying power quality big data into a more interpretable form. Despite the application of an unsupervised method, power quality experts remain significant in power quality studies. The main conclusion of this thesis is that unsupervised deep learning enhances the understanding of power quality experts and provides a complementary approach for analysing and extracting insights from time-varying power quality big data.

Place, publisher, year, edition, pages
Luleå: Luleå University of Technology, 2023
Series
Doctoral thesis / Luleå University of Technology 1 jan 1997 → …, ISSN 1402-1544
Keywords
power quality, power system harmonics, electric power distribution, interharmonics, big data analytics, pattern analysis, unsupervised learning, deep learning, artificial intelligence, geomagnetically induced currents
National Category
Other Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Electric Power Engineering
Identifiers
urn:nbn:se:ltu:diva-100718 (URN)978-91-8048-353-7 (ISBN)978-91-8048-354-4 (ISBN)
Public defence
2023-10-04, Hörsal A, Luleå tekniska universitet, Skellefteå, 09:00 (English)
Opponent
Supervisors
Available from: 2023-08-25 Created: 2023-08-24 Last updated: 2023-09-13Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Oliveira, Roger A.D.Bollen, Math H.J.

Search in DiVA

By author/editor
Oliveira, Roger A.D.Bollen, Math H.J.
By organisation
Energy Science
In the same journal
Electric power systems research
Other Electrical Engineering, Electronic Engineering, Information Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 296 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf