Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
SmartMonit: Real-time Big Data Monitoring System
Newcastle University. Bartin University.
Newcastle University. Taibah University.
Newcastle University.
Newcastle University.
Vise andre og tillknytning
2019 (engelsk)Inngår i: 2019 IEEE 38th International Symposium on Reliable Distributed Systems: SRDS 2019, IEEE, 2019, s. 357-359Konferansepaper, Publicerat paper (Annet vitenskapelig)
Abstract [en]

Modern big data processing systems are becoming very complex in terms of large-scale, high-concurrency and multiple talents. Thus, many failures and performance reductions only happen at run-time and are very difficult to capture. Moreover, some issues may only be triggered when some components are executed. To analyze the root cause of these types of issues, we have to capture the dependencies of each component in real-time. In this paper, we propose SmartMonit, a real-time big data monitoring system, which collects infrastructure information such as the process status of each task. At the same time, we develop a real-time stream processing framework to analyze the coordination among the tasks and the infrastructures. This coordination information is essential for troubleshooting the reasons for failures and performance reduction, especially the ones propagated from other causes.

sted, utgiver, år, opplag, sider
IEEE, 2019. s. 357-359
Serie
Symposium on Reliable Distributed Systems, ISSN 1060-9857, E-ISSN 2575-8462
Emneord [en]
Hadoop, MapReduce, Monitoring
HSV kategori
Forskningsprogram
Distribuerade datorsystem
Identifikatorer
URN: urn:nbn:se:ltu:diva-76617DOI: 10.1109/SRDS47363.2019.00049ISI: 000720089500038Scopus ID: 2-s2.0-85084118011OAI: oai:DiVA.org:ltu-76617DiVA, id: diva2:1368025
Konferanse
The 38th International Symposium on Reliable Distributed Systems (SRDS 2019) Lyon, France, OCT 1-4, 2019
Merknad

ISBN för värdpublikation: 978-1-7281-4222-7, 978-1-7281-4223-4

Tilgjengelig fra: 2019-11-05 Laget: 2019-11-05 Sist oppdatert: 2025-02-18bibliografisk kontrollert

Open Access i DiVA

Fulltekst mangler i DiVA

Andre lenker

Forlagets fulltekstScopus

Person

Mitra, Karan

Søk i DiVA

Av forfatter/redaktør
Mitra, Karan
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric

doi
urn-nbn
Totalt: 260 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf