Depending on the amount of data to process, file generation may take longer.

If it takes too long to generate, you can limit the data by, for example, reducing the range of years.

Chapter

Download BibTeX

Title

Reference Architecture for Running Large Scale Data Integration Experiments

Authors

[ 1 ] Politechnika Poznańska | [ 2 ] Instytut Informatyki, Wydział Informatyki i Telekomunikacji, Politechnika Poznańska | [ DW ] applied doctorate phd student | [ P ] employee

Scientific discipline (Law 2.0)

[2.3] Information and communication technology

Year of publication

2021

Chapter type

chapter in monograph / paper

Publication language

english

Keywords
EN
  • data integration
  • data processing
  • hybrid cloud
  • containerization
  • performance testing
  • software architecture
  • experimentation
Abstract

EN This paper contributes a reference architecture of a reusable infrastructure for scientific experiments on data processing and data integration. The architecture is based on containerization and is integrated with an external machine learning cloud service to build performance models.

Date of online publication

31.08.2021

Pages (from - to)

3 - 9

DOI

10.1007/978-3-030-86472-9_1

URL

https://link.springer.com/chapter/10.1007/978-3-030-86472-9_1

Book

Database and Expert Systems Applications : 32nd International Conference, DEXA 2021, Virtual Event, September 27–30, 2021, Proceedings, Part I

Presented on

32nd International Conference on Database and Expert Systems Applications DEXA 2021, 27-30.09.2021

Ministry points / chapter

20

Ministry points / conference (CORE)

70

This website uses cookies to remember the authenticated session of the user. For more information, read about Cookies and Privacy Policy.