Depending on the amount of data to process, file generation may take longer.

If it takes too long to generate, you can limit the data by, for example, reducing the range of years.

Chapter

Download BibTeX

Title

An on-demand ELT architecture for real-time BI

Authors

[ 1 ] Instytut Informatyki, Wydział Informatyki, Politechnika Poznańska | [ P ] employee

Year of publication

2013

Chapter type

paper

Publication language

english

Keywords
EN
  • Real-time BI
  • ETL
  • ELT
  • Materialized Views
Abstract

EN Online or real-time BI has remained elusive despite significant efforts by academic and industrial research. Some of the most prominent problems in accomplishing faster turnaround are related to the data ingest. The process of extracting data from source systems, transforming, and loading (ETL) it is often bottlenecked by architectural choices and fragmentation of the processing chain. In this paper, we present a vision for a resource-efficient infrastructure that enables just-in-time processing with regards to data ingest. At the heart of our approach are (1) the converting of compute intensive parts of the ETL process into in-database processing and (2) the activating of the process on demand via a system of flexible views. Our approach avoids processing of data that is not being accessed any time soon, scales effectively with the database system and avoids administration and management overhead.

Pages (from - to)

50 - 59

DOI

10.1007/978-3-642-39872-8_4

URL

https://link.springer.com/chapter/10.1007/978-3-642-39872-8_4

Book

Enabling real-time business intelligence : International Workshop, BIRTE 2012, Held at the 38th International Conference on Very Large Databases, VLDB 2012, Istanbul, Turkey, August 27, 2012 : revised selected papers

Presented on

6th International Workshop Enabling Real-Time Business Intelligence, BIRTE 2012, 27.08.2012, Istanbul, Turkey

Publication indexed in

WoS (15)

This website uses cookies to remember the authenticated session of the user. For more information, read about Cookies and Privacy Policy.