Depending on the amount of data to process, file generation may take longer.

If it takes too long to generate, you can limit the data by, for example, reducing the range of years.

Chapter

Download BibTeX

Title

Distributed and cloud-based multi-model analytics experiments on large volumes of climate change data in the Earth System Grid Federation eco-system

Authors

Year of publication

2016

Chapter type

paper

Publication language

english

Keywords
EN
  • big analytics
  • workflow management
  • cloud computing
  • ESGF
  • INDIGO-DataCloud
Abstract

EN A case study on climate models intercomparison data analysis addressing several classes of multi-model experiments is being implemented in the context of the EU H2020 INDIGO-DataCloud project. Such experiments require the availability of large amount of data (multi-terabyte order) related to the output of several climate models simulations as well as the exploitation of scientific data management tools for large-scale data analytics. More specifically, the paper discusses in detail a use case on precipitation trend analysis in terms of requirements, architectural design solution, and infrastructural implementation. The experiment has been tested and validated on CMIP5 datasets, in the context of a large scale distributed testbed across EU and US involving three ESGF sites (LLNL, ORNL, and CMCC) and one central orchestrator site (PSNC).

Pages (from - to)

2911 - 2918

DOI

10.1109/BigData.2016.7840941

URL

https://ieeexplore.ieee.org/document/7840941

Book

Proceedings of 2016 IEEE International Conference on Big Data (Big Data)

Presented on

4th IEEE International Conference on Big Data (Big Data), 5-8.12.2016, Washington, United States

Publication indexed in

WoS (15)

This website uses cookies to remember the authenticated session of the user. For more information, read about Cookies and Privacy Policy.