Prototype of HPC/Data Infrastructure for On-demand Services

The project will build a prototype for Data/HPC services based on Earth sciences cases. The consortium will develop and provide new services to discover, manage and process spatial and environmental data (in particular from earth surface, atmosphere, ocean). The project will develop the datasets adding into the EOSC catalogues. It will optimize and industrialize treatments workflows (to allow a largest reusability); provide an open access to standardized HPC services. The consortium will improve the FAIRization processes and the open access to the environmental initial and the processed datasets. The project will also progress on sustainability and evolution of services from an experimental and restricted usage to a large and standardized (in a production phase). It will explore a distributed model for data transfer and resource allocation between two european computing centers (CINES in France and CSC in Finland). On the use cases, the project will develop data post-processing methods coupled with HPC capabilities, which will be deployed as a service for several end-users (scientific communities/public authorities/private players/citizen scientists). The data generated and services created will be available on the relevant EU portals (EU Open Data Portal/EUDAT/EOSC) and will be preserved using the long-term preservation services of the EOSC. This PHIDIAS project will then propose a generic workflow for massive scientific data by combining computing, dissemination and archiving resources in a single framework.

CSC collaborates in this project with 12 PMs on AI and on the fly computing workflow.

Other partners include French computing centers and environmental research organisations, including SYKE.

The project will allow CSC to test and develop new approached with regards to AI and will be used as a pilot for EuroHPC.