BEGIN:VCALENDAR VERSION:2.0 PRODID:-//pretalx//talks.staging.osgeo.org//foss4g-europe-2025//speaker//98 K373 BEGIN:VTIMEZONE TZID:CET BEGIN:STANDARD DTSTART:20001029T040000 RRULE:FREQ=YEARLY;BYDAY=-1SU;BYMONTH=10 TZNAME:CET TZOFFSETFROM:+0200 TZOFFSETTO:+0100 END:STANDARD BEGIN:DAYLIGHT DTSTART:20000326T030000 RRULE:FREQ=YEARLY;BYDAY=-1SU;BYMONTH=3 TZNAME:CEST TZOFFSETFROM:+0100 TZOFFSETTO:+0200 END:DAYLIGHT END:VTIMEZONE BEGIN:VEVENT UID:pretalx-foss4g-europe-2025-SEMYHF@talks.staging.osgeo.org DTSTART;TZID=CET:20250717T143000 DTEND;TZID=CET:20250717T150000 DESCRIPTION:Destination Earth (DestinE) is a flagship initiative led by the European Commission\, implemented by the European Organisation for the Ex ploitation of Meteorological Satellites (EUMETSAT)\, the European Space Ag ency (ESA) and the European Centre for Medium-Range Weather Forecasts (ECM WF). It aims to create highly detailed Digital Twins (DTs) of the Earth\, enabling precise simulations for a variety of uses. Currently\, the initia tive focuses on two primary Digital Twins: the Weather Extremes Digital T win (ExtremeDT) and the Climate Change Adaptation Digital Twin (ClimateDT) . Over the coming years\, the scope of Digital Twins is set to expand\, ne cessitating improved access to data and streamlined methods for working wi th it. This is where the Destination Earth Data Lake (DEDL) plays a pivota l role\, offering comprehensive data discovery\, access\, and processing s ervices tailored to the needs of DestinE users.\n\nThe DEDL operates on tw o key levels: ‘Data Discovery and Access’ and ‘Edge Services’. DED L Discovery and Data Access services is provided by Harmonized Data Access (HDA) tool which provides a single\, federated entry point to the service s and data\, including resources from existing datasets and complementary sources such as in-situ and socio-economic data. Notably\, it also provide s access to the unique datasets generated by DestinE’s Digital Twins. By combining these sources\, users can seamlessly explore\, integrate\, and analyze both existing services and the innovative data produced by the Dig ital Twins. What is more\, all this data is provided as a full archive imm ediately available to the user. The services rely on use of the SpatioTemp oral Asset Catalogs (STAC) standard which means:\n\n• The search in the dataset is done according to the STAC protocol\;\n• The Federated Catalo g search proxy component converts STAC queries into queries adapted to the underlying catalog and returns the results to the user in STAC format\;\n • The services are presented in service catalog.\n\nEdge Services offere d by DEDL provides:\n• Cloud Computing\n• STACK Application Developmen t Environment\n• Hook Services\n\nThe cloud computing service is powered by the ISLET infrastructure\, a distributed Infrastructure as a Service ( IaaS) built on OpenStack\, using the Horizon interface. It allows users to manage virtual machines\, s3 storage\, and run advanced computations via a graphical user interface (GUI) or command-line interface (CLI). For more complex tasks\, Kubernetes integration is available. A standout feature o f ISLET is its proximity to data sources\, operating near High-Performance Computing (HPC) facilities. This is achieved through data bridges\, enabl ing efficient processing of large datasets\, including those from Digital Twins\, in conjunction with HPC systems.\n\nThe STACK environment supports application development using JupyterHub and DASK\, with Python\, and R l anguages. Users can create DASK clusters on selected infrastructure or clo ud sites to process data directly where it resides\, removing the need for extensive local setup and optimization.\n\nHook Services is a set of pre- defined workflows which could be used by users as a ready-to-use processor s\, e. g. : Sentinel-2: MAJA Atmospheric Correction\; \, Sentinel-2: SNAP- Biophysical\; Sentinel-1: Terrain-corrected backscatter. It also enables w orkflow functions to generate on-demand higher-level products\, such as te mporal composites.\n\nThe DestinE Data Lake is a transformative initiative that revolutionizes how Earth Observation data is managed and utilized. B y integrating innovative infrastructure (ISLET)\, data services (HDA)\, re liable processors (Hook Services)\, and user-friendly development tools (S TACK)\, DEDL enables unprecedented levels of data harmonization\, federati on\, and processing. Moreover\, the DEDL plays a crucial role in empowerin g DestinE users by providing them with seamless access to vast datasets an d advanced computational tools. It simplifies the process of data explorat ion\, integration\, and analysis\, enabling researchers\, policymakers\, a nd developers to focus on innovation and decision-making rather than techn ical barriers. By offering a comprehensive suite of services designed to w ork close to the data\, DEDL ensures that users can efficiently utilize th e wealth of information generated by the Digital Twins and maximize the im pact of their work. This cutting-edge system enhances climate research cap abilities and supports sustainable development efforts on a scale previous ly unattainable. DTSTAMP:20260527T212624Z LOCATION:EL11 (Geosolutions) SUMMARY:How Data Lake services support Destination Earth users - A Year of Insights and Experiences - Patryk Grzybowski URL:https://talks.staging.osgeo.org/foss4g-europe-2025/talk/SEMYHF/ END:VEVENT BEGIN:VEVENT UID:pretalx-foss4g-europe-2025-7JYZJH@talks.staging.osgeo.org DTSTART;TZID=CET:20250717T171000 DTEND;TZID=CET:20250717T171500 DESCRIPTION:The Destination Earth Data Lake Lab (DestinE-DataLake-Lab) is a comprehensive GitHub repository designed to facilitate users' interaction with the Destination Earth Data Lake (DEDL) services. Developed by EUMETS AT and partners\, this repository offers a collection of Jupyter Notebook examples and Python tools that demonstrate how to effectively utilize vari ous DEDL services\, including Harmonized Data Access (HDA)\, STACK\, and H OOK.\n\nHarmonized Data Access (HDA)\n\nThe HDA service provides users wit h streamlined access to a diverse range of datasets within the DEDL ecosys tem. Within the repository\, the HDA directory contains Jupyter Notebook e xamples that guide users through the process of discovering available serv ices\, listing and searching for STAC collections\, and retrieving specifi c data items. These examples are instrumental in helping users understand how to interact with the HDA API\, manage authentication\, and perform dat a queries efficiently.\n\nSTACK Service\n\nThe STACK service is designed t o facilitate near-data processing by leveraging DASK\, a flexible parallel computing library in Python. In the STACK directory of the repository\, u sers will find Jupyter Notebook examples that illustrate how to set up and utilize DASK for processing large datasets distributed across different c loud locations. These examples demonstrate the deployment of DASK clusters \, execution of parallel computations\, and optimization of data processin g workflows\, enabling users to perform complex analyses efficiently.\n\nH OOK Service\n\nThe HOOK service offers Function-as-a-Service (FaaS) capabi lities\, allowing users to define and execute workflows within the DEDL en vironment. The HOOK directory in the repository provides Jupyter Notebook examples that guide users through the process of creating\, deploying\, an d managing workflows using the HOOK service. These tutorials cover various aspects\, including defining functions\, setting up triggers\, and monito ring workflow execution\, thereby enabling users to automate data processi ng tasks effectively.\n\nGetting Started\n\nTo begin utilizing the resourc es provided in the DestinE-DataLake-Lab repository\, users are encouraged to clone the repository into their local environment or access it through the DEDL-provided JupyterHub - STACK Service. The repository includes a re quirements.txt file that lists the necessary Python dependencies. Users sh ould create a virtual environment\, install the required packages\, and se lect the appropriate kernel when running the provided notebooks. Detailed instructions for setting up the environment and installing dependencies ar e available in the repository's README file.\n\nAdditional Resources\n\nFo r further information and comprehensive documentation on DEDL services\, u sers can refer to the DestinE Data Lake documentation. This resource provi des in-depth guides\, API references\, and additional tutorials to assist users in maximizing their utilization of DEDL services. Moreover\, the Des tinE Data Portfolio and Data Lake Edge services offer valuable insights in to the available datasets and services within the DEDL ecosystem.\n\nSumma ry\n\nIn summary\, the DestinE-DataLake-Lab repository serves as a valuabl e resource for users aiming to effectively engage with the Destination Ear th Data Lake services. By providing practical examples and comprehensive g uides\, it empowers users to harness the full potential of DEDL's offering s\, facilitating efficient data access\, processing\, and workflow managem ent within the Destination Earth initiative. DTSTAMP:20260527T212624Z LOCATION:SA02 SUMMARY:DestinE DataLake Lab: A Guide to Utilizing Destination Earth Data L ake Services - Patryk Grzybowski URL:https://talks.staging.osgeo.org/foss4g-europe-2025/talk/7JYZJH/ END:VEVENT END:VCALENDAR