ODIP

Ocean Data Interoperability Platform

Progress up to date 

  1. 1st October 2012: Project start up
  2. 20 November 2012: Kick-off meeting
  3. 6 December 2012: splinter meeting at AGU
  4. December 2012 - February 2013: Preparation of the 1st Workshop
  5. 25-28 February 2013: 1st ODIP Workshop
  6. February - December 2013: ODIP Prototypes Projects-1st Workshop follow up activities
  7. 27 November 2013: EU Review
  8. 3 - 6 December 2013: 2nd ODIP Workshop
  9. 7 December 2013 - August 2014
  10. 5 - 8 August 2014: 3rd ODIP Workshop
  11. 18 November 2014: CDI and CSR metadata standards submitted to ODSBP
  12. 26 November 2014: EU review
  13. 15 March 2015: proposal for ODIP II successful
  14. 20 - 23 April 2015: 4th ODIP Workshop
  15. 20 April 2015: Controlled Vocabularies submitted to ODSBP
  16. 21 May 2015: SeaDataNet NetCDF Format submitted to ODSBP
  17. 28 September - 1 October 2015: 5th ODIP Workshop (=1st ODIP II Workshop)
  18. 5 - 30 October 2015: reporting results of prototypes and impact assessments
  19. November 2015 - May 2016: progressing prototypes and preparing for the 6th ODIP Workshop
  20. 2 - 5 May 2016: 6th ODIP Workshop (= 2nd ODIP II Workshop)
  21. October 2016: Workplans for expanding existing ODIP Prototypes specified
  22. November 2016: Good progress with developing ODIP Prototypes
  23. 7 - 10 March 2017: 7th ODIP Workshop (= 3rd ODIP II Workshop)
  24. March - August 2017: Workplans for 2 extra ODIP Prototypes specified
  25. 2- 5 October 2017: 8th ODIP Workshop (= 4th ODIP II Workshop)
  26. May 2018: Final results achieved with ODIP II prototypes and documented.

1st October 2012: Project start up
The ODIP project officially started on the 1st October 2012 and is planned to run for 36 Months until October 2015.

20 November 2012: Kick-off meeting
The project kick-off meeting took place 20 November 2012 in London, United Kingdom. The meeting was used to introduce partners from the 3 regions (Europe, USA and Australia) and UNESCO IOC-IODE and to brainstorm about planning the 1st Workshop. Moreover a matrix was prepared of possible topics for discussion in the coming ODIP Workshops.

6 December 2012: splinter meeting at AGU
A further meeting, involving more USA organisations, took place as splinter meeting during AGU 2012 in San Francisco, USA, 6 December 2012. This meeting contributed to further brainstorming about the approach to follow for the 1st ODIP Workshop

December 2012 - February 2013: Preparation of the 1st ODIP Workshop
Following AGU and the topics selection partners were asked to nominate experts on the topics for each region (Europe, USA, and Australia). These experts were tasked with gathering and publishing on the ODIP website documentation on their expert topic as preparatory material for Workshop participants. Moreover they were asked to prepare presentations to be given at the 1st Workshop that provided the basis for the discussions on possible common standards and interoperability solutions. The resulting agenda for the 1st Workshop is available in the Agenda section of the website, while the documentation for the 6 topics as listed for the 1st Workshop is available in the Workshop section of the website.

25 - 28 February 2013: 1st ODIP Workshop
The actual 1st ODIP Workshop took place 25th - 28th February 2013 in Oostende, Belgium at the IODE Programme Office. More than 40 persons participated in a lively discussion and brainstorming, most attending in Ostend and a number also by Webex. The discussion and brainstorming has taken place around the first 6 topics as prioritised after the London Kick-off meeting.

Extensive minutes have been made which report on the organisation, participation and outcomes of the 1st ODIP Workshop. Users can also check the presentations given during the 1st Workshop by video's and downloadable presentations. These are made available through the IODE portal.

The minutes conclude with a comprehensive list of proposed actions that resulted from the discussions both during the plenary and the concurrent break-out sessions. These actions will be implemented through the development of a number of prototype projects as part of the activities of work package 3. The actual development of the prototypes will be a joint activity undertaken by ODIP partners that will leverage on the activities of current regional projects and initiatives such as SeaDataNet, Eurofleets, EMODnet (EU), IMOS (Australia) and R2R, US NODC, IOOS (USA)

February - December 2013: ODIP Prototypes Projects-1st Workshop follow up activities 
In July 2013 a proposal has been drafted for a first set of ODIP Prototype projects. It gives a formulation of each of the proposed Prototype projects, indicates which identified actions from the long list are relevant, with some overlaps, and indicates which regional projects and initiatives will contribute. The draft also gives a plan for further organisation and implementation of the proposed ODIP Prototype projects.

The draft proposal has been considered by the ODIP Steering Committee and during the ODIP project meeting at the IMDIS Conference in Lucca - Italy, 23 September 2013 it was accepted. The proposal is now public and serves as basis for the coming ODIP activities.

The 3 ODIP Prototype projects are formulated as follows:

  • ODIP 1: Establishing interoperability between SeaDataNet CDI, US NODC, and IMOS  MCP Data Discovery and Access services, making use of a brokerage service, towards  interacting with the IODE-ODP en GEOSS portals 
  • ODIP 2: Establishing deployment and interoperability between Cruise Summary reporting systems in Europe, US and Australia, making use of GeoNetWork, towards interacting  with the POGO portal
  • ODIP 3: Establishing a prototype for a Sensor Observation Service (SOS) and formulating common standards for SensorML and O&M profiles for selected sensors (SWE), installed at vessels and in real-time monitoring systems

Activities were undertaken for organising the proposed subgroups per Prototype project and starting the development process. The subgroups provided input for the 2nd ODIP Workshop agenda.

27 November 2013: EU Review
The review with 3 external reviewers and the EU Project officer took place in Brussels, Belgium at EU offices. The EU core group presented the ODIP scope and its progress up-to-date. The evaluation was successful.    

3 - 6 December 2013: 2nd ODIP Workshop
The 2nd ODIP Workshop took place in La Jolla, USA at the Scripps Institution of Oceanography (SIO). The leaders of the ODIP Prototype projects each led a section on progress made. This included several presentations of regional components and brainstorming about the overall approach and planning. Two extra sessions took place dedicated to 'vocabularies' and 'data publishing and citation', also with presentations and brainstorming.

Extensive minutes have been made which report on the organisation, participation, proceedings and outcomes of the 2nd ODIP Workshop. The final version incorporates all feedback received from many colleagues and it has been signed off by the ODIP coordinator. Users can also download all the presentations and audio recordngs. These are made available through the IODE portal.

7 December 2013 - August 2014
ODIP Prototype project leaders have finalised their Workplans which are described in the Deliverable D3.2. The associated groups are underway with the further development and implementation of the 3 ODIP Prototype projects. A progress check has taken place during EGU 2014 in May 2014. The presentations per ODIP Prototype project are available in the Promotion section of the website. Also at EGU 2014 a joint Workshop together with the EU COOPEUS project has been  organised.

5 - 8 August 2014: 3rd ODIP Workshop
The 3rd ODIP Workshop took place from 5th to the 8th August 2014 in Townsville, Australia, hosted by the Australian Institute for Marine Science (AIMS). The programme was dedicated to monitoring the progress of the 3 ODIP Prototype activities and further discussing Data Publishing & Citation, Vocabularies, and Person Identifiers. The Workshop was  joined by oceanographic data management experts from the 3 regions (Europe, USA and Australia) and IOC-IODE. 

The presentations are available from the IODE website. Also extensive minutes have been prepared, including amendments by participants. The minutes are awaiting final sign-off by the coordinator.

18 November 2014: CDI and CSR metadata standards submitted to ODSBP
On behalf of the ODIP and SeaDataNet projects 2 proposals entitled “SeaDataNet Common Data Index (CDI) Metadata data model and XML encoding” and “SeaDataNet Cruise Summary Report (CSR) Metadata data model and XML encoding” have been submitted on 18 November 2014 to the IODE  Ocean Data Standards and Best Practices Project (ODSBP). The related documents can be downloaded:

26 November 2014: EU Review
The review with 3 external reviewers and the EU Project officer took place in Brussels, Belgium at EU offices. The EU core group presented the ODIP scope and its progress up-to-date. The evaluation was successful.  

15 March 2015: proposal for ODIP II successful
The EU reviewers have given a positive review, 14.5 out of max 15 points, to the ODIP II proposal for continuation and extension of the ODIP project. Inspired by the success of the ongoing ODIP activities, the partnership of ODIP 2 includes more European and international organisations (from USA, Australia and global) and associated data management infrastructures. Moreover the scope of topics will be enlarged by including also marine biological data management. This outcome provides a seamless continuation of the ODIP activities. The preparations for the new grant agreement were concluded by having it signed by the EU and all European partners. Officially ODIP II runs from 1st April 2015 till 31st March 2018.

20 - 23 April 2015: 4th ODIP Workshop
The 4th ODIP Workshop took place from 20th to the 23rd April 2015 in Liverpool, United Kingdom, hosted by the British Oceanographic Data Centre (BODC). The programme was dedicated to monitoring the progress of the 3 ODIP Prototype activities and further discussing Data Ingestion, Data Publishing & Citation, Vocabularies, and Person Identifiers. The Workshop was  joined by oceanographic data management experts from the 3 regions (Europe, USA and Australia) and IOC-IODE. 

The presentations are available from the IODE website. Extensive minutes are available.

20 April 2015: Controlled Vocabularies submitted to ODSBP
On behalf of the ODIP and SeaDataNet projects a proposal entitled "SeaDataNet Controlled Vocabularies" has been submitted on 20 April 2015 to the IODE  Ocean Data Standards and Best Practices Project (ODSBP). The related documents can be downloaded:

Controlled vocabularies - proposal

21 May 2015: SeaDataNet NetCDF Format submitted to ODSBP
On behalf of the ODIP and SeaDataNet projects a proposal entitled "SeaDataNet NetCDF (CF) data transport model for Marine and Oceanographic Datasets " has been submitted on 21 May 2015 to the IODE  Ocean Data Standards and Best Practices Project (ODSBP). The related documents can be downloaded:

SeaDataNet NetCDF format - proposal

28 September - 1 October 2015: 5th ODIP Workshop (= 1 st ODIP II Workshop)
The 5th ODIP Workshop (= 1st Workshop of the successor ODIP II project) took place from 29th September to the 1st October 2015 in Paris, France, with logistic support of IFREMER. The programme was dedicated to kick-off of the ODIP II project involving more partners, reviewing the results and possible follow-up of the 3 ODIP Prototype activities, updates on Data Publishing & Citation, Vocabularies, and Person Identifiers, introducing Model Workflows and Big Data as new subjects, and brainstorming on additional topics for ODIP II discussions and prototype developments. The Workshop was  joined by oceanographic data management experts from the 3 regions (Europe, USA and Australia) and IOC-IODE. 

The presentations are available from the IODE website. Extensive minutes are available.

5 - 30 October 2015: reporting results of prototypes and impact assessments in 1st ODIP project
The activities in the three ODIP protype developments have resulted in a number of highly significant results:

  • the GEOSS portal and the IODE-ODP portal have been populated with data collection entries as harvested and brokered from the three regional SeaDataNet (Europe), US NODC (USA) and AODN (Australia) data discovery and access services as a result of ODIP 1;
  • the SeaDataNet Cruise Summary Report (CSR) metadata profile and schema have been adopted by R2R (USA) and NMF (Australia) within the framework of ODIP 2, leading to the population of the POGO CSR catalogue with an initial set of CSRs for US Research Vessels and a first CSR entry for Australia;
  • ODIP 3 has resulted in a closer cooperation and alignment between multiple European, Australian and USA projects on SWE for the marine domain, leading to synergies, initiation and adoption of common vocabularies, and a basis for continued activity in the ODIP II follow-on project.

These results and related activities have been reported in detail and with illustrations where relevant, in deliverable D3.4 'Results and conclusions from Prototype Analyses'.

In addition to the prototype developments, three cross-cutting themes were included as recurring agenda items for the ODIP workshops starting with the second workshop. These concern:

  • Vocabularies
  • Data Publishing and Citation
  • Unique persistent identifiers for researchers

These themes are highly relevant for data management in general and in particular for harmonising metadata and data descriptions and achieving semantic interoperability between different regional systems through mappings and ontologies as applied and demonstrated in the three ODIP prototype developments. In addition the topics of data publishing/citation and the assigning of persistent identifiers to data sets are very relevant for encouraging researchers to release and publish their data sets in scientific literature and obtaining academic credit by means of citations.

The major results and progress made have been summarised and reported in deliverable D3.3 ‘Cross-cutting themes’.

The ODIP workshops and prototype developments as part of the first ODIP project have provided an insight into possible common standards and/or interoperability solutions. However implementing these solutions in practice might have significant implications for the operational systems. Their adoption may require modifications throughout the existing system from the portal to the distributed data providers. The deliverable D4.2 “Final strategic analysis” reports on the analyses conducted to identify the possible impacts and potential solutions for the adoption of the prototype interoperability solutions and the associated standards by the regional data infrastructures. The report also includes a proposed action plan to address issues that have been identified by the impact analysis.

The ODIP activities are continued as part of the ODIP II contract.

November 2015 - May 2016: prototypes progress and preparations for the 6th ODIP Workshop
Further progress has been made with the ODIP prototypes, shaping ideas for expanding these prototypes as well as with the cross-cutting topics. Preparations have been made for the 6th ODIP Workshop.

2 - 5 May 2016: 6th ODIP Workshop (= 2nd ODIP II Workshop)

The 6th ODIP Workshop (= 2nd Workshop of the successor ODIP II project) took place from 2nd to the 5th of May 2016 in Boulder, USA, with logistic support of UNCAR (UNIDATA). The programme was dedicated to agreeing on the terms oif reference for the expansion of the 3 existing ODIP prototypes, brainstorming on any additional prototypes, updates of the cross-cutting topics Data Publishing & Citation, Vocabularies, and Person Identifiers, and exploring new subjects such as biological data management and big data. The Workshop was joined by oceanographic data management experts from the 3 original regions (Europe, USA and Australia) and IOC-IODE, while now also Canada joined. 

The presentations are available from the IODE website. Extensive minutes are available in draft.

October 2016: Workplans for expanding existing ODIP Prototypes specified

At the 6th ODIP Workshop it was discussed and agreed to expand the existing three ODIP Prototypes. As a follow-up specifications and work plans have been formulated between the ODIP Technical Coordinator and the new Prototype leaders (MARIS, BSH and 52North) and these have been documented in the Deliverable D3.1.

November 2016: Good progress with developing ODIP Prototypes

Considerable activities have taken place by the prototype leaders MARIS, BSH and 52North for expanding the existing three ODIP Prototypes as well as for the cross-cutting topics. The progress has been documented in the Deliverable D3.3.

7 - 10 March 2017: 7th ODIP Workshop (= 3rd ODIP II Workshop)

The 7th ODIP Workshop (= 3rd Workshop of the successor ODIP II project) took place from 7th to the 10th of March 2017 in Hobart, Australia, with logistic support of UTAS and CSIRO. The programme was dedicated to presenting and discussing progress on the 3 earlier agreed ODIP prototypes, updates of the cross-cutting topics on Vocabularies and Linked Data, and further exploring biological data management, big data and Virtual Research Environments (VRE). The Workshop was joined by oceanographic data management experts from the 3 regions (Europe, USA and Australia) and IOC-IODE.

The presentations are available from the IODE website. Extensive minutes have been prepared and are available in final draft.

March - August 2017: Workplans for 2 extra ODIP Prototypes specified

During the 2nd ODIP II Workshop brainstorming started concerning the formulation of additional prototypes, such as focus on i) the concept of collaborative workspaces on the cloud for functions such as computing, analyzing, accessing data, and visualization, and ii) a possible prototype for marine biology. At the 3rd ODIP II Workshop several ongoing virtual research laboratories projects were presented and following the brainstorming a new ODIP II prototype was defined and agreed as:

  • ODIP II prototype 4: the Digital Playground.

The marine biology community in ODIP II also continued their brainstorming and have agreed on the following new ODIP II prototype:

  • ODIP II prototype 5: integration of data management for biological and physicochemical marine data.

The definitions and workplans for both extra ODIP II Prototype projects are documented in the ODIP II Deliverable D3.2 (DRAFT). This also includes an extract of the examples and considerations that were presented and discussed at the Workshops concerning big data, cloud computing and collaborative workspaces as well as concerning biological data management. The 2 extra prototype projects have already been put into motion and will be further implemented in the remaining ODIP II project duration.

2- 5 October 2017: 8th ODIP Workshop (= 4th ODIP II Workshop)

The 8th ODIP Workshop (= 4th Workshop of the successor ODIP II project) took place from 2nd to the 5th of October 2017 in Galway, Ireland, with logistic support of the Marine Institute. Great progress was reported on all the 5 ODIP prototypes with clear actions defined for the remaining project period. There were also major steps presented and discussed for the cross-cutting topics on Vocabularies and Linked Data. The Workshop was joined by oceanographic data management experts from the 3 regions (Europe, USA and Australia) and IOC-IODE.

The presentations are available at the IODE website. In addition extensive minutes have been made.

May 2018: Final results achieved with ODIP II prototypes and documented.

In the final period major results have been achieved with the 5 prototypes, which are documented:

ODIP II Prototype 1+: interoperability between regional data discovery and access services and interacting with the global IODE-ODP and GEOSS portals. The exchange concerns the three regional data portals: SeaDataNet CDI service, AODN data portal, and the USA NCEI data portal and the metadata of their data collections (SDN 450+; NCEI 25.000+ and AODN 100+). CNR together with BODC and MARIS has developed an extended prototype portal for its Brokerage Service. The common broker metadata profile has been expanded with extra attributes for e.g. platforms, instruments, and parameters to distinct the current keywords attribute, and with extra attributes for including types of services, such as WMS, WFS, and others, their versions and addresses. Semantic brokerage has been added by interaction with a 'Rosetta stone' mapping service, developed by BODC, that allows to translate between different vocabularies used at the source providers for the given data collections. Therefore the harvested metadata collections from the 3 portals have been analysed for their use of controlled vocabularies and mappings have been initiated between comparable vocabularies for the indexed terms of each. The mapping, supported by the Rosetta Stone service, is used in the ODIP  prototype portal that has been developed and deployed at:

https://seadatanet.geodab.eu/gs-service/odip/search
 
to demonstrate the ODIP broker discovery functionalities at full through a user friendly web interface which includes semantic capabilities. In addition a detailed document has been prepared describing the ODIP II Brokering Architecture.

ODIP II Prototype 2+: interoperability between the regional cruise summary reporting systems and interacting with the global POGO portal. Further population has taken place of the CSR directory as managed by BSH through European providers, R2R (USA), and some entries from Australia. The CSR has been mapped by Marine Institute (Ireland) and LDEO (USA) to a Linked Data pattern in a cooperation with US projects “R2R” and “GeoLink” and the EU project “SeaDataCloud”. This mapping has been adopted by SeaDataCloud and work is now underway by BSH to set up a CSR SPARQL service for publishing the CSRs as RDF resources from a triple-store database. The delivery is planned for end October 2018. This will largely improve the machine-to-machine interoperability and findability in search engines. Moreover it will facilitate enriching metadata profiles of related resources.

ODIP II Prototype 3+: Sensor Web Enablement (SWE) for the marine and ocean domain. SWE profiles have been formulated for a range of platforms and instruments in synergy with multiple projects; this task has been coordinated by 52North. The profiles are supported by SeaDataNet common vocabularies and new vocabulary lists have been defined and populated by BODC with contributions of the international marine SWE community. The resulting standards are now available in a dedicated ODIP GitHub repository: https://odip.github.io/MarineProfilesForSWE/

These standards are adopted in current developments in the SeaDataCloud project for an SWE Ingestion service, in the NeXOS and FixO3 projects for refining the Helgoland Sensor Web viewer and smle SWE editor, and in EMODnet Ingestion and Physics projects for promoting SWE to operators of ocean observing systems by means of an SWE demonstrator and guidance. See the SWE demonstrator at: www.emodnet-physics.eu/realtime

Also the link to Internet of Things technologies was further investigated. For this purpose, 52°North has been working on an adapter that allows to link MQTT data streams to Sensor Web servers. For testing and showcasing this approach, a data stream of the Marine Institute (Ireland) is used.

ODIP II Prototype 4: 'The digital playground' to explore, review, and formulate common solutions and best practices for setting up and configuring cloud based Virtual Research Environments in the marine domain. This prototype was initiated at the third ODIP II Workshop and it has been approached by reviewing relevant existing projects and initiatives through presentations and discussions at the ODIP II Workshops, followed by further analyses, looking for common developments as well as specific promising solutions. Analysis took place of the following cloud and VRE projects:
    EVER-EST (Europe)
    SeaDataCloud – VRE development (Europe)
    Climate Information Portal for Copernicus (CLIPC) (Europe)
    Nectar Research Cloud (Australia)
    Australian Marine Sciences Cloud (Australia)
    Marine Virtual Laboratory (MARVL) (Australia):
    eReefs (Australia)
    Australian Urban Research Infrastructure Network (AURIN) (Australia)
    Virtual Geophysics Laboratory project (Australia)
Most examples are from Australia which is quite ahead of others in this respect. The first conclusions from the review are:
   
The ODIP analysis and international discussions have provided a major input for the architecture that has recently been drafted for a SeaDataCloud VRE. This VRE focuses on a workflow generating T-S Climatology, both menu driven and by Jupyter notebook. The architecture is flexible to carry also other workflows. Use is made of Docker containers and JupyterHub for configuring application software components, such as WebODV, online DIVA, sub setting, visualisations, and others.

ODIP II Prototype 5: integration of data management for biological and physicochemical marine data. The current practices of animal tagging data were investigated by VLIZ. Bio-telemetry constitutes a powerful technology to collect remotely unprecedented insights into animal movement behavior and social interactions, and physical environment. The merging of oceanography and marine mammal ecology advances our understanding of the world’s oceans and its top predators, and allows us to predict how these species will be affected by future climate changes. At the same time, using organisms as sensor platforms provides very valuable information on the physicals state of the oceans. However different communities use different data systems and data standards. Therefore prototype 5 focused on a use case of marine mammal tracking. Conceptually it was worked out how a better integration of data management principles between biological and physicochemical marine data could be achieved. The further implementation will be done in a successive project.

The resulting prototypes are documented in deliverable D3.4 Progress and Results from Prototype Developments 2 (draft). This is an update of deliverable D3.3 Progress and results from prototype developments 1 that was delivered halfway the project and that reported on the progress with the first 3 prototypes and cross-cutting topics.

Tools

Contact
Extranet
Sitemap
Home

This project has received funding from the European Union's Seventh Framework Programme for research, technological development and demonstration under grant agreement no [312492] and continued funding from the European Union's HORIZON 2020 Framework Programme for Research and Innovation under grant agreement no [654310].