ODIP

Ocean Data Interoperability Platform

Progress up to date 

  1. 1st October 2012: Project start up
  2. 20 November 2012: Kick-off meeting
  3. 6 December 2012: splinter meeting at AGU
  4. December 2012 - February 2013: Preparation of the 1st Workshop
  5. 25-28 February 2013: 1st ODIP Workshop
  6. February - December 2013: ODIP Prototypes Projects-1st Workshop follow up activities
  7. 27 November 2013: EU Review
  8. 3 - 6 December 2013: 2nd ODIP Workshop
  9. 7 December 2013 - August 2014
  10. 5 - 8 August 2014: 3rd ODIP Workshop
  11. 18 November 2014: CDI and CSR metadata standards submitted to ODSBP
  12. 26 November 2014: EU review
  13. 15 March 2015: proposal for ODIP II successful
  14. 20 - 23 April 2015: 4th ODIP Workshop
  15. 20 April 2015: Controlled Vocabularies submitted to ODSBP
  16. 21 May 2015: SeaDataNet NetCDF Format submitted to ODSBP
  17. 28 September - 1 October 2015: 5th ODIP Workshop (=1st ODIP II Workshop)
  18. 5 - 30 October 2015: reporting results of prototypes and impact assessments
  19. November 2015 - May 2016: progressing prototypes and preparing for the 6th ODIP Workshop
  20. 2 - 5 May 2016: 6th ODIP Workshop (= 2nd ODIP II Workshop)
  21. October 2016: Workplans for expanding existing ODIP Prototypes specified
  22. November 2016: Good progress with developing ODIP Prototypes
  23. 7 - 10 March 2017: 7th ODIP Workshop (= 3rd ODIP II Workshop)
  24. March - August 2017: Workplans for 2 extra ODIP Prototypes specified
  25. 2- 5 October 2017: 8th ODIP Workshop (= 4th ODIP II Workshop)
  26. Good progress till October 2017 as reported at the 4th ODIP II Workshop

1st October 2012: Project start up
The ODIP project officially started on the 1st October 2012 and is planned to run for 36 Months until October 2015.

20 November 2012: Kick-off meeting
The project kick-off meeting took place 20 November 2012 in London, United Kingdom. The meeting was used to introduce partners from the 3 regions (Europe, USA and Australia) and UNESCO IOC-IODE and to brainstorm about planning the 1st Workshop. Moreover a matrix was prepared of possible topics for discussion in the coming ODIP Workshops.

6 December 2012: splinter meeting at AGU
A further meeting, involving more USA organisations, took place as splinter meeting during AGU 2012 in San Francisco, USA, 6 December 2012. This meeting contributed to further brainstorming about the approach to follow for the 1st ODIP Workshop

December 2012 - February 2013: Preparation of the 1st ODIP Workshop
Following AGU and the topics selection partners were asked to nominate experts on the topics for each region (Europe, USA, and Australia). These experts were tasked with gathering and publishing on the ODIP website documentation on their expert topic as preparatory material for Workshop participants. Moreover they were asked to prepare presentations to be given at the 1st Workshop that provided the basis for the discussions on possible common standards and interoperability solutions. The resulting agenda for the 1st Workshop is available in the Agenda section of the website, while the documentation for the 6 topics as listed for the 1st Workshop is available in the Workshop section of the website.

25 - 28 February 2013: 1st ODIP Workshop
The actual 1st ODIP Workshop took place 25th - 28th February 2013 in Oostende, Belgium at the IODE Programme Office. More than 40 persons participated in a lively discussion and brainstorming, most attending in Ostend and a number also by Webex. The discussion and brainstorming has taken place around the first 6 topics as prioritised after the London Kick-off meeting.

Extensive minutes have been made which report on the organisation, participation and outcomes of the 1st ODIP Workshop. Users can also check the presentations given during the 1st Workshop by video's and downloadable presentations. These are made available through the IODE portal.

The minutes conclude with a comprehensive list of proposed actions that resulted from the discussions both during the plenary and the concurrent break-out sessions. These actions will be implemented through the development of a number of prototype projects as part of the activities of work package 3. The actual development of the prototypes will be a joint activity undertaken by ODIP partners that will leverage on the activities of current regional projects and initiatives such as SeaDataNet, Eurofleets, EMODnet (EU), IMOS (Australia) and R2R, US NODC, IOOS (USA)

February - December 2013: ODIP Prototypes Projects-1st Workshop follow up activities 
In July 2013 a proposal has been drafted for a first set of ODIP Prototype projects. It gives a formulation of each of the proposed Prototype projects, indicates which identified actions from the long list are relevant, with some overlaps, and indicates which regional projects and initiatives will contribute. The draft also gives a plan for further organisation and implementation of the proposed ODIP Prototype projects.

The draft proposal has been considered by the ODIP Steering Committee and during the ODIP project meeting at the IMDIS Conference in Lucca - Italy, 23 September 2013 it was accepted. The proposal is now public and serves as basis for the coming ODIP activities.

The 3 ODIP Prototype projects are formulated as follows:

  • ODIP 1: Establishing interoperability between SeaDataNet CDI, US NODC, and IMOS  MCP Data Discovery and Access services, making use of a brokerage service, towards  interacting with the IODE-ODP en GEOSS portals 
  • ODIP 2: Establishing deployment and interoperability between Cruise Summary reporting systems in Europe, US and Australia, making use of GeoNetWork, towards interacting  with the POGO portal
  • ODIP 3: Establishing a prototype for a Sensor Observation Service (SOS) and formulating common standards for SensorML and O&M profiles for selected sensors (SWE), installed at vessels and in real-time monitoring systems

Activities were undertaken for organising the proposed subgroups per Prototype project and starting the development process. The subgroups provided input for the 2nd ODIP Workshop agenda.

27 November 2013: EU Review
The review with 3 external reviewers and the EU Project officer took place in Brussels, Belgium at EU offices. The EU core group presented the ODIP scope and its progress up-to-date. The evaluation was successful.    

3 - 6 December 2013: 2nd ODIP Workshop
The 2nd ODIP Workshop took place in La Jolla, USA at the Scripps Institution of Oceanography (SIO). The leaders of the ODIP Prototype projects each led a section on progress made. This included several presentations of regional components and brainstorming about the overall approach and planning. Two extra sessions took place dedicated to 'vocabularies' and 'data publishing and citation', also with presentations and brainstorming.

Extensive minutes have been made which report on the organisation, participation, proceedings and outcomes of the 2nd ODIP Workshop. The final version incorporates all feedback received from many colleagues and it has been signed off by the ODIP coordinator. Users can also download all the presentations and audio recordngs. These are made available through the IODE portal.

7 December 2013 - August 2014
ODIP Prototype project leaders have finalised their Workplans which are described in the Deliverable D3.2. The associated groups are underway with the further development and implementation of the 3 ODIP Prototype projects. A progress check has taken place during EGU 2014 in May 2014. The presentations per ODIP Prototype project are available in the Promotion section of the website. Also at EGU 2014 a joint Workshop together with the EU COOPEUS project has been  organised.

5 - 8 August 2014: 3rd ODIP Workshop
The 3rd ODIP Workshop took place from 5th to the 8th August 2014 in Townsville, Australia, hosted by the Australian Institute for Marine Science (AIMS). The programme was dedicated to monitoring the progress of the 3 ODIP Prototype activities and further discussing Data Publishing & Citation, Vocabularies, and Person Identifiers. The Workshop was  joined by oceanographic data management experts from the 3 regions (Europe, USA and Australia) and IOC-IODE. 

The presentations are available from the IODE website. Also extensive minutes have been prepared, including amendments by participants. The minutes are awaiting final sign-off by the coordinator.

18 November 2014: CDI and CSR metadata standards submitted to ODSBP
On behalf of the ODIP and SeaDataNet projects 2 proposals entitled “SeaDataNet Common Data Index (CDI) Metadata data model and XML encoding” and “SeaDataNet Cruise Summary Report (CSR) Metadata data model and XML encoding” have been submitted on 18 November 2014 to the IODE  Ocean Data Standards and Best Practices Project (ODSBP). The related documents can be downloaded:

26 November 2014: EU Review
The review with 3 external reviewers and the EU Project officer took place in Brussels, Belgium at EU offices. The EU core group presented the ODIP scope and its progress up-to-date. The evaluation was successful.  

15 March 2015: proposal for ODIP II successful
The EU reviewers have given a positive review, 14.5 out of max 15 points, to the ODIP II proposal for continuation and extension of the ODIP project. Inspired by the success of the ongoing ODIP activities, the partnership of ODIP 2 includes more European and international organisations (from USA, Australia and global) and associated data management infrastructures. Moreover the scope of topics will be enlarged by including also marine biological data management. This outcome provides a seamless continuation of the ODIP activities. The preparations for the new grant agreement were concluded by having it signed by the EU and all European partners. Officially ODIP II runs from 1st April 2015 till 31st March 2018.

20 - 23 April 2015: 4th ODIP Workshop
The 4th ODIP Workshop took place from 20th to the 23rd April 2015 in Liverpool, United Kingdom, hosted by the British Oceanographic Data Centre (BODC). The programme was dedicated to monitoring the progress of the 3 ODIP Prototype activities and further discussing Data Ingestion, Data Publishing & Citation, Vocabularies, and Person Identifiers. The Workshop was  joined by oceanographic data management experts from the 3 regions (Europe, USA and Australia) and IOC-IODE. 

The presentations are available from the IODE website. Extensive minutes are available.

20 April 2015: Controlled Vocabularies submitted to ODSBP
On behalf of the ODIP and SeaDataNet projects a proposal entitled "SeaDataNet Controlled Vocabularies" has been submitted on 20 April 2015 to the IODE  Ocean Data Standards and Best Practices Project (ODSBP). The related documents can be downloaded:

Controlled vocabularies - proposal

21 May 2015: SeaDataNet NetCDF Format submitted to ODSBP
On behalf of the ODIP and SeaDataNet projects a proposal entitled "SeaDataNet NetCDF (CF) data transport model for Marine and Oceanographic Datasets " has been submitted on 21 May 2015 to the IODE  Ocean Data Standards and Best Practices Project (ODSBP). The related documents can be downloaded:

SeaDataNet NetCDF format - proposal

28 September - 1 October 2015: 5th ODIP Workshop (= 1 st ODIP II Workshop)
The 5th ODIP Workshop (= 1st Workshop of the successor ODIP II project) took place from 29th September to the 1st October 2015 in Paris, France, with logistic support of IFREMER. The programme was dedicated to kick-off of the ODIP II project involving more partners, reviewing the results and possible follow-up of the 3 ODIP Prototype activities, updates on Data Publishing & Citation, Vocabularies, and Person Identifiers, introducing Model Workflows and Big Data as new subjects, and brainstorming on additional topics for ODIP II discussions and prototype developments. The Workshop was  joined by oceanographic data management experts from the 3 regions (Europe, USA and Australia) and IOC-IODE. 

The presentations are available from the IODE website. Extensive minutes are available.

5 - 30 October 2015: reporting results of prototypes and impact assessments in 1st ODIP project
The activities in the three ODIP protype developments have resulted in a number of highly significant results:

  • the GEOSS portal and the IODE-ODP portal have been populated with data collection entries as harvested and brokered from the three regional SeaDataNet (Europe), US NODC (USA) and AODN (Australia) data discovery and access services as a result of ODIP 1;
  • the SeaDataNet Cruise Summary Report (CSR) metadata profile and schema have been adopted by R2R (USA) and NMF (Australia) within the framework of ODIP 2, leading to the population of the POGO CSR catalogue with an initial set of CSRs for US Research Vessels and a first CSR entry for Australia;
  • ODIP 3 has resulted in a closer cooperation and alignment between multiple European, Australian and USA projects on SWE for the marine domain, leading to synergies, initiation and adoption of common vocabularies, and a basis for continued activity in the ODIP II follow-on project.

These results and related activities have been reported in detail and with illustrations where relevant, in deliverable D3.4 'Results and conclusions from Prototype Analyses'.

In addition to the prototype developments, three cross-cutting themes were included as recurring agenda items for the ODIP workshops starting with the second workshop. These concern:

  • Vocabularies
  • Data Publishing and Citation
  • Unique persistent identifiers for researchers

These themes are highly relevant for data management in general and in particular for harmonising metadata and data descriptions and achieving semantic interoperability between different regional systems through mappings and ontologies as applied and demonstrated in the three ODIP prototype developments. In addition the topics of data publishing/citation and the assigning of persistent identifiers to data sets are very relevant for encouraging researchers to release and publish their data sets in scientific literature and obtaining academic credit by means of citations.

The major results and progress made have been summarised and reported in deliverable D3.3 ‘Cross-cutting themes’.

The ODIP workshops and prototype developments as part of the first ODIP project have provided an insight into possible common standards and/or interoperability solutions. However implementing these solutions in practice might have significant implications for the operational systems. Their adoption may require modifications throughout the existing system from the portal to the distributed data providers. The deliverable D4.2 “Final strategic analysis” reports on the analyses conducted to identify the possible impacts and potential solutions for the adoption of the prototype interoperability solutions and the associated standards by the regional data infrastructures. The report also includes a proposed action plan to address issues that have been identified by the impact analysis.

The ODIP activities are continued as part of the ODIP II contract.

November 2015 - May 2016: prototypes progress and preparations for the 6th ODIP Workshop
Further progress has been made with the ODIP prototypes, shaping ideas for expanding these prototypes as well as with the cross-cutting topics. Preparations have been made for the 6th ODIP Workshop.

2 - 5 May 2016: 6th ODIP Workshop (= 2nd ODIP II Workshop)

The 6th ODIP Workshop (= 2nd Workshop of the successor ODIP II project) took place from 2nd to the 5th of May 2016 in Boulder, USA, with logistic support of UNCAR (UNIDATA). The programme was dedicated to agreeing on the terms oif reference for the expansion of the 3 existing ODIP prototypes, brainstorming on any additional prototypes, updates of the cross-cutting topics Data Publishing & Citation, Vocabularies, and Person Identifiers, and exploring new subjects such as biological data management and big data. The Workshop was joined by oceanographic data management experts from the 3 original regions (Europe, USA and Australia) and IOC-IODE, while now also Canada joined. 

The presentations are available from the IODE website. Extensive minutes are available in draft.

October 2016: Workplans for expanding existing ODIP Prototypes specified

At the 6th ODIP Workshop it was discussed and agreed to expand the existing three ODIP Prototypes. As a follow-up specifications and work plans have been formulated between the ODIP Technical Coordinator and the new Prototype leaders (MARIS, BSH and 52North) and these have been documented in the Deliverable D3.1.

November 2016: Good progress with developing ODIP Prototypes

Considerable activities have taken place by the prototype leaders MARIS, BSH and 52North for expanding the existing three ODIP Prototypes as well as for the cross-cutting topics. The progress has been documented in the Deliverable D3.3.

7 - 10 March 2017: 7th ODIP Workshop (= 3rd ODIP II Workshop)

The 7th ODIP Workshop (= 3rd Workshop of the successor ODIP II project) took place from 7th to the 10th of March 2017 in Hobart, Australia, with logistic support of UTAS and CSIRO. The programme was dedicated to presenting and discussing progress on the 3 earlier agreed ODIP prototypes, updates of the cross-cutting topics on Vocabularies and Linked Data, and further exploring biological data management, big data and Virtual Research Environments (VRE). The Workshop was joined by oceanographic data management experts from the 3 regions (Europe, USA and Australia) and IOC-IODE.

The presentations are available from the IODE website. Extensive minutes have been prepared and are available in final draft.

March - August 2017: Workplans for 2 extra ODIP Prototypes specified

During the 2nd ODIP II Workshop brainstorming started concerning the formulation of additional prototypes, such as focus on i) the concept of collaborative workspaces on the cloud for functions such as computing, analyzing, accessing data, and visualization, and ii) a possible prototype for marine biology. At the 3rd ODIP II Workshop several ongoing virtual research laboratories projects were presented and following the brainstorming a new ODIP II prototype was defined and agreed as:

  • ODIP II prototype 4: the Digital Playground.

The marine biology community in ODIP II also continued their brainstorming and have agreed on the following new ODIP II prototype:

  • ODIP II prototype 5: integration of data management for biological and physicochemical marine data.

The definitions and workplans for both extra ODIP II Prototype projects are documented in the ODIP II Deliverable D3.2 (DRAFT). This also includes an extract of the examples and considerations that were presented and discussed at the Workshops concerning big data, cloud computing and collaborative workspaces as well as concerning biological data management. The 2 extra prototype projects have already been put into motion and will be further implemented in the remaining ODIP II project duration.

2- 5 October 2017: 8th ODIP Workshop (= 4th ODIP II Workshop)

The 8th ODIP Workshop (= 4th Workshop of the successor ODIP II project) took place from 2nd to the 5th of October 2017 in Galway, Ireland, with logistic support of the Marine Institute. Great progress was reported on all the 5 ODIP prototypes with clear actions defined for the remaining project period. There were also major steps presented and discussed for the cross-cutting topics on Vocabularies and Linked Data. The Workshop was joined by oceanographic data management experts from the 3 regions (Europe, USA and Australia) and IOC-IODE.

The presentations are available at the IODE website

Good progress till October 2017 as reported at the 4th ODIP II Workshop 

In the period between the third and the recent fourth ODIP II Workshops considerable progress has been made with all ODIP II prototypes:

ODIP II Prototype 1+: CNR together with BODC and MARIS has developed an extended prototype portal for its Brokerage Service. The common broker metadata profile has been expanded with extra attributes for e.g. platforms, instruments, and parameters to distinct the current keywords attribute, and with extra attributes for including types of services, such as WMS, WFS, and others, their versions and addresses. Semantic brokerage has been added by interaction with a 'Rosetta stone' mapping service, developed by BODC, that allows to translate between different vocabularies used at the source providers for the given data collections. Therefore the harvested metadata collections from the 3 portals have been analysed for their use of controlled vocabularies and mappings have been initiated between comparable vocabularies for the indexed terms of each. The initial mapping, supported by the Rosetta Stone service, is used in the broker prototype portal. The prototype demonstrates well the added functionality which is considered very relevant for adoption for GEOSS, SeaDataNet and possibly for IODE. The demonstrator is available at: http://odip-prototype.essi-lab.eu/broker/odip/search

Further work is planned in the last period for:

  • Completing the mapping between the vocabularies for all indexed terms;
  • Changing the current US NCEI portal for the new NCEI portal once it has been launched officially.
  • Exploring use of the extra services such as WMS and WFS, if available, to display and retrieve data sets at granule level.

ODIP II Prototype 2+: Further population has taken place of the CSR directory as managed by BSH through European providers, R2R (USA), and some entries from Australia. IOC-IODE has enquired whether IODE could adopt the CSR scheme for its members as a service at the IODE portal. This would provide opportunity for CSR entries from multiple other regions and countries. This will be worked out in the coming months.

Great progress has been made with mapping the CSR to a Linked Data pattern. Due to the highly specialised nature of the information included within a CSR, there does not exist a standard Linked Data ontology to map these data to. However in a cooperation with US projects “R2R” and “GeoLink” and the EU project “SeaDataCloud” a CSR pattern has been formulated by Marine Institute (Ireland) and LDEO (USA). Next steps will be setting up a CSR SPARQL service by BSH in order to publish the CSRs as RDF resources from a triple-store database. This will largely improve the machine-to-machine interoperability and findability in search engines. Moreover it will facilitate enriching metadata profiles of related resources.

ODIP II Prototype 3+: The activities focused on the further development of Marine Sensor Web Enablement (SWE) profiles for harmonising the usage of Sensor Web technology across ocean projects, organisations, and observation networks. The current result of the profile developments is documented on a dedicated Github which will be migrated to an ODIP-managed repository (https://github.com/ODIP/MarineProfilesForSWE).

Specific emphasis was put on the development of a harmonised approach for describing sensor outputs and interfaces. This work was carried out in close cooperation with projects such as SeaDataCloud and NeXOS. Also the work on a common approach and encoding of SWE messages relying on controlled vocabularies was continued. This comprised especially the work of BODC on vocabularies needed for SensorML as well as Observations and Measurements (O&M) documents. These developments are also an important foundation for facilitating the publication of Sensor Web data sources into SWE-based data infrastructures. An example for this are the developments of the SeaDataCloud project which will result in a SWE Ingestion Service that is capable of harvesting different kinds of marine observation data sources.

In cooperation with the NeXOS and FixO3 projects, the development of the Helgoland Sensor Web viewer was continued by 52°North. The achievements in this reporting period cover mainly the visualisation of profile observations collected by stationary as well as mobile sensors.

Also the link to Internet of Things technologies was further investigated. For this purpose, 52°North is currently working on an adapter that allows to link MQTT data streams to Sensor Web servers. For testing and showcasing this approach, a data stream of the Marine Institute (Ireland) will be used.

The installation of Sensor Web servers was continued by ODIP partners. Examples are Sensor Web components hosted by BODC and the integration of the Oceanotron SOS server of Ifremer into the Helgoland Sensor Web viewer.

Finally, several partners such as CNR, Ifremer, and 52°North have continued their work on SWE Metadata (SensorML) editors focusing on improving their usability in different application contexts.
In the upcoming period the focus will be on the finalisation of the marine SWE profiles, on integrating further Sensor Web resources into showcases, and improving the connection of Sensor Web data sources into SWE infrastructures (e.g. SeaDataCloud SWE Ingestion Service).

ODIP II Prototype 4: This prototype was initiated at the third ODIP II Workshop. It is approached by reviewing relevant existing projects and initiatives through presentations and discussions at the ODIP II Workshops, followed by further analyses, looking for common developments as well as specific promising solutions. So far analysis took place of the following cloud and VRE projects:

  • EVER-EST (Europe)
  • SeaDataCloud – VRE development (Europe)
  • Climate Information Portal for Copernicus (CLIPC) (Europe)
  • Nectar Research Cloud (Australia)
  • Australian Marine Sciences Cloud (Australia)
  • Marine Virtual Laboratory (MARVL) (Australia):
  • eReefs (Australia)
  • Australian Urban Research Infrastructure Network (AURIN) (Australia)
  • Virtual Geophysics Laboratory project (Australia)

Most examples are from Australia which is quite ahead of others in this respect. The first conclusions from the review are:

  • Mostly the same expectations with respect to community building, data sharing, processing and analysis tools
  • Authorisation/Authentication layer both in portal layer as well as on top of service layer
  • API’s for each (processing) service
  • Communication standards are key to success
  • Front end applications are various: From self created workflows, to VRE virtual labs, to dedicated user interfaces. But all run on same set of services and data.

Synergy will take place with the VRE developments in the EU SeaDataCloud project which undertakes a systematic analysis for the architecture, thereby learning from the ODIP examples. The use case for SeaDataCloud focuses on a workflow generating T-S Climatology, both menu driven and by i-notebook. The architecture needs to be capable to carry also other workflows, such as for EMODnet lots on chemistry and bathymetry, for which also experiences and contributions of the international ODIP partners are relevant.

ODIP II Prototype 5: this prototype project was officially formulated recently and only some initial progress has been made. 

Tools

Contact
Extranet
Sitemap
Home

This project has received funding from the European Union's Seventh Framework Programme for research, technological development and demonstration under grant agreement no [312492] and continued funding from the European Union's HORIZON 2020 Framework Programme for Research and Innovation under grant agreement no [654310].