Welcome to the GitHub Repository of the EuroSea Data Portal. The EuroSea Data Portal is a project that aims at providing real-time oceanographic data and forecasts at the Deenish Island and El Campello monitoring sites. The website can be accessed at https://eurosea.marine.ie.
This is a EuroSea partnership between the Marine Institute, the Spanish National Research Council (CSIC), Mowi Ireland (formerly Marine Harvest) and Xylem / Aanderaa Data Instruments. This part of the Marine Observatory work is being developed within the WP6 Ocean Health Demonstrator of the EuroSea project “Improving and integrating the European Ocean Observing and Forecasting System”. This project is funded by the EU Horizon 2020 research and innovation programme under grant agreement No 862626.
These instructions have been tested on Ubuntu 18.04.6 LTS (Bionic Beaver). First, download the code with:
git clone https://github.com/IrishMarineInstitute/EuroSea.git
The code is structured in multiple Docker containers that communicate with each other through a shared volume. Create a Docker volume to communicate the containers:
docker volume create shared-data
The next step is to initialize each container. crontab is used to schedule tasks and ensure that the website updates on a regular basis. The containers work independently, so there is no need to initialize them in a specific order.
This container is set to run every ten minutes to download the in-situ data from the EuroSea monitoring station at Deenish Island. In addition, it subsets the latest data for the number of days specified in the configuration file. All this data is wrapped in a BUOY.pkl file that is updated every ten minutes, and later accessed by the WEBAPP container through the shared volume. Historical data starting from the time the buoy started data transmission is compiled to address any request from the Historical Data Portal.
Navigate to the Deenish Island - SITE container
cd EuroSea/containers/Deenish-Island/site
Build image
docker build -t deenish-site:latest .
Start container with data sharing to communicate with other containers.
docker run -d -v shared-data:/data --name deenish-site deenish-site:latest
The task will run hourly at the time specified in the crontab file. Once it is finished, model forecasts are exported to a pickle file /data/pkl/MODEL.pkl. The website will read the model forecasts from this file.
This container is set to run hourly to download the model forecasts from CMEMS and ECMWF. This data is wrapped in a MODEL.pkl file that is updated every hour and later accessed by the WEBAPP container through the shared volume.
Navigate to the Deenish Island - MODEL container
cd EuroSea/containers/Deenish-Island/model
Build image
docker build -t deenish-model:latest .
Start container with data sharing to communicate with other containers.
docker run -d -v shared-data:/data --name deenish-model deenish-model:latest
The task will run hourly at the time specified in the crontab file. Once it is finished, model forecasts are exported to a pickle file /data/pkl/MODEL.pkl. The website will read the model forecasts from this file.
This container is set to run hourly to download the latest seawater chlorophyll-a concentration observations in the Southwest of Ireland waters. The chlorophyll-a concentration is provided by the Atlantic Ocean Colour Bio-Geo-Chemical L4 Satellite Observations (https://doi.org/10.48670/moi-00288).
In addition, chlorophyll-a anomaly is determined as the difference between the actual chlorophyll-a concentration and a 60-day running median, ending two weeks before the current image (Tomlinson et al., 2004).
This application is set to run hourly to make sure that the website updates as soon as a new daily layer is released by the Copernicus Marine Service. This application also creates the figures that are later accessed by the WEBAPP container through the shared volume.
Navigate to the Deenish Island - CHL container
cd EuroSea/containers/Deenish-Island/chl
Build image
docker build -t chlorophyll:latest .
Start container with data sharing to communicate with other containers.
docker run -d -v shared-data:/data --name chlorophyll chlorophyll:latest
The task will run hourly at the time specified in the crontab file. Once it is finished, chlorophyll-a NetCDF files are downloaded to the /data/CHL folder, and CHL figures are exported as Plotly JSON strings to a pickle file /data/pkl/CHL.pkl. The website will read the CHL figures from this file.
This container is set to run hourly to download the latest wave height forecasts from Copernicus.
This application is set to run hourly to make sure that the website updates as soon as new forecasts are released by the Copernicus Marine Service. This application also creates a Plotly JSON figure that is later accessed by the WEBAPP container through the shared volume.
Navigate to the Deenish Island - WAVES container
cd EuroSea/containers/Deenish-Island/waves
Build image
docker build -t waves:latest .
Start container with data sharing to communicate with other containers.
docker run -d -v shared-data:/data --name waves waves:latest
The task will run hourly at the time specified in the crontab file. Once it is finished, wave forecasts are exported to a pickle file /data/pkl/WAVES.pkl. The website will take the wave forecast figure (exported as a Plotly JSON string) from this file.
The containers for El Campello are the same as those for Deenish Island and work identically.
These containers were created outside the EuroSea project, to collaborate with Cuan Beo in a project to deploy QR codes at different locations in Galway Bay. These sites are: Renville, Ballinacourty, Blackweir, Cave, Killeenaran, Tarrea, Kinvara, Crushoa, Parkmore, Traught, Newtownlynch, New Quay, Flaggy Shore, Bellharbour, Bishop's Quarter, Ballyvaughan and Gleninagh. When scanning the QR codes, real-time information and forecasts from the Galway Bay and Connemara ROMS hydrodynamic models are shown on screen. These containers read the operational data from the Marine Institute THREDDS server and produce the information shown on the phone. The instructions below are for the Galway Bay container, but they are the same for the Connemara container. The Connemara container was added to accommodate the request of a QR code at Gleninagh, which is outside of the Galway Bay model domain.
The config file contains the names and coordinates of the sites of interest. It is possible to add new sites or delete existing ones by modifying the config file. Navigate to the Galway Bay container
cd EuroSea/containers/Galway-Bay
Build image
docker build -t galway:latest .
Start container with data sharing to communicate with other containers.
docker run -d -v shared-data:/data --name galway galway:latest
The task will run every five minutes at the times specified in the crontab file. Once it is finished, model forecasts are exported to pickle files at /data/pkl/Galway-Bay/*.pkl. The website will take the model forecasts from these files (one .pkl file per site).
This container runs the website as a uwsgi-nginx-flask deployment. It loads the data files generated by the backend containers and provides the visualization on the website. It also provides access to the Historical Data requests for Deenish Island and El Campello. The Service Desk and Questionnaires are also generated in this container.
Navigate to the WEBAPP container
cd EuroSea/containers/webapp
Build image
docker build -t eurosea-webapp:latest .
Launch website
docker run -d --restart=on-failure --name=eurosea-webapp -p 80:80 -v /opt/cloudadm/multidocker/webapp:/app -v shared-data:/data eurosea.webapp:latest