-
Notifications
You must be signed in to change notification settings - Fork 490
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dataverse: script to verify WorldMap links are valid #3480
Comments
We discussed this in the Sprint Planning meeting yesterday. We decided on the following approach:
|
Question in gist for tomorrow: https://gist.github.com/raprasad/b69dcd0549e78837cb29b90e07244b7b |
I'd like to point out that from the WorldMap side, when you delete a map (WorldMap calls it a "layer"), you get no indication that you're leaving cruft behind in Dataverse. This is what the WorldMap user sees: The cruft left behind in Dataverse is the "Explore" button. When anyone comes along and clicks the Explore button... ... they see "Page Not Found" on the WorldMap side (Safari hides the URL but it's http://worldmap.harvard.edu/data/geonode:starbucks_u_gq ): This issue is about deleting the cruft from Dataverse, specifically the |
I just opened cga-harvard/geonode#214 asking for the WorldMap "delete" interface to say something like, "this layer is in use by a dataset with a published DOI." |
Added lastverifiedstatus and lastverifiedtime to maplayermetadata.
@kcondon also, please note that scripts/database/upgrades/upgrade_v4.6.1_to_v4.6.2.sql has been updated |
After deleting map on Worldmap side, there is stale data on Dataverse, ie. the explore button, but also stale data on GeoConnect. This ticket does address the Dataverse stale data but trying to remap the deleted map from the Dataverse side fails for shape files and has a workaround for tabular data. |
- ignore WorldMapInfo already in db - avoids error where info deleted from WM and DV but still in geoconnect
@kcondon I put in a fix for stale tabular file data. The updated geoconnect code is available via dvn-build. note: they're in the process of restarting worldmap which is down right now. (May look at shapefiles depending on worldmap availability and time left with other issues) |
Geoconnect pull request: IQSS/geoconnect#125 |
I just reviewed IQSS/geoconnect#125 and it looks good so I'm sending this issue to QA at https://waffle.io/IQSS/dataverse @kcondon I'd say you can go ahead and merge pull request #3721 into the Dataverse code base because the branch ( |
@pdurbin I'd still like to test it again, thanks for the heads up. |
Dataset metadata will contain links to WorldMap layers.
Verify that the WorldMap links are valid--e.g., that the layers still exist.
Run this check via GeoConnect:
MapLayerMetadata
objects. Started in f0cec55.Run reverse check. For Layers with DataverseInfo objects, make sure Dataverse still has the file/dataset. Delete the WorldMap DataverseInfo object but not the Layer itself.Notes
The text was updated successfully, but these errors were encountered: