Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem: We haven't an in-built mechanism to verify an AIP's structure or compliance #993

Closed
5 tasks
ross-spencer opened this issue Nov 15, 2019 · 1 comment
Labels
Status: invalid A reported issue that isn't reproduceable or was caused by user error/improper installation/etc.

Comments

@ross-spencer
Copy link
Contributor

ross-spencer commented Nov 15, 2019

Please describe the problem you'd like to be solved

Artefactual tests an AIP structure extensively in the lead-up to a release. We have relied on the PREMIS in metadata validator up until recently. But that ticket shows the validator is behind as we start using newer standards.

Archivematica has mechanism to validate a bag, but a bag once created can have pretty much any structure within the bag 'envelope'. If something happens to the folder structure between moves, and an AIP is still created then it is difficult to spot the anomaly.

Archivematica doesn't have an inbuilt mechanism to perhaps do a handful of things:

  • Validate the AIP METS.
  • Validate the directory and file structure, e.g. if the directory and files in the METS still exist in the AIP.

Describe the solution you'd like to see implemented

Create a new microservice group with various AIP validation tasks. Starting with a validate METS task, possibly using metsrw's validation mechanism. Then we can build out to detect structure/layout anomalies.

This ticket could be an epic for further related tasks.

Describe alternatives you've considered

Leaving things as they are is always an option.

Additional context

We have documentation in the works around AIP structure, and we have a number of related tasks, some of which are starting to realize this capability:

And there are related issues:

This ticket could be an epic for further related tasks.


For Artefactual use:

Before you close this issue, you must check off the following:

  • All pull requests related to this issue are properly linked
  • All pull requests related to this issue have been merged
  • A testing plan for this issue has been implemented and passed (testing plan information should be included in the issue body or comments)
  • Documentation regarding this issue has been written and merged
  • Details about this issue have been added to the release notes
@ross-spencer ross-spencer added the Status: invalid A reported issue that isn't reproduceable or was caused by user error/improper installation/etc. label Dec 3, 2019
@ross-spencer
Copy link
Contributor Author

Closing as this is another non-issue from me I am afraid. Well, at least it only has a minimal potential to ever happen, i.e. an AIP with no files in the objects folder.

The verify AIP task runs on all AIPs created by Archivematica and looks to verify the checksums generated by the service via the database and the objects on disk here. The bag structure should be valid and the checksums should match.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Status: invalid A reported issue that isn't reproduceable or was caused by user error/improper installation/etc.
Projects
None yet
Development

No branches or pull requests

1 participant