forked from IQSS/dataverse
-
Notifications
You must be signed in to change notification settings - Fork 3
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge branch 'develop' into signposting
- Loading branch information
Showing
184 changed files
with
3,976 additions
and
2,714 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,29 @@ | ||
## Release Highlights | ||
|
||
### A new file access API | ||
|
||
A new api offers *crawlable* access view of the folders and files within a datset: | ||
|
||
``` | ||
/api/datasets/<dataset id>/dirindex/ | ||
``` | ||
|
||
will output a simple html listing, based on the standard Apache | ||
directory index, with Access API download links for individual files, | ||
and recursive calls to the API above for sub-folders. (See the | ||
documentation entry in the guides for more information). | ||
|
||
Using this API, ``wget --recursive`` (or similar crawling client) can | ||
be used to download all the files in a dataset, preserving the file | ||
names and folder structure; without having to use the download-as-zip | ||
API. In addition to being faster (zipping is a relatively | ||
resource-intensive operation on the server side), this process can be | ||
restarted if interrupted (with ``wget --continue`` or equivalent) - | ||
unlike zipped multi-file downloads that always have to start from the | ||
beginning. | ||
|
||
On a system that uses S3 with download redirects, the individual file | ||
downloads will be handled by S3 directly, without having to be proxied | ||
through the Dataverse application. | ||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,11 @@ | ||
## Notes to Admins | ||
|
||
Beginning in Dataverse Software 4.10, the size of the saved original file (for an ingested tabular datafile) was stored in the database. For files added before this change, we provide an API that retrieves and permanently stores the sizes for any already existing saved originals. See [Datafile Integrity API](https://guides.dataverse.org/en/5.4/api/native-api.html#datafile-integrity) for more information. | ||
|
||
This was documented as a step in previous release notes, but we are noting it in these release notes to give it more visibility. | ||
|
||
## Upgrade Instructions | ||
|
||
X./ Retroactively store original file size | ||
|
||
Use the [Datafile Integrity API](https://guides.dataverse.org/en/5.4/api/native-api.html#datafile-integrity) to ensure that the sizes of all original files are stored in the database. |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,22 @@ | ||
### Solr Update | ||
|
||
With this release we upgrade to the latest available stable release in the Solr 8.x branch. We recommend a fresh installation of Solr 8.8.1 (the index will be empty) | ||
followed by an "index all". | ||
|
||
Before you start the "index all", Dataverse will appear to be empty because | ||
the search results come from Solr. As indexing progresses, partial results will | ||
appear until indexing is complete. | ||
|
||
|
||
See http://guides.dataverse.org/installation/prerequisites.html#installing-solr | ||
|
||
[for the additional upgrade steps section] | ||
|
||
Run the script updateSchemaMDB.sh to generate updated solr schema files and preserve any other custom fields in your Solr configuration. | ||
For example: (modify the path names as needed) | ||
cd /usr/local/solr-8.8.1/server/solr/collection1/conf | ||
wget https://github.com/IQSS/dataverse/releases/download/v5.4/updateSchemaMDB.sh | ||
chmod +x updateSchemaMDB.sh | ||
./updateSchemaMDB.sh -t . | ||
|
||
See http://guides.dataverse.org/en/5.4/admin/metadatacustomization.html?highlight=updateschemamdb for more information. |
Oops, something went wrong.