Downloading tags as separate files (for Hydrus)

[DonaldTsang]

Is it possible to name the gallery file by md5 while putting the tags in a separate txt file with the same md5 hash? Bonus points if that is a default flag in gallery-dl.
that will be used for importing in https://github.com/hydrusnetwork/hydrus

[mikf]

Filenames can be specified by setting a custom filename format (e.g. "{md5}.{extension}").

With 38500ad it is now possible to write all file-metadata to a separate .json file, although that would currently be all metadata, not just tags. I really don't know what exactly is needed to make it Hydrus-compatible, so please tell me.

Also: an example config snippet for danbooru that enables this would look something like the following:

"danbooru": {
    "filename": "{md5}.{extension}",
    "postprocessors": [{"name": "metadata"}]
}

[DonaldTsang]

Cross referencing: Bionus/imgbrd-grabber#1492
(with further reference in Bionus/imgbrd-grabber#1001 and Bionus/imgbrd-grabber#588 and Bionus/imgbrd-grabber#573)

It is best to make it one tag per newline, and one txt file per image (\n)

[rachmadaniHaryono]

alternative to this is using server framework like in #146. it just need a function to convert gallery-dl metadata to hydrus compatible metadata

[DonaldTsang]

@rachmadaniHaryono could you explain this further? Since Hydrus's API hasn't been released yet

[rachmadaniHaryono]

basically create a api server, which will return json data from url input. this will make gallery-dl act as parser for hydrus.

[mikf]

I've added a mode option to the metadata post processor to tell it how and what kind of metadata it should write. To get a separate .txt file with tags, you should use "mode": "tags":

"danbooru": {
    "filename": "{md5}.{extension}",
    "postprocessors": [{
        "name": "metadata",
        "mode": "tags"
    }]
}

This will create a {md5}.jpg.txt file for each image, filled with one tag per line.

[DonaldTsang]

@mikf thanks for the option, is it possible to add a command flag for that (maybe -hydrus or -text-tag)?

[mikf]

@DonaldTsang --write-tags

[DonaldTsang]

@mikf thanks, what about in a python library import (import gallery-dl)?

[mikf]

You need to somehow attach a MetadataPP object to your job's post processors.

One way is to use the config module to set an appropriate postprocessors option before constructing a job object:

from gallery_dl import config, job

config.set(("postprocessors",), [{
    "name": "metadata",
    "mode": "tags",
}])

j = job.DownloadJob("URL")
j.run()

Or you can construct one yourself before calling job.run():

from gallery_dl import job
from gallery_dl.postprocessor import metadata

m = metadata.MetadataPP(None, {"mode": "tags"})

j = job.DownloadJob("URL")
j.postprocessors = [m]
j.run()