Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Full filename image URLs don't always exist for Philomena boorus #6922

Closed
Twi-Hard opened this issue Feb 2, 2025 · 0 comments
Closed

Full filename image URLs don't always exist for Philomena boorus #6922

Twi-Hard opened this issue Feb 2, 2025 · 0 comments
Labels

Comments

@Twi-Hard
Copy link

Twi-Hard commented Feb 2, 2025

A very large number of images have failed to download because the long version of the view URL 404s

For example, this image:
https://manebooru.art/307071

gallery-dl tries to download this url:
https://static.manebooru.art/img/view/2020/10/27/307071__safe_artist-colon-kty159_character-colon-lyra+heartstrings_character-colon-pinkie+pie_#1_foam+finger_micro_question+mark.png.png

when it should probably be downloading the short url:
https://static.manebooru.art/img/view/2020/10/27/307071.png

Looking at the API, the short url is there under "representations"

{
    "faves": 1,
    "processed": true,
    "size": 115622,
    "animated": false,
    "thumbnails_generated": true,
    "tag_count": 27,
    "upvotes": 1,
    "height": 756,
    "score": 1,
    "aspect_ratio": 1.0582010582010581,
    "sha512_hash": "adcae1465a1cd9441da42bbb759f34071d2a7df5cc4fc90a338f8ba8810721077fef2a745205e8a78f6e7f8bf85504895dc51c1563c5b1368a313a081aff44b7",
    "uploader_id": 97,
    "id": 4038488,
    "name": "scraper-1738483178342051",
    "comment_count": 0,
    "duration": 0.04,
    "orig_sha512_hash": "adcae1465a1cd9441da42bbb759f34071d2a7df5cc4fc90a338f8ba8810721077fef2a745205e8a78f6e7f8bf85504895dc51c1563c5b1368a313a081aff44b7",
    "created_at": "2025-02-02T07:59:39",
    "mime_type": "image/png",
    "downvotes": 0,
    "intensities": {
        "ne": 3.948911,
        "nw": 16.559239,
        "se": 4.672884,
        "sw": 16.571172
    },
    "duplicate_of": null,
    "format": "png",
    "view_url": "https://static.manebooru.art/img/view/2025/2/2/4038488__safe_artist-colon-flamirasplitz_character-colon-fizzlepop+berrytwist_character-colon-hoo'far_character-colon-tempest+shadow_species-colon-pony_species-.png",
    "spoilered": false,
    "uploader": "Supermarine Spitfire",
    "tags": [
        "safe",
        "transparent background",
        "species:pony",
        "species:unicorn",
        "female",
        "simple background",
        "shipping",
        "smiling",
        "character:tempest shadow",
        "character:fizzlepop berrytwist",
        "g4",
        "floppy ears",
        "three quarter view",
        "male",
        "stallion",
        "open mouth",
        "straight",
        "missing cutie mark",
        "raised hoof",
        "crack shipping",
        "profile",
        "color palette",
        "my little pony: the movie (2017)",
        "open smile",
        "temp'far",
        "character:hoo'far",
        "artist:flamirasplitz"
    ],
    "wilson_score": 0.13097748173129398,
    "description": "From source (18 March 2019):\r\n[bq]*Hoo'far X Tempest Shadow [MLP Request]*[/bq]",
    "deletion_reason": null,
    "hidden_from_users": false,
    "representations": {
        "full": "https://static.manebooru.art/img/view/2025/2/2/4038488.png",
        "large": "https://static.manebooru.art/img/2025/2/2/4038488/large.png",
        "medium": "https://static.manebooru.art/img/2025/2/2/4038488/medium.png",
        "small": "https://static.manebooru.art/img/2025/2/2/4038488/small.png",
        "tall": "https://static.manebooru.art/img/2025/2/2/4038488/tall.png",
        "thumb": "https://static.manebooru.art/img/2025/2/2/4038488/thumb.png",
        "thumb_small": "https://static.manebooru.art/img/2025/2/2/4038488/thumb_small.png",
        "thumb_tiny": "https://static.manebooru.art/img/2025/2/2/4038488/thumb_tiny.png"
    },
    "updated_at": "2025-02-02T07:59:43",
    "tag_ids": [
        1,
        31,
        59,
        62,
        168,
        190,
        241,
        283,
        335,
        350,
        555,
        1636,
        1646,
        1917,
        1936,
        2251,
        2357,
        3312,
        3602,
        5812,
        6996,
        7700,
        57649,
        93311,
        180662,
        206697,
        244299
    ],
    "source_url": "https://www.deviantart.com/flamirasplitz/art/Hoo-far-X-Tempest-Shadow-MLP-Request-790177616",
    "width": 800,
    "first_seen_at": "2025-02-02T07:59:38"
},
"representations": {
    "full": "https://static.manebooru.art/img/view/2025/2/2/4038488.png",
    "large": "https://static.manebooru.art/img/2025/2/2/4038488/large.png",
    "medium": "https://static.manebooru.art/img/2025/2/2/4038488/medium.png",
    "small": "https://static.manebooru.art/img/2025/2/2/4038488/small.png",
    "tall": "https://static.manebooru.art/img/2025/2/2/4038488/tall.png",
    "thumb": "https://static.manebooru.art/img/2025/2/2/4038488/thumb.png",
    "thumb_small": "https://static.manebooru.art/img/2025/2/2/4038488/thumb_small.png",
    "thumb_tiny": "https://static.manebooru.art/img/2025/2/2/4038488/thumb_tiny.png"
},

I'm sorry about bringing so much stuff up. I try to bring things up in bursts then take a long break before asking about anything else.

@mikf mikf added the site:bug label Feb 2, 2025
mikf added a commit that referenced this issue Feb 7, 2025
'view_url' URLs sometimes result in 404 errors
@mikf mikf closed this as completed Feb 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants