v1.29.1

Extractors

Additions

• [tenor] add support (#6075)

Fixes

• [bunkr] update API endpoint (#7097)
• [erome] fix AttributeError for albums without tags (#7076)
• [furaffinity] fix artist metadata (#6582 #7115 #7123 #7130)
• [jpgfish] decrypt file URLs (#7073 #7079 #7109)
• [sankaku] fix search tag limit check
• [vsco] fix video extractor (#7113)
• [vsco] fix extracting videos from /gallery results (#7113)

Improvements

• [bunkr] add endpoint option (#7097)
• [danbooru:pool] download posts in pool order, add order-posts option (#7091)
• [erome:search] recognize all URL query parameters (#7125)
• [reddit] add selftext option (#7111)
• [redgifs:search] support /search?query=... URLs (#7118)
• [sankaku] increase wait time on 429 errors (#7129)
• [tiktok] improve tiktok-range parsing (#7098)

Downloaders

• [http] detect Cloudflare/DDoS-Guard challenges (#7066 #7121)
• warn about invalid subcategory values (#7103 #7119)

v1.29.0

Changes

• build gallery-dl.exe on Windows 10 / Python 3.13 (#6684)
• provide Windows 7 / Python 3.8 builds as gallery-dl_x86.exe

Extractors

Additions

• [bilibili] add user-articles-favorite extractor (#6725 #6781)
• [boosty] add direct-messages extractor (#6768)
• [discord] add support (#454 #6836 #7059 #7067)
• [furry34] add support (#1078 #7018)
• [hentaiera] add support (#3046 #6952 #7020)
• [hentairox] add support (#7003)
• [imgur] add support for personal posts (#6990)
• [imhentai] add support (#1660 #3046 #3824 #4338 #5936)
• [tiktok] add support (#3061 #4177 #5646 #6878 #6708)
• [vsco] support /video/ URLs (#4295 #6973)

Fixes

• [bunkr] decrypt file URLs (#7058 #7070 #7085 #7089 #7090)
• [chevereto/jpgfish] fix extraction (#7073 #7079)
• [generic] fix config lookups by subcategory
• [philomena] fix date values without UTC offset (#6921)
• [philomena] download full URLs to prevent potential 404 errors (#6922)
• [pixiv] prevent exceptions during comments extraction (#6965)
• [reddit] restrict subreddit search results (#7025)
• [sankaku] fix extraction (#7071 #7072)
• [subscribestar] fix post extractor (#6582)
• [twitter] revert generated CSRF token length to 32 characters (#6895)
• [vipergirls] change default domain to viper.click (#4166)
• [weebcentral] fix extracting wrong number of chapter pages (#6966)

Improvements

• [b4k] update domain to arch.b4k.dev (#6955 #6956)
• [bunkr] update default archive ID format (#6935)
• [bunkr] provide fallback URLs for 403 download links (#6732 #6972)
• [bunkr] implement fast --range support (#6985)
• [furaffinity] use a default delay of 1 second between requests (#7054)
• [itaku] support gallery section URLs (#6951)
• [patreon] support /profile/creators URLs
• [subscribestar] detect and handle redirects (#6916)
• [twibooru] match URLs with www subdomain (#6903)
• [twitter] support grok cards content (#7040)
• [vsco] improve m3u8 handling
• [weibo] add movies option (#6988)

Metadata

• [bunkr] extract id_url metadata (#6935)
• [erome] extract tags metadata (#7076)
• [issuu] unescape HTML entities
• [newgrounds] provide comment_html metadata (#7038)
• [patreon] extract campaign metadata (#6989)

Downloaders

• implement downloader options per extractor category
• [http] add sleep-429 option (#6996)
• [ytdl] support specifying module as filesystem path (#6991)

Archives

• [archive] implement support for PostgreSQL databases (#6152)
• [archive] add archive-table option (#6152)

Miscellaneous

• [aes] handle errors during cryptodome import (#6906)
• [executables] fix loading certifi SSL certificates (#6393)
• improve \f format string handling for --print

v1.28.5

Extractors

Additions

• [nekohouse] add support (#5241, #6738)
• [turboimagehost] add support for galleries (#6855)
• [xfolio] add support (#5514, #6351, #6837)

Fixes

• [4archive] fix TypeError
• [adultempire] bypass age confirmation check
• [architizer] fix extraction
• [artstation] avoid Cloudflare challenges (#5817, #5658, #5564, #5554)
• [deviantart] prevent crash when accessing premium_folder data (#6873)
• [fapachi] fix extraction (#6881)
• [issuu] fix user extractor
• [kemonoparty] fix username metadata and filtering by tag for /posts URLs (#6833)
• [mangafox] fix chapter extraction
• [mangahere] fix chapter extraction
• [pixiv] fix sanity_level workaround (#4327)
• [pornpics] fix pagination results from HTML pages
• [twitter] handle exceptions during file extraction (#6647)
• [vsco] fix JSONDecodeError (#6887, #6891)
• [weebcentral] fix extraction (#6860)
• [xhamster] fix gallery extractor (#6818, #6876)

Improvements

• [batoto] use chapter_id in default archive IDs (#6835)
• [e621] support e621.cc and e621.anthro.fr frontend URLs (#6809)
• [e621] prevent premature pagination end (#6886)
• [facebook] allow accessing all metadata in directory format strings (#6874)
• [hiperdex] update domain to hiperdex.com
• [kemonoparty] enable filtering creator posts by tag (#6833)
• [khinsider] add covers option (#6844)
• [komikcast] update domain to komikcast.la
• [lofter] improve error handling (#6865)
• [pornpics] avoid redirect when retrieving a gallery page
• [urlgalleries] support new URL format

Metadata

• [bunkr] extract better filename metadata (#6824)
• [hiperdex] fix description metadata
• [khinsider] extract more album metadata (#6844)
• [mangaread] fix manga metadata extraction
• [rule34xyz] fix date and tags metadata
• [saint] fix metadata of /d/ URLs
• [toyhouse] fix date, artists, and characters metadata
• [webtoons] fix username and author_name metadata

Removals

• [cohost] remove module
• [fanleaks] remove module
• [shimmie2] remove tentaclerape.net
• [szurubooru] remove booru.foalcon.com

Miscellaneous

• [docs] add nix docs to README (#6606)
• [path] fix exception when using --rename-to + --no-download (#6861)
• [release] include scripts/run_tests.py in release tarball (#6856)

v1.28.4

Extractors

Additions

• [pexels] add support (#2286, #4214, #6769)
• [weebcentral] add support (#6778)

Fixes

• [bunkr] update to new site layout (#6798, #6805)
• [bunkr] fix ValueError on relative redirects (#6790)
• [plurk] fix user data extraction and make it non-fatal (#6742)

Improvements

• [bunkr] support /f/ media URLs
• [e621] accept tag search URLs with empty tag (#6783)
• [pixiv] provide fallback URLs (#6762)
• [wallhaven] extract search[tags] and search[tag_id] metadata (#6772)

Miscellaneous

• [util] support not splitting value argument when calling contains() (#6773)

v1.28.3

Extractors

Additions

• [civitai] add user-videos extractor (#6644)
• [szurubooru] support visuabusters.com/booru (#6729)

Fixes

• [8muses] skip albums without valid permalink (#6717)
• [batoto] update domains (#6714)
• [deviantart:tiptap] fix deviation embeds without token
• [hitomi] fix searches (#6713)
• [instagram:reels] fix pinned values (#6719)
• [kemonoparty] handle discord favorites (#6706)
• [piczel] fix extraction (#6735)
• [poipiku] fix downloads when post has a warning (#6736)
• [sankaku] support alphanumeric book/pool IDs (#6757)
• [subscribestar] fix attachment downloads (#6721, #6724, #6758)
• [subscribestar] improve content metadata extraction (#6761)
• [tapas] fix TypeError for locked episodes (#6700)

Improvements

• [boosty] support file post attachments (#6760)
• [deviantart:tiptap] support more content block types (#6686)
• [directlink] use domain as subcategory (#6703)
• [hitomi] provide search_tags metadata for tag and search results (#6756)
• [subscribestar] support audio files (#6758)

Miscellaneous

• [workflows:executables] build with Python 3.13

v1.28.2

Extractors

Additions

• [cyberdrop] add extractor for media URLs (#2496)
• [itaku] add search extractor (#6613)
• [lofter] add initial support (#650, #2294, #4095, #4728, #5656, #6607)
• [yiffverse] add support (#6611)

Fixes

• [facebook] decode Unicode surrogate pairs in metadata values (#6599)
• [zerochan] parse API responses manually when receiving invalid JSON (#6632)
• [zerochan] fix source metadata extraction when not logged in

Improvements

• [bilibili] extract files from module_top entries (#6687)
• [bilibili] support /upload/opus URLs (#6687)
• [bluesky] default to posts timeline when reposts or quoted is enabled (#6583)
• [common] simplify HTTP error messages
• [common] detect DDoS-Guard challenge pages
• [deviantart] improve tiptap markup to HTML conversion (#6686)
  • fix KeyError: 'attrs' for links without href
  • support heading content blocks
  • support strike text markers
• [instagram] extract date metadata for stories (#6677)
• [kemonoparty:favorite] support new URL format (#6676)
• [saint] support saint2.cr URLs (#6692)
• [tapas] improve extractor hierarchy (#6680)

Options

• [cohost] add avatar and background options (#6656)

Miscellaneous

• support * wildcards for parent>child categories, for example reddit>* (#6673)
• use latest Firefox UA as default user-agent
• use random unused port for "user-agent": "browser" requests

v1.28.1

Extractors

Additions

• [bluesky] add info extractor

Fixes

• [bluesky] fix exception when encountering non-quote embeds (#6577)
• [bluesky] unescape search queries (#6579)
• [common] restore using environment proxy settings by default (#6553, #6609)
• [common] improve handling of user-agent settings (#6594)
• [e621] fix TypeError when metadata is enabled (#6587)
• [gofile] fix website token extraction (#6596)
• [inkbunny] fix re-login loop (#6618)
• [instagram] handle empty carousel_media entries (#6595)
• [kemonoparty] fix o query parameter handling (#6597)
• [nhentai] fix download URLs (#6620)
• [readcomiconline] fix chapter extraction (#6070, #6335)
• [realbooru] fix extraction (#6543)
• [rule34] fix favorite extraction (#6573)
• [zerochan] download .webp and .gif files (#6576)

Improvements

• [hentaicosplays] update domains (#6578)
• [pixiv:ranking] implement filtering results by content (#6574)
• [pixiv] include user ID in failed AJAX request warnings (#6581)

Options

• [patreon] add format-images option (#6569)
• [zerochan] add extensions option (#6576)

v1.28.0

Changes

• [common] disable using environment network settings by default (HTTP_PROXY, .netrc, …)
  • disable trust_env session attribute
  • disable Authorization header injection from .netrc auth (#5780, #6134, #6455)
  • add proxy-env option
• [ytdl] change forward-cookies default value to true (#6401, #6348)

Extractors

Additions

• [bilibili] add support for opus articles (#2824, #6443)
• [bluesky] add hashtag extractor (#4438)
• [danbooru] add artist and artist-search extractors (#5348)
• [everia] add support (#1067, #2472, #4091, #6227)
• [facebook] add support (#470, #2612, #5626, #6548)
• [hentaifoundry] add tag extractor (#6465)
• [hitomi] add index and search extractors (#2502, #6392, #3720)
• [motherless] add support (#2074, #4413, #6221)
• [noop] add noop extractor
• [rule34vault] add support (#5708, #6240)
• [rule34xyz] add support (#1078, #4960)
• [saint] add support (#4405, #6324)
• [tumblr] add search extractor (#6394)

Fixes

• [8chan] avoid performing network requests within _init() (#6387)
• [bluesky] fix downloads from non-bsky PDSs (#6406)
• [bunkr] fix album names containing <>& characters
• [flickr] use download URLs (#6360, #6464)
• [hiperdex] update domain to hipertoon.com (#6420)
• [imagechest] fix extractors (#6475, #6491)
• [instagram] fix using numeric cursor values (#6414)
• [kemonoparty] update to new site layout (#6415, #6503, #6528, #6530, #6536, #6542, #6554)
• [koharu] update domain to niyaniya.moe (#6430, #6432)
• [mangadex] apply lang option only to chapter results (#6372)
• [newgrounds] fix metadata extraction (#6463, #6533)
• [nhentai] support .webp files (#6442, #6479)
• [patreon] use legacy mobile UA when no session_id is set
• [pinterest] update API headers (#6513)
• [pinterest] detect video/audio by block content (#6421)
• [scrolller] prevent exception for posts without mediaSources (#5051)
• [tumblrgallery] fix file downloads (#6391)
• [twitter] make source metadata extraction non-fatal (#6472)
• [weibo] fix livephoto filename & extension (#6471)

Improvements

• [bluesky] support main.bsky.dev URLs (#4438)
• [bluesky] match common embed fixes (#6410, #6411)
• [boosty] update default video format list (#2387)
• [bunkr] support bunkr.cr URLs
• [common] allow passing cookies to OAuth extractors
• [common] allow overriding more default User-Agent headers (#6496)
• [philomena] switch default ponybooru filter (#6437)
• [pinterest] support story_pin_music blocks (#6421)
• [pixiv] get ugoira frame extension from meta_single_page values (#6056)
• [reddit] support user profile share links (#6389)
• [steamgriddb] disable adjust-extensions for fake-png files (#5274)
• [twitter] remove cookies migration workaround

Metadata

• [bluesky] provide author[instance] metadata (#4438)
• [instagram] fix extension of apparent .webp files (#6541)
• [pillowfort] provide count metadata (#6478)
• [pixiv:ranking] add rank metadata field (#6531)
• [poipiku] return count as proper number (#6445)
• [webtoons] extract episode_no for comic results (#6439)

Options

• [civitai] add metadata option - support fetching generation data (#6383)
• [exhentai] implement tags option (#2117)
• [koharu] implement tags option
• [rule34xyz] add format option (#1078)

Downloaders

• [ytdl] fix AttributeError caused by decodeOption() removal (#6552)

Post Processors

• [classify] rewrite - fix skipping existing files (#5213)
• enable inheriting options from global postprocessor objects
• allow postprocessors values to be a single post processor object

Cookies

• support Chromium table version 24 (#6162)
• fix GCM pad length calculation (#6162)
• try decryption with empty password as fallback

Documentation

• update recommended pip command for installing dev version (#6493)
• update gallery-dl.conf (#6501)

Options

• add -4/--force-ipv4 and -6/--force-ipv6 command-line options
• fix passing negative numbers as arguments (#5262)

Miscellaneous

• [output] use default ANSI colors only when stream is a TTY
• [util] implement defaultdict filters-environment
• [util] enable using multiple statements for all filter options (#5262)

v1.27.7

Extractors

Additions

• [civitai] add extractors for global models and images (#6310)
• [mangadex] add author extractor (#6372)
• [scrolller] add support (#295, #3418, #5051)

Fixes

• [8chan] automatically detect TOS cookie name (#6318)
• [bunkr] update to new site layout (#6344, #6352, #6368)
• [bunkr] send proper Referer headers for file downloads (#6319)
• [civitai] add uuid metadata field & use it as default archive format (#6326)
• [civitai] fix "My Reactions" results (#6263)
• [civitai] fix model file download URLs for tRPC API
• [lensdump] fix extraction (#6313)
• [pixiv] make retrieving ugoira metadata non-fatal (#6297)
• [pixiv] fix exception when processing deleted sanity_level works (#6339)
• [urlgalleries] fix extraction
• [wikimedia] fix non-English Fandom/wiki.gg articles (#6370)

Improvements

• [8chan] support /last/ thread URLs (#6318)
• [bunkr] support bunkr.ph and bunkr.ps URLs
• [newgrounds] support page numbers in URLs (#6320)
• [patreon] support /c/ prefix in creator URLs (#6348)
• [pinterest] support story pins (#6188, #6078, #4229)
• [pixiv] implement sanity_level workaround for user artworks results (#4327, #5435, #6339)

Options

• [bluesky] add quoted option (#6323)
• [pixiv] add captions option (#4327)
• [reddit] add embeds option (#6357)
• [vk] add offset option (#6328)

Downloaders

• [ytdl] implement explicit HLS/DASH handling

Post Processors

• add error event

Miscellaneous

• [cookies] convert Chromium expires_utc values to Unix timestamps
• [util] add std object to global eval namespace (#6330)
• add --print and --print-to-file command-line options (#6343)
• use child extractor fallbacks only when a non-user error occurs (#6329)

v1.27.6

Extractors

Additions

• [ao3] add subscriptions extractor (#6247)
• [boosty] add support (#2387)
• [civitai] add post extractors (#6279)
• [pixiv] support unlisted artworks (#5162)

Fixes

• [cohost] sanitize default filenames (#6262)
  • limit headline length
  • remove plainTextBody
• [deviantart] fix & improve journal/literature extraction (#6254, #6207, #6196)
  • extract journal HTML from webpage if possible
  • support converting tiptap markup to HTML
• [deviantart] fix stash folder extraction
• [flickr] update default API credentials (#6300)
• [flickr] fix ZeroDivisionError (#6252)
• [imagefap] fix {num} in default filenames for single images
• [myhentaigallery] fix tags extraction
• [patreon] extract attachments_media files (#6241, #6268)
• [pixiv] implement workaround for limit_sanity_level works (#4327, #4747, #5054, #5435, #5651, #5655)
• [pornhub] fix KeyError when album images are missing (#6299)
• [rule34us] fix extraction (#6289)
• [8chan] set TOS cookie for current and previous day

Improvements

• [bunkr] support bunkr.pk URLs (#6272)
• [civitai] use tRPC API by default (#6279)
• [civitai] improve default archive format (#6302)
• [komikcast] update domain to komikcast.cz
• [newgrounds] detect more comment embeds (#6253)
• [newgrounds] add more fallback URL formats for art-images files
• [oauth] prevent empty browser names
• [patreon] use mobile UA (#6241, #6239, #6140)
• [patreon] handle suspended accounts
• [pixiv] detect works requiring My pixiv access

Metadata

• [civitai] ensure image files have an id (#6251)
• [gelbooru_v02] unescape HTML entities in categorized tags
• [generic] ensure path metadata is always defined
• [pixiv] retrieve caption from AJAX API when empty (#4327, #5191)

Options

• [fanbox] add comments option, extend metadata option (#6287)
• [pixiv] add comments option (#6287)

Removals

• [blogger] remove micmicidol.club
• [chevereto] remove deltaporno.com
• [lolisafe] remove xbunkr.com
• [pururin] remove module
• [shimmie2] remove loudbooru.com

Post Processors

• [ugoira] fix BadZipFile exceptions (#6285)
• [ugoira] catch all exceptions when extracting ZIP archives (#6285)
• [ugoira] forward frame data as _ugoira_frame_data (#6154, #6285)

Miscellaneous

• [build] remove setuptools and requests version restrictions
• [docker] build from python:3.12-alpine
• [text] improve parse_query() performance