Gallery Dl Updates & Release Notes

Active development has moved to Codeberg
(see [Announcement] Moving to Codeberg for details)
https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.17

Extractors

500px

• fix PhotoGroup items in user results (cb#517)
• warn about missing x-500px-access-token-prod cookie (cb#524)

8muses

• update URL patterns (cb#520)
• fix albums without name attribute (cb#520)

behance

• fix user pagination (cb#514)

bunkr

• support bunkr.cx domain (cb#504)
• support bunkr.by domain (pr#508)

erome

• support language subdomains (pr#511)

instagram

• update user & posts query parameters (cb#519 gh#9816 gh#9818)
• fix & improve doc_id lookups (cb#503 cb#515 gh#9815 gh#9794)
• fix AttributeError if friendship_status is None (cb#526)
• ensure non-zero exit status on GraphQL error (cb#519)
• restore static-videos functionality (cb#513)
• remove user-strategy option
• extend debug logging messages

iwara

• fix bug when refreshing access token more than once
• forward Control exceptions during image/video extraction

toyhouse

• fix & improve metadata extraction (cb#493)
• support character sub URLs (cb#493)

twitter

• fix "replies": "self" for likes/bookmarks (cb#501)
• support /i/history/likes URLs (cb#501)

zerochan

• fix HTML removal from API responses (cb#522)

Post Processors

ugoira

• pass -pix_fmt yuv420p as default FFmpeg argument (cb#496)

Miscellaneous

• [config] define and use config.setg()
• replace isinstance() checks
• remove warnings about deprecated path usage

Active development has moved to Codeberg
(see [Announcement] Moving to Codeberg for details)
https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.16

Extractors

Additions

• [toyhouse] add extractor for character galleries (cb#493)

• [xenforo] support darkwanderer.net (gh#9805)

• bellazon

  • warn on files hidden for guests (cb#489)

• common

  • check for empty cookie values (cb#490)

• deviantart

  • support numeric fav.me links (cb#495)

• fapello

  • extract model_name & aliases metadata (pr#487)

• imxtw

  • update domain to imx.bz (gh#9802)

• instagram

  • fix user lookups by ID (cb#465 cb#466 cb#484 gh#9773 gh#9787)
  • fix avatar extractor (cb#466 cb#484 gh#9773)
  • fix highlights extractor (cb#484 gh#9786 gh#9793)
  • fix KeyError: 'width' (gh#9793)
  • update stories-tray extractor
  • improve doc_id extraction

• kemono

  • fix thumbnail check (gh#9792)

• myfigurecollection

  • fix items without filename
  • improve user pictures extraction

• paheal

  • fix file_url & date extraction (gh#9791)

• pawchive

  • fix deferred files marked as preview_only
  • handle deferred main post files

• tapas

  • improve username & password login cookie handling (cb#497)

• toyhouse

  • bypass Content Warning on image links
  • fix art extractor

• xhamster

  • fix gallery extractor (pr#498)

Active development has moved to Codeberg
(see [Announcement] Moving to Codeberg for details)
https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.15

Extractors

Additions

• [mastodon] support mastodon.art (gh#5269)
• [mastodon] support aethy.com (gh#5311)
• [pornhub] add asset extractor for avatars & banners (gh#3323)
• [steamcommunity] add extractor for game screenshots & artworks (gh#2563 gh#7565)
• [steamcommunity] add extractor for user screenshots & artworks (gh#1079 gh#2563 gh#6978 gh#7565)
• ao3
  • fix subscriptions extractor (cb#477)
• dcinside
  • extract full-sized images (cb#478)
• filester
  • support password-protected files (cb#467)
• furaffinity
  • support non-default number of submissions per page (gh#9785)
• instagram
  • add covers option (gh#3010 gh#3761)
• iwara
  • fix handling network errors during login (gh#9278)
  • rename date to file_date - use date value of post objects
• myfigurecollection
  • fix pictures marked as containing spoilers
• postype
  • support downloading attachments (gh#9788)
• steamcommunity
  • fix Steam Artwork & Mature items
• twitter
  • warn on login page redirect (gh#9783)
• ytdl
  • implement websites option (gh#4394)

Active development has moved to Codeberg
(see [Announcement] Moving to Codeberg for details)
https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.14

Extractors

Additions

• [xasiat] add video extractor (cb#453 gh#8335)
• [steamcommunity] add support for screenshots & artwork (gh#7565 pr#126)
• behance
• fix 403 Forbidden errors (gh#9779)
• civitai
• support followed & newCreators query parameters (cb#462)
• eporner
• extract date metadata (pr#459)
• filester
• support password-protected folders (cb#467)
• instagram
• update & fix story & highlight extraction (cb#457 gh#9765 gh#9777)
• update & fix highlights extractor (gh#9777)
• update & fix tagged extractor (gh#9540 gh#9777)
• fix TypeError: 'generator' object is not subscriptable (cb#457)
• fix potential TypeError for previews (cb#458)
• include username in user_by_web() results
• simplify info extractor
• patreon
• support cta content elements (cb#461)
• pawchive
• ignore deferred files without download link (gh#9768)
• fix "deferred": "only" when all download links are missing (gh#9768)
• rawkuma
• fix chapter extractor (cb#454)
• turbo
• fix album extractor (gh#9778)
• twitter
• fix limitedActionResults quotes (gh#9767)
• implement quoted-expand option (cb#460)
• xasiat
• support category/model/tag videos (cb#453 gh#8335)
• add video format option

Post Processors

python

• implement args & kwargs options (pr#463)

Miscellaneous

• resolve symlink paths before updating file contents (gh#9772)
• implement global follow-symlinks option (gh#9772)
• prevent appending multiple .part on fallback downloads

Active development has moved to Codeberg
(see [Announcement] Moving to Codeberg for details)
https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.13

Extractors

Additions

• [coomerfans] add support (gh#9502 pr#112 pr#438)
• 500px
  • update extractors (gh#9754)
• civitai
  • support model & post collections
• dcinside
  • extract board metadata (pr#442)
  • handle lazy-loaded & single-quoted images (pr#443 pr#445)
  • ignore ads (pr#444)
• directlink
  • implement transform option
• instagram
  • fix redirect detection during user lookup (cb#422)
  • implement setting a user-cache expiration time
• iwara
  • fix downloading iwara.tv files on iwara.ai and vice versa
• mangafire
  • extract chapter_type & official metadata (gh#9756)
• onlyhaven
  • add expand option (gh#9746)
  • fix exception when caption is null (pr#441)
• pawchive
  • add expand option
  • support deferred files
  • add deferred option
  • implement "deferred": "only"
  • provide previews as fallback URLs (cb#433 gh#9727)
• xhamster
  • fix gallery extractor (pr#449)

Archive

• implement archive-reuse option (pr#434)

Path

• implement path-sub option

Utilities

• implement generate_uuid()
• simplify generate_token()

Miscellaneous

• implement global environment & environment-expand options (pr#451)

Active development has moved to Codeberg

(see [Announcement] Moving to Codeberg for details)

https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.12

Extractors

Additions

• [imdb] support title & name photos (cb#411 gh#2242)
• [whitekitten] add initial support (pr#436)

Removals

• [fileditchfiles] remove module (cb#412)
• [instagram] remove guide extractor
• [nekohouse] remove module

celebforum

update xenforo URL patterns (gh#9736)

fantia

download content of text-only posts (cb#424)

ganknow

fix download URLs of /private/ files (cb#428)

gofile

fix RecursionError in single file links (cb#430)

instagram

fix posts & reels extractors (cb#245 cb#396 cb#422 gh#9714 gh#9716 gh#9731 gh#9735 gh#9743)

newgrounds

bypass Content Filtered pages

onlyhaven

preserve post id value (cb#431)

add endpoint option (gh#9746)

twitter

expand Show More stubs, add showmore option (gh#9742)

improve ondemand.s.…a.js key extraction (cb#419)

weibo

extend livephoto option

fix livephoto filename & extension

provide type metadata

Utilities

job

implement children option (gh#7629)

Active development has moved to Codeberg

(see [Announcement] Moving to Codeberg for details)

https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.11

Extractors

Additions

[kokonotsuba] add generic extractors for kokonotsuba imageboards

Removals

• [3dbooru] remove module
• [desktopography] remove module
• [fuskator] remove module
• [itchio] remove module

8chan

support 8chan.st URLs

celebforum

update domain to celebforum.cc (cb#409)

dandadan

update domain to w6.dandadan.net

deviantart

support videos in multi-file posts (cb#379 gh#9692)

update filename metadata format (gh#9729)

fansly

fix potential 414 Request-URI Too Large errors (gh#9715)

lightroom

fix download URLs

mangafreak

fix manga extractor

update domain to 'ww3.mangafreak.me'

nijie

ignore duplicate post IDs

pawchive

fix 403 Forbidden errors by using gallery-dl/<version> as User-Agent (cb#405 gh#9717)

add endpoint option

add previews option (gh#9727)

provide original metadata value (gh#9727)

reddit

fix handling REST API morecomments results (cb#403)

improve Youve been blocked' message

tiktok

fix AttributeError: '_generate_headers' (cb#402)

tumblr

prevent source metadata getting overwritten

refactor file extraction (cb#369)

webmshare

send is_adult cookie

Configuration

update existing config-map targets (gh#9720)

Documentation

supportedsites

update site names & URLs

Miscellaneous

implement general async option (cb#369)

Active development has moved to Codeberg

(see [Announcement] Moving to Codeberg for details)

https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.10

Extractors

Additions

• [adultphotosets] add support (pr#340)
• [fileditchfiles] add support (gh#9666 pr#338)
• [furaffinity] add journal & journals extractors (cb#332)
• [leftybooru] add support (cb#315)
• [mangayi] add support (pr#374)
• [onlyhaven] add support (cb#347 gh#9702)
• [sofurry] add support (gh#311 gh#2382)
• [webmshare] add search extractor
• [xenforo] support thirsthub.cc (cb#393)

aryion

• fix non-recursive pagination

audiochan

• fix KeyError: 'created_at' (cb#320)
• fix 404 Not Found errors (cb#384)

civitai

• refactor API response handling (cb#326)

cosmos

• fix user data extraction (cb#360)

cosplayrule34

• fix title metadata

eporner

• fix gallery image extraction (pr#351)

exhentai

• provide search_tags & favorite_id metadata (cb#361)

furaffinity

• add comments option (cb#321)
• remove url metadata field (cb#332)

gofile

• fix 401 Unauthorized (cb#133 gh#9706)
• fix single file links (cb#375)

imagehosts

• fix hotlinking errors by adding Referer header (pr#348)

iwara

• support embedded videos
• add embeds option

kagane

• update root API URL (cb#355 pr#356)

kemono

• implement original option for discord URLs (gh#9704)

mastodon

• remove access-token defaults (cb#323)

nhentai

• extract title_pretty metadata (cb#352)

nozomi

• implement post-range skip support (cb#342)

patreon

• extract post data from API (cb#390)
• support video & caption content elements (cb#382)

pawchive

• implement revision functionality
• provide tags metadata as list of strings

pixhost

• fix extractor (pr#365)

reddit

• extract external URLs from deleted posts (gh#9678)
• provide search_tags metadata (cb#361)

scrolller

• fix GraphQL queries (pr#364)

tiktok

• randomize HTTP header fingerprints

tumblr

• combine inline image/video extraction
• provide keepreading metadata (cb#391)

twitter

• extract quoted_id metadata (cb#367)
• support /i/history bookmark URLs

webmshare

• fix NSFW videos

whyp

• support new URL format

Miscellaneous

• support narrowly-scoped external extractor imports (pr#324)
• [common] implement _extract_nuxtdata()
• [docs] fix bluesky API URLs (pr#376)
• [pyinstaller] exclude setuptools & packaging modules
• [requirements] implement --update
• [requirements] update package versions
• [util] extend HTTPBasicAuth username & password encoding (pr#331)
• [ytdl] fix --impersonate (pr#341)

Active development has moved to Codeberg

(see [Announcement] Moving to Codeberg for details)

https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.9

Extractors

Additions

• [bakashots] add support (gh#9634)
• [batcave] add support (cb#226 gh#9625)
• [dcinside] add support (gh#9657)
• [manganelo] add genre extractor (cb#292)
• [myfigurecollection] add article & user-articles extractors (gh#9609)
• [szurubooru] support ricardo.adacor.org (cb#305)

Removals

• [readcomiconline] remove module

• bunkr

  • extract thumbnail metadata

• civitai

  • fix TypeError when unpacking API responses (cb#310)
  • provide video fallback URLs (cb#308)

• exhentai

  • fix gallery extractor (cb#297 cb#298 gh#9676)

• facebook

  • extract post_text metadata (cb#309 gh#9679 gh#9682)
  • fix video extractor (cb#311)

• furaffinity

  • extract user comments (cb#263)

• iwara

  • provide video fallback URLs

• mangafire

  • fix extractors and vrf token generation (cb#283 cb#295)

• myfigurecollection

  • fix exception for releases without price (cb#294)
  • fix include default (gh#9609)

• newgrounds

  • fix audio file extraction

• nitter

  • fix video filename parsing (gh#9674)

• patreon

  • fix campaign_id extraction from /cw/ creator pages (gh#9681)

• pawchive

  • add original option (cb#314 gh#9684)

• shimmie2

  • extract source, rating, and parent_id metadata (cb#286)
  • extract size metadata (cb#302)

Cookies

• support Brave Origin profile paths (cb#299)

Output

• prevent AttributeError for redirected streams (pr#306)

Active development has moved to Codeberg

(see [Announcement] Moving to Codeberg for details)

https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.8

Extractors

Additions

[animepictures] add support (gh#339 gh#3523 gh#4355)

[myfigurecollection] add support (gh#222 gh#9609)

[imxtw] add image extractor (gh#9617)

audiochan

fix error for posts without audioFile (cb#288)

cara

fix duplicate filenames (cb#284)

civitai

handle new API response format (cb#278)

deviantart

fix literature markup extraction (gh#9670 cb#287)

fanbox

fix creator posts extraction (cb#279)

fix fee-min blocking individual post links

newgrounds

fix flash animation extraction (cb#293)

tumblr

distinguish question & answer media from regular inline media

twitter

restore protected & blocked_by detection (cb#290)

weibo

fix video format selection (cb#276 gh#9660)

Post Processors

mtime

add target option (pr#8120 gh#9638 cb#238)

Utilities

common

update browser user-agents and headers

allow setting custom sleep defaults per extractor

job

implement using a list of follow format strings (cb#261)

release

include SHA256SUMS & SHA512SUMS files

supportedsites

update auto-generation script

util

adjust Firefox & Chrome User-Agent header versions

Extractors

Additions

• [clonr] add folder extractor (cb#251)
• [misskey] add emoji extractor (cb#249)
• [mgrenders] add support (gh#1340 gh#9543)
• [vanlifetrader] add support (gh#9415 pr#64)
• [kagane] add chapter & manga extractors (cb#243 gh#8292 pr#268)

Removals

• [misskey] remove lesbian.energy

• audiochan
  fix KeyError: 'stream_url' (cb#256 cb#264 cb#269)
  update API endpoints (cb#256)

• civitai
  fix KeyError: 'createdAt' when downloading user posts (cb#248 cb#255)

• everia
  fix post extractor (cb#250)

• fanbox
  fix post data extraction (cb#257)

• furry34
  extend tag category list

• ganknow
  fix video downloads

• goonbox
  fix legacy non-album images (pr#253)

• hiperdex
  fix 403 Forbidden errors (cb#241 cb#254)

• mangafire
  update extractors (cb#260)

• rule34vault
  extend tag category list
  fix searching for multiple tags (gh#9646)

• tumblr
  extend inline option (gh#8468)
  provide source metadata for files

• vk
  support vk.ru URLs (cb#267)
  add domain option (cb#267)

• webtoons
  improve bgm filenames (gh#8733)

Post Processors

exec

• only add successful commands to archive (cb#266)

Cookies

• support v147+ profile paths for Firefox-based browsers

Active development has moved to Codeberg

(see [Announcement] Moving to Codeberg for details)

https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.6

Extractors

Additions

• [artfight] add support (gh#9235 pr#62)
• [cara] add support (cb#222 gh#5799)
• [ganknow] add basic support (gh#6880 pr#190)
• [sakuhentai] add support for image galleries (pr#224)
• [shimmie2] support prequeladventure.com/fanartbooru (cb#236)
• [xasiat] add search extractor (cb#229)

Removals

• [shimmie2] remove soybooru.com

arena

• fix 403 Forbidden errors (gh#9632)

booru

• add post-range skip

bunkr

• accept cdn.bunkr.ru URLs (cb#234)

facebook

• update /posts/ URL pattern (cb#228)

hiperdex

• use tRPC API (cb#241)
• fix 403 Forbidden errors (cb#241)

mangadex

• fix AttributeError: 'cache' (gh#9642)

pawchive

• update domain to pawchive.pw
• add domain option

sankaku

• fix searches for tags with + characters (cb#239)

shimmie2

• prevent IndexError when no width/height is given (cb#236)

twitter

• support article videos (gh#8995)

Utilities

common

• allow disabling header injection in request_json()

requirements

• update package versions

Active development has moved to Codeberg
(see [Announcement] Moving to Codeberg for details)
https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.5

Extractors

Additions

• [goonbox] add support (cb#218 gh#9615)
• aryion
• fix folder detection (gh#9608)
• bilibili
• extract content, date, title, and topic metadata (cb#200)
• dankefuerslesen
• fix 400 Bad Request errors (cb#219)
• facebook
• handle video pages in sets (cb#208)
• improve title extraction
• fanbox
• support skipping posts via page query parameter
• add --post-range skip
• filester
• fix download URLs (cb#210)
• hentainexus
• fix extraction (cb#202 cb#215)
• issuu
• fix JSONDecodeError (cb#220)
• pawchive
• show warning for missing files (gh#9605)
• skeb
• prevent KeyError: 'private' (gh#9604)
• toyhouse
• extract detail & status metadata (cb#209)
• fix characters metadata (cb#209)

Cookies

• fix IndexError for empty encrypted values (gh#9611)
• fix Firefox containers (cb#216)

Active development has moved to Codeberg

(see [Announcement] Moving to Codeberg for details)

https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.4

Extractors

Additions

[pawchive] add support (cb#179 gh#9590)

Removals

[cfake] remove module

aryion

extract title without HTML entities (cb#183)

fix metadata extraction (cb#193)

bilibili

update modules extraction (gh#9596)

civitai

fix file URLs

comicartfans

bypass CF and fix 403 error for downloads

facebook

fix crash on title values with double quotes (cb#198)

fanbox

add fee-min option

furaffinity

fix crash on Image Not Found posts (cb#195)

hypnohub

use workaround for Access Restricted images (gh#9586)

kemono

fix username & password login

motherless

update domain to motherless.xxx (gh#9601)

pixiv

restore background fallback URLs (gh#9587)

shimmie2

generalize file URL extraction (cb#182)

weibo

improve retweet extraction (cb#87 cb#191)

xasiat

fix filename metadata (gh#9589)

Utilities

util

implement and use b64… functions

Active development has moved to Codeberg

(see [Announcement] Moving to Codeberg for details)

https://codeberg.org/mikf/gallery-dl/releases/tag/v1.32.3

Extractors

bluesky

• support gallery/carousel media (cb#168)

civitai

• update file URLs (gh#9421)

exhentai

• do not send empty f_search parameters (cb#158)

facebook

• improve next_photo_id extraction

gofile

• fix 401 Unauthorized (cb#133 cb#176)

instagram

• fix num of audio files & covers (cb#175)

kemono

• download preview files, implement original option (cb#97 gh#9442)

leakgallery

• update file URL regex (cb#119)

newgrounds

• use non-WebP extensions for imageData images (cb#162)

oauth

• fix oauth:deviantart & oauth:pixiv (cb#106)

patreon

• support post URLs with creator name (cb#170)
• update User-Agent version (pr#172)

pixhost

• update domain to pixhost.cc

twitter

• fix KeyError: 'name' for "transform": false (cb#109)

vsco

• provide site_id & user_id metadata when possible (cb#145)
• support downloadng user galleries by site ID (gh#7310)

Utilities

requirements

• update package versions

text

• restore bytes value usage in build_query() (cb#106)