Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Odysee downloads have stopped working #31362

Open
5 tasks done
ml48603 opened this issue Nov 18, 2022 · 9 comments
Open
5 tasks done

Odysee downloads have stopped working #31362

ml48603 opened this issue Nov 18, 2022 · 9 comments
Labels
broken-IE problem with existing site extraction patch-available

Comments

@ml48603
Copy link

ml48603 commented Nov 18, 2022 •
edited by dirkf
Loading

Checklist

  • I'm reporting a broken site support
  • I've verified that I'm running youtube-dl version 2021.12.17
  • I've checked that all provided URLs are alive and playable in a browser
  • I've checked that all URLs and arguments with special characters are properly quoted or escaped
  • I've searched the bugtracker for similar issues including closed ones

Verbose log

youtube-dl -v -o "/home/mark/home/News/NEWS-Chronological/2022-11-17/TEST-Max-Igan-orig.mp4" https://odysee.com/@thecrowhouse:2/A-Ticket-to-the-Freak-Show:6                              [debug] System config: []                                                                                 [debug] User config: []                                                                                   [debug] Custom config: []                                                                                 [debug] Command-line args: ['-v', '-o', '/home/mark/home/News/NEWS-Chronological/2022-11-17/TEST-Max-Igan-orig.mp4', 'https://odysee.com/@thecrowhouse:2/A-Ticket-to-the-Freak-Show:6']
[debug] Encodings: locale UTF-8, fs utf-8, out utf-8, pref UTF-8
[debug] youtube-dl version 2021.12.17
[debug] Python version 3.10.6 (CPython) - Linux-5.15.0-53-generic-x86_64-with-glibc2.35
[debug] exe versions: ffmpeg 4.4.2, ffprobe 4.4.2, rtmpdump 2.4
[debug] Proxy map: {}
[lbry] @thecrowhouse#2/A-Ticket-to-the-Freak-Show#6: Downloading stream JSON metadata
ERROR: Unable to download JSON metadata: HTTP Error 405: Method Not Allowed (caused by <HTTPError 405: 'Method Not Allowed'>); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see  https://yt-dl.org/update  on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output.
  File "/usr/lib/python3/dist-packages/youtube_dl/extractor/common.py", line 634, in _request_webpage
    return self._downloader.urlopen(url_or_request)
  File "/usr/lib/python3/dist-packages/youtube_dl/YoutubeDL.py", line 2288, in urlopen
    return self._opener.open(req, timeout=self._socket_timeout)
  File "/usr/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/usr/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.10/urllib/request.py", line 557, in error
    result = self._call_chain(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 749, in http_error_302
    return self.parent.open(new, timeout=req.timeout)
  File "/usr/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/usr/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.10/urllib/request.py", line 563, in error
    return self._call_chain(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)```

Description

(Yes, really write the description HERE!)
Odysee downloads have stopped working, Nov 17, 2022. Worked up till now.
@ml48603

This comment was marked as outdated.

Sign in to view
@october262
Copy link

try with youtube-dl --force-generic-extractor " https://odysee.com/@thecrowhouse:2/A-Ticket-to-the-Freak-Show:6"

@NielsMayer
Copy link

@october262 's -force-generic-extractor hint only works with Odysee RSS feeds.

e.g. it'll fail with https://odysee.com/@corbettreport:0 but succeed with the RSS feed extracted from Odysee, https://odysee.com/$/rss/@corbettreport:0

e.g.

$ odysee-dl https://odysee.com/@corbettreport:0
[generic] @corbettreport:0: Requesting header
WARNING: Forcing on generic information extractor.
[generic] @corbettreport:0: Downloading webpage
[generic] @corbettreport:0: Extracting information
ERROR: Unsupported URL: https://odysee.com/@corbettreport:0

versus

odysee-dl https://odysee.com/$/rss/@corbettreport:0
[generic] @corbettreport:0: Requesting header
WARNING: Forcing on generic information extractor.
[generic] @corbettreport:0: Downloading webpage
[generic] @corbettreport:0: Extracting information
[download] Downloading playlist: The Corbett Report Official LBRY Channel on Odysee
[generic] playlist The Corbett Report Official LBRY Channel on Odysee: Collected 50 video ids (downloading 10 of them)
[download] Downloading video 1 of 10
[generic] eaff0d: Requesting header
[info] Writing video description metadata as JSON to: The Underpopulation Bomb - #NewWorldNextWeek.info.json
[generic] eaff0d: Downloading thumbnail ...
[generic] eaff0d: Writing thumbnail to: The Underpopulation Bomb - #NewWorldNextWeek.webp
[download] Destination: The Underpopulation Bomb - #NewWorldNextWeek.mp4
[download] 100% of 323.00MiB in 00:41
[ffmpeg] Converting thumbnail "The Underpopulation Bomb - #NewWorldNextWeek.webp" to JPEG
[atomicparsley] Adding thumbnail to "The Underpopulation Bomb - #NewWorldNextWeek.mp4"
[download] Downloading video 2 of 10
[generic] 95f61c: Requesting header
[info] Writing video description metadata as JSON to: One Nation Under Blackmail with Whitney Webb.info.json
[generic] 95f61c: Downloading thumbnail ...
WARNING: Unable to download thumbnail "https://thumbs.odycdn.com/c84c01f8fdd46aea19d9a387b9b037bd.webp": HTTP Error 404: Not Found
[download] One Nation Under Blackmail with Whitney Webb.mp4 has already been downloaded
[download] 100% of 771.32MiB
WARNING: Skipping embedding the thumbnail because the file is missing.
[download] Downloading video 3 of 10
[generic] e56e86: Requesting header
[info] Writing video description metadata as JSON to: The CIA and the News Media 2.0.info.json
[generic] e56e86: Downloading thumbnail ...
[generic] e56e86: Writing thumbnail to: The CIA and the News Media 2.0.webp
[download] The CIA and the News Media 2.0.mp4 has already been downloaded
[download] 100% of 396.98MiB
[ffmpeg] Converting thumbnail "The CIA and the News Media 2.0.webp" to JPEG
[atomicparsley] Adding thumbnail to "The CIA and the News Media 2.0.mp4"
[download] Downloading video 4 of 10
[generic] 6d3c6a: Requesting header
[info] Writing video description metadata as JSON to: FLASHBACK - How Do I Find Broken Links (2021).info.json
[generic] 6d3c6a: Downloading thumbnail ...
[generic] 6d3c6a: Writing thumbnail to: FLASHBACK - How Do I Find Broken Links (2021).webp
[download] FLASHBACK - How Do I Find Broken Links (2021).mp4 has already been downloaded
[download] 100% of 234.02MiB
[ffmpeg] Converting thumbnail "FLASHBACK - How Do I Find Broken Links (2021).webp" to JPEG
[atomicparsley] Adding thumbnail to "FLASHBACK - How Do I Find Broken Links (2021).mp4"
[download] Downloading video 5 of 10
[generic] 5589a7: Requesting header
[info] Writing video description metadata as JSON to: Nudge, Nudge, Wink, Wink - #NewWorldNextWeek.info.json
[generic] 5589a7: Downloading thumbnail ...
[generic] 5589a7: Writing thumbnail to: Nudge, Nudge, Wink, Wink - #NewWorldNextWeek.webp
[download] Destination: Nudge, Nudge, Wink, Wink - #NewWorldNextWeek.mp4
[download] 100% of 266.90MiB in 00:35
[ffmpeg] Converting thumbnail "Nudge, Nudge, Wink, Wink - #NewWorldNextWeek.webp" to JPEG
[atomicparsley] Adding thumbnail to "Nudge, Nudge, Wink, Wink - #NewWorldNextWeek.mp4"
[download] Downloading video 6 of 10
[generic] 59db8f: Requesting header
[info] Writing video description metadata as JSON to: Auditing the Police - #SolutionsWatch.info.json
[generic] 59db8f: Downloading thumbnail ...
[generic] 59db8f: Writing thumbnail to: Auditing the Police - #SolutionsWatch.webp
[download] Auditing the Police - #SolutionsWatch.mp4 has already been downloaded
[download] 100% of 432.79MiB
[ffmpeg] Converting thumbnail "Auditing the Police - #SolutionsWatch.webp" to JPEG
[atomicparsley] Adding thumbnail to "Auditing the Police - #SolutionsWatch.mp4"
[download] Downloading video 7 of 10
[generic] 38d7c1: Requesting header
[info] Writing video description metadata as JSON to: We're Telling You For the 500th Time! - #NewWorldNextWeek.info.json
[generic] 38d7c1: Downloading thumbnail ...
[generic] 38d7c1: Writing thumbnail to: We're Telling You For the 500th Time! - #NewWorldNextWeek.webp
[download] Destination: We're Telling You For the 500th Time! - #NewWorldNextWeek.mp4
[download] 100% of 125.44MiB in 00:17
[ffmpeg] Converting thumbnail "We're Telling You For the 500th Time! - #NewWorldNextWeek.webp" to JPEG
[atomicparsley] Adding thumbnail to "We're Telling You For the 500th Time! - #NewWorldNextWeek.mp4"
[download] Downloading video 8 of 10
[generic] e06e09: Requesting header
[info] Writing video description metadata as JSON to: What is Technocracy - Questions For Corbett.info.json
[generic] e06e09: Downloading thumbnail ...
[generic] e06e09: Writing thumbnail to: What is Technocracy - Questions For Corbett.webp
[download] Destination: What is Technocracy - Questions For Corbett.mp4
[download] 100% of 437.96MiB in 00:56
[ffmpeg] Converting thumbnail "What is Technocracy - Questions For Corbett.webp" to JPEG
[atomicparsley] Adding thumbnail to "What is Technocracy - Questions For Corbett.mp4"
[download] Downloading video 9 of 10
[generic] 72b91a: Requesting header
[info] Writing video description metadata as JSON to: Unknown Unknowns.info.json
[generic] 72b91a: Downloading thumbnail ...
WARNING: Unable to download thumbnail "https://thumbs.odycdn.com/f3597450aa53cf7be979c03cbd2fe2f9.webp": HTTP Error 404: Not Found
[download] Unknown Unknowns.mp4 has already been downloaded
[download] 100% of 630.96MiB
WARNING: Skipping embedding the thumbnail because the file is missing.
[download] Downloading video 10 of 10
[generic] 6f56e3: Requesting header
[info] Writing video description metadata as JSON to: FLASHBACK - Meet Smedley Butler (2010).info.json
[generic] 6f56e3: Downloading thumbnail ...
[generic] 6f56e3: Writing thumbnail to: FLASHBACK - Meet Smedley Butler (2010).webp
[download] FLASHBACK - Meet Smedley Butler (2010).mp4 has already been downloaded
[download] 100% of 641.06MiB
[ffmpeg] Converting thumbnail "FLASHBACK - Meet Smedley Butler (2010).webp" to JPEG
[atomicparsley] Adding thumbnail to "FLASHBACK - Meet Smedley Butler (2010).mp4"
[download] Finished downloading playlist: The Corbett Report Official LBRY Channel on Odysee

Where "odysee-dl" refers to a config file for odysee with following options:

-o "%(title)s.%(ext)s"
--dateafter now-1month
--playlist-end 10
--write-info-json
--embed-thumbnail
--download-archive ./ytdl-download-archive.txt
--force-generic-extractor

@october262
Copy link

@october262 's -force-generic-extractor hint only works with Odysee RSS feeds.

e.g. it'll fail with https://odysee.com/@corbettreport:0 but succeed with the RSS feed extracted from Odysee, https://odysee.com/$/rss/@corbettreport:0

e.g.

$ odysee-dl https://odysee.com/@corbettreport:0
[generic] @corbettreport:0: Requesting header
WARNING: Forcing on generic information extractor.
[generic] @corbettreport:0: Downloading webpage
[generic] @corbettreport:0: Extracting information
ERROR: Unsupported URL: https://odysee.com/@corbettreport:0

versus

odysee-dl https://odysee.com/$/rss/@corbettreport:0
[generic] @corbettreport:0: Requesting header
WARNING: Forcing on generic information extractor.
[generic] @corbettreport:0: Downloading webpage
[generic] @corbettreport:0: Extracting information
[download] Downloading playlist: The Corbett Report Official LBRY Channel on Odysee
[generic] playlist The Corbett Report Official LBRY Channel on Odysee: Collected 50 video ids (downloading 10 of them)
[download] Downloading video 1 of 10
[generic] eaff0d: Requesting header
[info] Writing video description metadata as JSON to: The Underpopulation Bomb - #NewWorldNextWeek.info.json
[generic] eaff0d: Downloading thumbnail ...
[generic] eaff0d: Writing thumbnail to: The Underpopulation Bomb - #NewWorldNextWeek.webp
[download] Destination: The Underpopulation Bomb - #NewWorldNextWeek.mp4
[download] 100% of 323.00MiB in 00:41
[ffmpeg] Converting thumbnail "The Underpopulation Bomb - #NewWorldNextWeek.webp" to JPEG
[atomicparsley] Adding thumbnail to "The Underpopulation Bomb - #NewWorldNextWeek.mp4"
[download] Downloading video 2 of 10
[generic] 95f61c: Requesting header
[info] Writing video description metadata as JSON to: One Nation Under Blackmail with Whitney Webb.info.json
[generic] 95f61c: Downloading thumbnail ...
WARNING: Unable to download thumbnail "https://thumbs.odycdn.com/c84c01f8fdd46aea19d9a387b9b037bd.webp": HTTP Error 404: Not Found
[download] One Nation Under Blackmail with Whitney Webb.mp4 has already been downloaded
[download] 100% of 771.32MiB
WARNING: Skipping embedding the thumbnail because the file is missing.
[download] Downloading video 3 of 10
[generic] e56e86: Requesting header
[info] Writing video description metadata as JSON to: The CIA and the News Media 2.0.info.json
[generic] e56e86: Downloading thumbnail ...
[generic] e56e86: Writing thumbnail to: The CIA and the News Media 2.0.webp
[download] The CIA and the News Media 2.0.mp4 has already been downloaded
[download] 100% of 396.98MiB
[ffmpeg] Converting thumbnail "The CIA and the News Media 2.0.webp" to JPEG
[atomicparsley] Adding thumbnail to "The CIA and the News Media 2.0.mp4"
[download] Downloading video 4 of 10
[generic] 6d3c6a: Requesting header
[info] Writing video description metadata as JSON to: FLASHBACK - How Do I Find Broken Links (2021).info.json
[generic] 6d3c6a: Downloading thumbnail ...
[generic] 6d3c6a: Writing thumbnail to: FLASHBACK - How Do I Find Broken Links (2021).webp
[download] FLASHBACK - How Do I Find Broken Links (2021).mp4 has already been downloaded
[download] 100% of 234.02MiB
[ffmpeg] Converting thumbnail "FLASHBACK - How Do I Find Broken Links (2021).webp" to JPEG
[atomicparsley] Adding thumbnail to "FLASHBACK - How Do I Find Broken Links (2021).mp4"
[download] Downloading video 5 of 10
[generic] 5589a7: Requesting header
[info] Writing video description metadata as JSON to: Nudge, Nudge, Wink, Wink - #NewWorldNextWeek.info.json
[generic] 5589a7: Downloading thumbnail ...
[generic] 5589a7: Writing thumbnail to: Nudge, Nudge, Wink, Wink - #NewWorldNextWeek.webp
[download] Destination: Nudge, Nudge, Wink, Wink - #NewWorldNextWeek.mp4
[download] 100% of 266.90MiB in 00:35
[ffmpeg] Converting thumbnail "Nudge, Nudge, Wink, Wink - #NewWorldNextWeek.webp" to JPEG
[atomicparsley] Adding thumbnail to "Nudge, Nudge, Wink, Wink - #NewWorldNextWeek.mp4"
[download] Downloading video 6 of 10
[generic] 59db8f: Requesting header
[info] Writing video description metadata as JSON to: Auditing the Police - #SolutionsWatch.info.json
[generic] 59db8f: Downloading thumbnail ...
[generic] 59db8f: Writing thumbnail to: Auditing the Police - #SolutionsWatch.webp
[download] Auditing the Police - #SolutionsWatch.mp4 has already been downloaded
[download] 100% of 432.79MiB
[ffmpeg] Converting thumbnail "Auditing the Police - #SolutionsWatch.webp" to JPEG
[atomicparsley] Adding thumbnail to "Auditing the Police - #SolutionsWatch.mp4"
[download] Downloading video 7 of 10
[generic] 38d7c1: Requesting header
[info] Writing video description metadata as JSON to: We're Telling You For the 500th Time! - #NewWorldNextWeek.info.json
[generic] 38d7c1: Downloading thumbnail ...
[generic] 38d7c1: Writing thumbnail to: We're Telling You For the 500th Time! - #NewWorldNextWeek.webp
[download] Destination: We're Telling You For the 500th Time! - #NewWorldNextWeek.mp4
[download] 100% of 125.44MiB in 00:17
[ffmpeg] Converting thumbnail "We're Telling You For the 500th Time! - #NewWorldNextWeek.webp" to JPEG
[atomicparsley] Adding thumbnail to "We're Telling You For the 500th Time! - #NewWorldNextWeek.mp4"
[download] Downloading video 8 of 10
[generic] e06e09: Requesting header
[info] Writing video description metadata as JSON to: What is Technocracy - Questions For Corbett.info.json
[generic] e06e09: Downloading thumbnail ...
[generic] e06e09: Writing thumbnail to: What is Technocracy - Questions For Corbett.webp
[download] Destination: What is Technocracy - Questions For Corbett.mp4
[download] 100% of 437.96MiB in 00:56
[ffmpeg] Converting thumbnail "What is Technocracy - Questions For Corbett.webp" to JPEG
[atomicparsley] Adding thumbnail to "What is Technocracy - Questions For Corbett.mp4"
[download] Downloading video 9 of 10
[generic] 72b91a: Requesting header
[info] Writing video description metadata as JSON to: Unknown Unknowns.info.json
[generic] 72b91a: Downloading thumbnail ...
WARNING: Unable to download thumbnail "https://thumbs.odycdn.com/f3597450aa53cf7be979c03cbd2fe2f9.webp": HTTP Error 404: Not Found
[download] Unknown Unknowns.mp4 has already been downloaded
[download] 100% of 630.96MiB
WARNING: Skipping embedding the thumbnail because the file is missing.
[download] Downloading video 10 of 10
[generic] 6f56e3: Requesting header
[info] Writing video description metadata as JSON to: FLASHBACK - Meet Smedley Butler (2010).info.json
[generic] 6f56e3: Downloading thumbnail ...
[generic] 6f56e3: Writing thumbnail to: FLASHBACK - Meet Smedley Butler (2010).webp
[download] FLASHBACK - Meet Smedley Butler (2010).mp4 has already been downloaded
[download] 100% of 641.06MiB
[ffmpeg] Converting thumbnail "FLASHBACK - Meet Smedley Butler (2010).webp" to JPEG
[atomicparsley] Adding thumbnail to "FLASHBACK - Meet Smedley Butler (2010).mp4"
[download] Finished downloading playlist: The Corbett Report Official LBRY Channel on Odysee

Where "odysee-dl" refers to a config file for odysee with following options:

-o "%(title)s.%(ext)s"
--dateafter now-1month
--playlist-end 10
--write-info-json
--embed-thumbnail
--download-archive ./ytdl-download-archive.txt
--force-generic-extractor

for this link - https://odysee.com/@corbettreport:0
you just need to find the master.m3u8 url via the developer tools.

@NielsMayer
Copy link

NielsMayer commented Nov 19, 2022 •
edited
Loading

@october262 -- no need to use any developer tools to find master.m3u8 -- just browse the Odysee channel you want and find the "vertical three dots" menu icon on the upper right hand side, click it, and select "Copy RSS URL" and use that URL with --force-generic-extractor . Thanks for the suggestion to use --force-generic-extractor,. as the Odysee RSS feed gets an error on Odysee without it...

@joelmaxuel joelmaxuel mentioned this issue Nov 20, 2022
Closed
@pukkandan
Copy link
Contributor

Related yt-dlp/yt-dlp#5585

@dirkf
Copy link
Contributor

dirkf commented Nov 20, 2022

Issue entry will not allow verbose log entry in "Verbose Log" block

If you paste it in the HTML comment field, it won't be displayed. Actually paste the log over the words PASTE VERBOSE LOG HERE, between the triple-backquotes.

@ytdl-org ytdl-org deleted a comment from ml48603 Nov 20, 2022
@ml48603
Copy link
Author

ml48603 commented Nov 24, 2022

Thanks Gentlemen. YouTube-dl is back in business at Odysee. I added the suggested switch

--force-generic-extractor

To the existing command and Voila . . . Video !

youtube-dl --force-generic-extractor -o "/home/mark/home/News/NEWS-Chronological/youtube-dl-issue-testing/odysee-test.%(ext)s" "https://odysee.com/@thecrowhouse:2/A-Ticket-to-the-Freak-Show:6"

[generic] A-Ticket-to-the-Freak-Show:6: Requesting header
WARNING: Forcing on generic information extractor.
[generic] A-Ticket-to-the-Freak-Show:6: Downloading webpage
[generic] A-Ticket-to-the-Freak-Show:6: Extracting information
[download] Destination: /home/mark/home/News/NEWS-Chronological/youtube-dl-issue-testing/odysee-test.mp4

[download] 54.3% of 2.11GiB at 27.86MiB/s ETA 00:35

Happy Thanksgiving

@dirkf
Copy link
Contributor

dirkf commented Nov 24, 2022

--force-generic-extractor finds the media URL when there is a ld+json block containing it.

Otherwise the one-line patch from yt-dlp/yt-dlp#5585 is needed to change the API URL:

-            'https://api.lbry.tv/api/v1/proxy',
+            'https://api.na-backend.odysee.com/api/v1/proxy',

Finally the extractor could try to extract the API host (eg, https://api.na-backend.odysee.com) from the site JS.

@dirkf dirkf added broken-IE problem with existing site extraction patch-available labels Nov 27, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
broken-IE problem with existing site extraction patch-available
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
5 participants
@dirkf @NielsMayer @pukkandan @ml48603 @october262