Unable to download ITV programmes #277
Comments
|
I have the same. I think it may be a geocaching issue as it also means you can't watch using the ITV player directly. |
|
I had a similar issue just recently in that ITV player would work on my Apple TV and iPad but not my iMac. Checking with my support team, they identified that ITV has added a new domain, sorry I don't have the details. Once they added that domain to my service I was able to use my iMac to watch ITV programmes and also downloading worked. |
|
I have the same problem. BBC downloads working fine but for ITV i receive the same error message as candcij. It stopped working two days ago... |
|
Able to watch on ITV’s website but not able to download. Receiving same error message as other users. |
|
My support team have now fixed it. It´s maybe not quite so stable as before but it works. |
|
Same issue; version 1.16, no proxy, in UK. |
|
Same issue, even on a programme downloaded successfully a couple of weeks ago. I'm in the UK. Could ITV have implemented DRM? |
|
Same issue here, can watch ITV hub on safari on iMac, have tried re-signing in to ITV, but to no avail, downloads fail. Critical part of log seems to be: "ExtractorError: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output." PS BBC radio and TV working fine, just affects ITV. Using GIA 1.16 |
|
I always hate it when people post things like "but it works for me", but in this case I have to. :-) I am able to download ITV shows with v1.17 -- I just tried Friday's Tipping Point. I can update youtube-dl in the next release to see if that will help anyone, but I didn't notice anything in their release notes that indicated they fixed any problems with ITV. If it's failing for you, are you inside the UK? |
|
Thanks for trying it for me (us). I'm afraid it still doesn't work for me and, yes, I am in the UK. BBC programmes are working fine, exactly as they have been for many months, but all ITV programmes I have tried during the last 3 days come up with the same error |
|
Same problem here, another UK user getting exactly the same error messages trying to download White House Farm from ITV using 1.17 on a mac |
|
Just to join in..it works SOMETOMES for me..if you keep retrying..sometimes
over a couple of days..it will download..problems viewing itv live as well,
so think it may be an issue with itv not gia.
…On Sun, Feb 9, 2020, 12:00 Scott Kovatch ***@***.***> wrote:
I always hate it when people post things like "but it works for me", but
in this case I have to. :-) I am able to download ITV shows with v1.17 -- I
just tried Friday's Tipping Point.
I can update youtube-dl in the next release to see if that will help
anyone, but I didn't notice anything in their release notes that indicated
they fixed any problems with ITV. If it's failing for you, are you inside
the UK?
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
<#277?email_source=notifications&email_token=AEDRDZTBGNCX5TQBIQ2SM4LRCAZD5A5CNFSM4KQYMJ52YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELGR6SI#issuecomment-583868233>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AEDRDZUPW73ATAIY5J2GCUTRCAZD5ANCNFSM4KQYMJ5Q>
.
|
I too am in the UK; interestingly(?) GiA creates the programme folder on the Mac as usual but it is left empty after the "download failed" message. However I can watch ITV from their website, unlike Ian and RA here. |
|
Apologies, forgot to add that I can watch on the ITV web site, also that I am using the same version macOS Sierra Version 10.12.6 as candcij |
|
Hi, just to add, I upgraded to GIA 1.17 and it made no difference, still failing on ITV shows. And yes, I'm in the UK, no proxy in use. |
|
Hi, Same issue, in UK able to watch ITV web browser / phone apps etc., but no longer able to download ITV programmes. Verbose log information below. `ITV Download (ID=1a2292a0061): Downloading Cold Feet - Mon Feb 03 [debug] User config: [] [debug] Encodings: locale US-ASCII, fs utf-8, out None, pref US-ASCII [debug] Python version 2.7.10 (CPython) - Darwin-15.6.0-x86_64-i386-64bit [debug] exe versions: ffmpeg 4.1.3-tessus, ffprobe N-90346-g86c7d8df95, rtmpdump 2.4-102-ga3a600d-get_iplayer [debug] Proxy map: {} [debug] Using fake IP 25.67.233.219 (GB) as X-Forwarded-For. [ITV] 1a2292a0061: Downloading webpage [ITV] 1a2292a0061: Downloading XML ITV Download (ID=1a2292a0061): youtube-dl finished downloading
|
|
I'm on 10.13.6/1.17 and I often have to retry downloading ITV at least twice before it works. |
|
Well I've retried the 3 Feb episode of Cold Feet about 200 times I reckon and its failed every time. (My GIA is set to auto-retry a failed download every 30mins) |
|
@steps39 wrote:
... But that URI you fed yt-dl is not valid; that same time-out will happen when you try to visit that URI with a browser... 😉 Using the latest (2020.01.24) yt-dl executable (sorry Mac users, I am currently on Windows), Cold Feet S09E04 comes down fine here:
... so, at first glance, I think we can absolve youtube-dl coding from any wrong-doing... 😉 Additional info: My own private tests have confirmed what is reported in some of the previous comments, i.e. that on ITV Hub's side some changes have been implemented recently; but the main playlist generating API (used in yt-dl's itv.py extractor) remained the same, so did the method of stream delivery (HLSe) and stream encryption (AES-128); the one thing that changed was the hostname of the CDN that serves the master and variant playlists, as well as the HLS fragments themselves; those using geo-fencing circumvention measures (e.g. smartDNS) may need to convey that change to their vendors (so that they "proxy" the new rather than the old CDN hostname...). And I'll stress once again here the fact that having ITV Hub VOD streams working in (desktop) Chrome and Firefox doesn't mean automatically that ITV fetches via yt-dl should equally work; Chrome and Firefox by default get served MPEG-DASH streams with Common Encryption (cenc) DRM (these require a working Widevine CDM in the browser), that yt-dl will NEVER support natively. Desktop Safari might equally be served the above type of DRM'd streams, but I can't check this myself... 😞 Best regards 😄 |
|
If I understand Vangellis66 comments correctly, GIA (yt-dl) needs to reference www.itv.com, not itv.com. INFO: Loading proxy settings... Downloading Show 1/1: ITV Download (ID=2a1229a0028): Downloading Endeavour - Sun Feb 09 [debug] User config: [] [debug] Encodings: locale US-ASCII, fs utf-8, out None, pref US-ASCII [debug] Python version 2.7.10 (CPython) - Darwin-15.6.0-x86_64-i386-64bit [debug] exe versions: ffmpeg 4.1.3-tessus, ffprobe N-90346-g86c7d8df95, rtmpdump 2.4-102-ga3a600d-get_iplayer [debug] Proxy map: {} [debug] Using fake IP 25.201.16.83 (GB) as X-Forwarded-For. [ITV] 2a1229a0028: Downloading webpage [ITV] 2a1229a0028: Downloading XML WARNING: Unable to download XML: HTTP Error 504: Gateway Time-out [ITV] 2a1229a0028: Downloading JSON metadata [ITV] 2a1229a0028: Downloading m3u8 information WARNING: Failed to download m3u8 information: <urlopen error [SSL: TLSV1_ALERT_PROTOCOL_VERSION] tlsv1 alert protocol version (_ssl.c:590)> ERROR: No video formats found; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; type youtube-dl -U to update. Be sure to call youtube-dl with the --verbose flag and include its complete output. ITV Download (ID=2a1229a0028): youtube-dl finished downloading Puzzled Peter |
|
@sxmpete wrote:
Hello 😄 ; my comment was mentioning the standalone yt-dl app, not GiA; I wrote:
(I've now edited my original post to make this more clear... 😉 ) This was in response to @steps39's attempt to test standalone yt-dl for id=1a2292a0061; his GiA log confirms though that GiA itself is feeding embedded yt-dl the correct ITV hostname:
which is something you, too, confirm:
The logic in testing the standalone yt-dl app is that if the fetch succeeds on one's setup (ISP/[W]LAN/OS version/DNS setup/UK-proxying solutions, etc.), then the GiA embedded yt-dl code should be exonerated; but possibly this approach is flawed, too, because, at least for Windows, the standalone yt-dl executable is an all-in-one solution, comprising all needed python (3.4.4) modules, not depending on OS installed python, which is the case for yt-dl on a Mac...
Are you referring to this?
This is an expected and quite benign warning! It's the result of relic code inside yt-dl's ITV extractor from the era when ITV (player, not hub) used to deliver VOD through the RTMPE protocol; back then, they were using an older playlist API that would generate the stream data inside an XML file; that API has been deprecated for two years already, the XML file it used to produce is no more, hence the error spewed by yt-dl; there's an open issue over at the yt-dl tracker reporting the above behaviour... Failing to acquire an XML playlist, yt-dl moves over to trying the current playlist API, which generates results in the JSON format and, by your posted log, you do succeed in that stage:
The most important part of your verbose log (and many thanks for providing that 👍 ) is the following one:
i.e. you are failing to download (over HTTPS) the master HLS playlist (*.m3u8) because of secure connection (SSL/TLS) issues! No master playlist accessed, of course, results in
In 2020, the deemed insecure TLS protocols v1.0 and v1.1 are being deprecated/phased out in servers, a client needing to make a secure connection must support at minimum TLS v1.2 (the current standard) and, preferably, TLS v1.3 (the finalised future standard).
If you're using a full blown VPN connection in your client, then you're simply connecting to a VPN server; the rest of the requests/connections to the ITV infrastructure (webpages, CDN, etc.) you're forwarding to that server are handled solely by the VPN server (the configuration of which is beyond your reach), so of course any connection issue when using a VPN can be a VPN vendor issue! On your Mac, for connection purposes, yt-dl uses the OS provided python modules; I notice that
Isn't that kinda old? I'm sure it can handle TLS v1.0, but can it handle v1.2/v1.3? I've checked the new CDN hostname ITV now use to stream content (it's actually an Akamai node) on @skovatch, does all this make any sense to you? Is it a case of obsolete python libraries on older Macs the cause of this issue, especially for UK users not behind a VPN? I'm sorry, but I can't offer additional advice... |
@Vangelis66 thanks as always for your analysis. What you describe makes sense, but I think we can test it to be sure. For GiA, I use the system Python in /usr/bin, since I can safely assume it's available. On macOS Catalina, that is v2.7.16, which is fine. Older versions of macOS had a vulnerable version of OpenSSL that is used by Python for secure connections. If it's failing for you, run this command in Terminal and report back here with the output.
If it doesn't report back TLS 1.2 or later that's a strong hint it might be the problem. If it is, I should be able to add a newer version of pyOpenSSL that is compatible. |
Hi Scott, |
|
Good morning Cheers |
|
I have done a bit of investigation into this issue and have uncovered the following info. Either/both my VPN or ITV must have recently eliminated support for TSL V1.0 resulting in the secure connection issue. Since problem is experienced by folk inside UK with no VPN, then at least ITV has made the change. Obvious solution is to upgrade to a version of openssl that supports newer TLS versions. One approach is to download 3.x python binary from python.org (which contains the latest openssl) and installs 3.x python in parallel with system version. Another approach would be to upgrade to latest version of openssl. Hopefully someone a bit more technical can leverage this info into a solution for those less technically inclined… |
|
Verified the problem (using Get iPlayer Automator Version 1.17). |
|
@Vangelis66 - thanks for pointing out my obvious mistake. I have installed Python 2.7.17 such that if command was python alone then correct TLS would be used see below. @skovatch would it be easy to just loose the /usr/bin from the python call, rather a hack and requires people needing to upgrade python (I hope there are no side-effects - I backed things up first). Alternative, I noted that using pip to install youtube-dl on a Raspberry Pi it uses Python 3.5 (CPython), so would now be the time to shift to Python 3 on GiA? python -V reports 2.7.10 So as administrator I have installed Python 2.7.17 from https://www.python.org/downloads/release/python-2717/ - then run the included Install Certificates.command and Update Shell Profile.command. Now python -V report 2.7.17, Now I have: So if GiA used just python then it should work at least in terms of TLS. |
Not an issue for High Sierra and above because that is when Apple switched to LibreSSL
For now, create a symlink in the location where GiA looks for binaries using one of: Remove the symlink if necessary when GiA is updated EDIT 2022-02-01: Install Python 2 for compatibility with pycrypto package provided by GiA |
|
@howyallare :-) GiA now working on El Capitan 10.11.6 again having installed Python 2.7.17 and put the symlink in place, thanks. |
|
So what all needs to be done to make this work again on Catalina?
From: steps39 <notifications@github.com>
Date: Wednesday, February 12, 2020 at 10:08 AM
To: Ascoware/get-iplayer-automator <get-iplayer-automator@noreply.github.com>
Cc: Subscribed <subscribed@noreply.github.com>
Subject: Re: [Ascoware/get-iplayer-automator] Unable to download ITV programmes (#277)
@howyallare<https://github.com/howyallare> :-) GiA now working on El Capitan 10.11.6 again having installed Python 2.7.17 and put the symlink in place, thanks.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub<#277?email_source=notifications&email_token=AFIY35JUJKMMPFAOCUOJOSLRCQNGFA5CNFSM4KQYMJ52YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOELRKWHA#issuecomment-585280284>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AFIY35LF6KFPQAIN5URBHLTRCQNGFANCNFSM4KQYMJ5Q>.
|
|
All done, can't understand what I can't use GIA myself, what version of OSX are you running ? |
|
macOS Catalina Version 10.15.3 the latest one. Thanks for removing the link as I don't think this forum likes links to downloads....I was doing as a favour to you, to help you out. Hopefully, Scott will sort this problem out....I'm sure he will. I just love this application....I just which it could do the same for Channel 4 and Channel 5 but sadly it doesn't. I also use Downie but I don't think it works on BBC but downloads YouTube so well |
|
Yes he does a great job with the updates. Ch4 was included years ago, certainly would be good to have ch5. I'll check Downie out. I am using Sierra only because you can't switch back to windows 10 in boot camp with later versions, that's probably why 1.17.0 won't work with me then. Thanks for your upload it was just a one off request as I wanted a copy of Richard and Judy, didn't know there were going to be on and am a bit of a fan lol |
|
Downie (and anybody else) can't download Channel 4, because all its programs are encrypted. |
|
Yes, I know Downie doesn't work on Channel 4 or 5 but I think it works on ITV |
|
Yes, Downie works fine with ITV, which is good to know if there is a problem with Get iPlayer Automator, but crashes if you try using it with the BBCiPlayer. I just checked with Downie 4. |
I need your help again ! |
|
OK mctk what is you need help with? |
|
Just wanted ITV News at 10 and the 6.30 one from tonight (Friday) really |
|
m1ctk I have created an email address where you can ask for any future ITV programs. Once you make contact with that address I will delete it here. I feel that this forum is not the right place for you to ask about different ITV programs, no matter how well-intentioned it is. So if you could make contact at this Gmail address I can give you further details on how to get the ITV programs you are after. I have already downloaded them and they are ready waiting for you to download |
Correct, and thank you for taking that to another location. The notes in the bug template mention that I don't want this to be a discussion forum, and in general everyone has been good about that. |
|
Scott I totally agree which is why I have set up the email account so that all this asking about ITV programs and not being able to download them can be taken to that account and away from this forum which as you say is only to be used for reporting bugs....I totally understand and am wanting to comply. As soon as the user contacts me I will delete the email address and none of this should happen again. Thanks again for your understanding and your support for this fabulous application....by the way, I am using the older version Version 1.17 (20191130002) and it is working a treat |
|
Sorry all...OK now replied to you, as I said in the email I could find no way to PM you hence asking on the forum of course it's not the thing to ask on here but this is a rather unusual situation re GIA |
|
m1ctk I have replied to your request and have sent you the links to download the programs. |
|
This is an observation but may help .... i posted earlier about not being able to download ITV programmes and at that time was using OS Sierra. I have since upgraded to Catalina and now V1.18.2 is working perfectly. Im no techie so cannot give reasons as to why it does now work, but it does!! Thanks to all for your continuing work on GIA. 5 stars to those involved. |
|
I have tried GIA with Catalina in VM Fusion but everytime I do a search it exists, anyone know why ? I do hope there is a fix soon ! |
|
I appreciate you're busy and have a real job to do too... I'm on OSX 10.11.6, I was wondering if there's going to be a new update for us older OSX users or whether the python hack mentioned earlier in this thread is our only option to getting GiA working again? |
|
I installed Catalina on a USB drive and yes now all downloads are fine though with longer shows I have to exit and restart a few times to complete the donwload. Really hoping there will be an update to fix this and make GIA working on older versions of OSX like High Sierra |
|
If you're on High Sierra there shouldn't be any real issues. It works/worked fine for me. I just updated to Mojave 10.14.6 but 10.13.6 was fine with GIA as well. Having to re-click on ITV downloads has been my experience for a while, also directly with the ITV Player. |
|
10.13.6 high sierra works for me also..i know that doesn't help you if its not...but maybe gives some light at end of the tunnel. |
|
I'm having the same problem again, re downloading ITV programmes. I remain on Sierra 10.12.4, which I appreciate might be at the heart of the issue. As before, a folder is created, but remains empty and GiA presents with its error message. Is it, as previously, a Python issue? Any and all suggestions gratefully received. The log is as follows: _Traceback (most recent call last): |
|
Hi guys, I'm afraid this issue has reappeared this morning when I upgraded GIA to 1.19.1... I knew I should have left well alone but got sick of the little bubble reminding me to upgrade!! :-( I have also updated Python to 2.1.17 from the link above, but no luck... In the log, GIA appears to be using 2.1.10 still, but somehow its failing... I'm not very good with the coding so please could someone more knowledgeable lend some advice? Do i need to re-do the steps above, or somehow remove them from the upgraded GIA? And if I need to remove them how do i do that? This is the log line about Python: Also, its downloading BBC absolutely fine again, only affects ITV shows. |
I'm sorry, I haven't been keeping up with this thread, but it came up again today in another issue. It isn't practical to include an entire distribution of python in GiA. That would massively increase the download size, and is a very heavy solution for the sole purpose of supporting older versions of macOS. Youtube-dl by default uses the system python, whatever that may be, and that's generally fine. However, it can be run with a specific version of python as well. So I think what I can do here is to add a line in the preferences where you can enter the path to an installed version of python. If present GiA can launch youtube-dl with that version of python and that should take care of it. You will still need an updated version of python, but it won't require you to tinker with system software, which is often dangerous. |
|
Look at the comments earlier in this thread (Feb 12) to see how to download latest Python and have GIA use it instead of system version of Python. |
I did see that, but that still requires taking action to fix it, as opposed to just installing the app and it 'just works'. That info could be added to the wiki for this project. Let's do a mini-survey. If you are still having this problem and are satisfied with the workaround, react to this with a thumbs-up. If you would like GiA to provide a fix by looking for python in /usr/local/bin vote thumbs down. If you are on High Sierra or later this doesn't apply to you. EDIT: Comments are fine, but please use the reaction emoji at the top right of my comment above to record your vote. Sorry, I wan't clear. |
|
👎
…On Mon, 7 Dec 2020, 04:32 Scott Kovatch, ***@***.***> wrote:
Look at the comments earlier in this thread (Feb 12) to see how to
download latest Python and have GIA use it instead of system version of
Python.
I did see that, but that still requires taking action to fix it, as
opposed to just installing the app and it 'just works'. That info could be
added to the wiki for this project.
Let's do a mini-survey. If you are still having this problem and are
satisfied with the workaround, react to this with a thumbs-up. If you would
like GiA to provide a fix by looking for python in /usr/local/bin vote
thumbs down. If you are on High Sierra or later this doesn't apply to you.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#277 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AOPK7B37IHKTLNE5OBKLGU3STRLGRANCNFSM4KQYMJ5Q>
.
[ { ***@***.***": "http://schema.org", ***@***.***": "EmailMessage",
"potentialAction": { ***@***.***": "ViewAction", "target": "
#277 (comment)",
"url": "
#277 (comment)",
"name": "View Issue" }, "description": "View this Issue on GitHub",
"publisher": { ***@***.***": "Organization", "name": "GitHub", "url": "
https://github.com" } } ]
|
|
👎
Every time GIA is updated I have the same stress and have to go looking for the fix, and re-teach myself how to do it, as I’m not a particularly IT technical or a “coding” person. Whilst the fix isn’t that difficult itself, it always takes me one or 2 days to figure out whats happened and how to fix it, so it would be way better if that code were bundled with the updates for me. Thanks guys, appreciate the efforts!
… On 7 Dec 2020, at 08:00, candcij ***@***.***> wrote:
👎
On Mon, 7 Dec 2020, 04:32 Scott Kovatch, ***@***.***> wrote:
> Look at the comments earlier in this thread (Feb 12) to see how to
> download latest Python and have GIA use it instead of system version of
> Python.
>
> I did see that, but that still requires taking action to fix it, as
> opposed to just installing the app and it 'just works'. That info could be
> added to the wiki for this project.
>
> Let's do a mini-survey. If you are still having this problem and are
> satisfied with the workaround, react to this with a thumbs-up. If you would
> like GiA to provide a fix by looking for python in /usr/local/bin vote
> thumbs down. If you are on High Sierra or later this doesn't apply to you.
>
> —
> You are receiving this because you authored the thread.
> Reply to this email directly, view it on GitHub
> <#277 (comment)>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AOPK7B37IHKTLNE5OBKLGU3STRLGRANCNFSM4KQYMJ5Q>
> .
> [ { ***@***.***": "http://schema.org", ***@***.***": "EmailMessage",
> "potentialAction": { ***@***.***": "ViewAction", "target": "
> #277 (comment)",
> "url": "
> #277 (comment)",
> "name": "View Issue" }, "description": "View this Issue on GitHub",
> "publisher": { ***@***.***": "Organization", "name": "GitHub", "url": "
> https://github.com" } } ]
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub <#277 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ACIC5H5AOVXMICFDTAJTPDTSTSDQXANCNFSM4KQYMJ5Q>.
|
and others
I am unable to download any ITV programme. (BBC downloads appears to be working correctly)
I am using Get iPlayer Automator Version 1.17 (20191130002) macOS Sierra Version 10.12.6
No proxy is being used.
The diagnosis shown for each failed ITV show is:
Problem Unknown.
Please submit a bug report from the application menu.
Example used:
Endeavour Series 1 Episode 4
The text was updated successfully, but these errors were encountered: