newpipe can't load any youtube link and show no result for any search #4201

mhdzli · 2020-08-28T19:53:55Z

Version

-0.19.8

Steps to reproduce the bug

I search for anything in newpipe and there is no result with a sorry some error occurred message.
If I open any youtube link in newpipe it can't load the page and info.

Screenshots/Screen recordings

Logs

Exception

User Action: searched
Request: swaywm
Content Country: US
Content Language: en-US
App Language: en_US
Service: YouTube
Version: 0.19.8
OS: Linux samsung/a6pltedx/a6plte:10/QP1A.190711.020/A605GDXU6CTC9:user/release-keys 10 - 29

Crash log

org.schabi.newpipe.extractor.exceptions.ParsingException: Could not get ytInitialData
	at org.schabi.newpipe.extractor.services.youtube.YoutubeParsingHelper.getInitialData(YoutubeParsingHelper.java:203)
	at org.schabi.newpipe.extractor.services.youtube.YoutubeParsingHelper.extractClientVersionAndKey(YoutubeParsingHelper.java:222)
	at org.schabi.newpipe.extractor.services.youtube.YoutubeParsingHelper.getKey(YoutubeParsingHelper.java:298)
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeSearchExtractor.getNewNextPageFrom(YoutubeSearchExtractor.java:233)
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeSearchExtractor.getInitialPage(YoutubeSearchExtractor.java:127)
	at org.schabi.newpipe.extractor.utils.ExtractorHelper.getItemsPageOrLogError(ExtractorHelper.java:19)
	at org.schabi.newpipe.extractor.search.SearchInfo.getInfo(SearchInfo.java:55)
	at org.schabi.newpipe.extractor.search.SearchInfo.getInfo(SearchInfo.java:30)
	at org.schabi.newpipe.util.ExtractorHelper.lambda$searchFor$0(ExtractorHelper.java:81)
	at org.schabi.newpipe.util.-$$Lambda$ExtractorHelper$BBduYDeZ_vXMQYaemaggmTPtqvA.call(Unknown Source:8)
	at io.reactivex.internal.operators.single.SingleFromCallable.subscribeActual(SingleFromCallable.java:44)
	at io.reactivex.Single.subscribe(Single.java:3666)
	at io.reactivex.internal.operators.single.SingleSubscribeOn$SubscribeOnObserver.run(SingleSubscribeOn.java:89)
	at io.reactivex.Scheduler$DisposeTask.run(Scheduler.java:578)
	at io.reactivex.internal.schedulers.ScheduledRunnable.run(ScheduledRunnable.java:66)
	at io.reactivex.internal.schedulers.ScheduledRunnable.call(ScheduledRunnable.java:57)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:301)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	at java.lang.Thread.run(Thread.java:919)
Caused by: org.schabi.newpipe.extractor.utils.Parser$RegexException: failed to find pattern "window\["ytInitialData"\]\s*=\s*(\{.*?\});
	at org.schabi.newpipe.extractor.utils.Parser.matchGroup(Parser.java:72)
	at org.schabi.newpipe.extractor.utils.Parser.matchGroup(Parser.java:61)
	at org.schabi.newpipe.extractor.utils.Parser.matchGroup1(Parser.java:52)
	at org.schabi.newpipe.extractor.services.youtube.YoutubeParsingHelper.getInitialData(YoutubeParsingHelper.java:200)
	... 20 more

The text was updated successfully, but these errors were encountered:

opusforlife2 · 2020-08-29T09:19:01Z

Interesting! I've never seen that error message before.

sandeeptardigrade · 2020-08-31T08:29:05Z

this is so frustrating. I am also facing the same error from about a month , before that it was working fine. my phone oneplus 5

mhdzli · 2020-08-31T08:33:04Z

@sandeeptardigrade
I just delete all newpipe data and it works for a while till this happen again ¯_(ツ)_/¯

wb9688 · 2020-08-31T09:21:58Z

If you could still reproduce it, could you install a debug version, connect your phone to your PC through USB, open Chrome, go to chrome://inspect, open that debug version of NewPipe on your phone, select that NewPipe instance in Chrome, go to the Network tab, try to reproduce the issue, and once you've successfully reproduced the issue, right-click in Chrome, select "Save as HAR with Content" and send me that HAR? Then I might be able to fix this issue.

mhdzli · 2020-08-31T17:39:29Z

@wb9688
Absolutely sure! I will be happy if I can be of any help.

wb9688 · 2020-08-31T17:55:00Z

@mhdzli: You could download a debug apk at https://github.com/TeamNewPipe/NewPipe/files/5083926/app-debug.zip (it will install side-by-side)

You'll probably need to export database (in Settings -> Content) from your normal NewPipe and import it into that debugging NewPipe to be able to reproduce it.

Btw have you at any point got a reCAPTCHA in NewPipe?

mhdzli · 2020-08-31T17:59:44Z

@wb9688
Yes I got reCAPCHA every now and then. And thank you and all of newpipe team for this great app.

Tybalta · 2020-09-15T17:35:13Z

I have the same issue...

opusforlife2 · 2020-09-15T17:41:18Z

@Tybalta Could you try this #4201 (comment)? Thanks.

Tybalta · 2020-09-18T09:56:54Z

@Tybalta Could you try this #4201 (comment)? Thanks.
@opusforlife2
I dont know how to do that in chrome? Which chrome? Phone or Pc chrome?

opusforlife2 · 2020-09-18T10:08:48Z

That's okay. We have got HARs above. If none of them helps solve the problem, then we could ask for them again.

Chrome on PC, by the way.

mhdzli · 2020-10-05T11:03:01Z

@wb9688
I installed the debug version and tried reproducing it several times, but everything works fine and the problem just went away. I did everything came into my mind. If you can think of anything that I should consider give me the instruction and I'll try again.

Stypox · 2020-10-16T16:59:46Z

Here is the two network files causing the following crash @wb9688 network.zip

Exception

User Action: searched
Request: fsd
Content Country: US
Content Language: en-US
App Language: en_US
Service: YouTube
Version: 0.20.0
OS: Linux Android 10 - 29

Crash log

org.schabi.newpipe.extractor.exceptions.ParsingException: Could not get ytInitialData
	at org.schabi.newpipe.extractor.services.youtube.YoutubeParsingHelper.getInitialData(YoutubeParsingHelper.java:203)
	at org.schabi.newpipe.extractor.services.youtube.YoutubeParsingHelper.extractClientVersionAndKey(YoutubeParsingHelper.java:222)
	at org.schabi.newpipe.extractor.services.youtube.YoutubeParsingHelper.getKey(YoutubeParsingHelper.java:298)
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeSearchExtractor.getNewNextPageFrom(YoutubeSearchExtractor.java:233)
	at org.schabi.newpipe.extractor.services.youtube.extractors.YoutubeSearchExtractor.getInitialPage(YoutubeSearchExtractor.java:127)
	at org.schabi.newpipe.extractor.utils.ExtractorHelper.getItemsPageOrLogError(ExtractorHelper.java:19)
	at org.schabi.newpipe.extractor.search.SearchInfo.getInfo(SearchInfo.java:55)
	at org.schabi.newpipe.extractor.search.SearchInfo.getInfo(SearchInfo.java:30)
	at org.schabi.newpipe.util.ExtractorHelper.lambda$searchFor$0(ExtractorHelper.java:81)
	at org.schabi.newpipe.util.-$$Lambda$ExtractorHelper$qyxpuXgomWa-cbONQns-pd7zxm0.call(Unknown Source:8)
	at io.reactivex.internal.operators.single.SingleFromCallable.subscribeActual(SingleFromCallable.java:44)
	at io.reactivex.Single.subscribe(Single.java:3666)
	at io.reactivex.internal.operators.single.SingleSubscribeOn$SubscribeOnObserver.run(SingleSubscribeOn.java:89)
	at io.reactivex.Scheduler$DisposeTask.run(Scheduler.java:578)
	at io.reactivex.internal.schedulers.ScheduledRunnable.run(ScheduledRunnable.java:66)
	at io.reactivex.internal.schedulers.ScheduledRunnable.call(ScheduledRunnable.java:57)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:301)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	at java.lang.Thread.run(Thread.java:919)
Caused by: org.schabi.newpipe.extractor.utils.Parser$RegexException: failed to find pattern "window\["ytInitialData"\]\s*=\s*(\{.*?\});
	at org.schabi.newpipe.extractor.utils.Parser.matchGroup(Parser.java:72)
	at org.schabi.newpipe.extractor.utils.Parser.matchGroup(Parser.java:61)
	at org.schabi.newpipe.extractor.utils.Parser.matchGroup1(Parser.java:52)
	at org.schabi.newpipe.extractor.services.youtube.YoutubeParsingHelper.getInitialData(YoutubeParsingHelper.java:200)
	... 20 more

wb9688 · 2020-10-16T18:39:15Z

Could you guys please test the following APK? app-debug.apk.zip

mehedihasanziku · 2020-10-16T18:49:37Z

Please test the APK and tell us if the problem still persists: app-debug.zip

Just tested seems working fine.

Step:
Installed > Import Database from release version > Searched Multiple times, working fine

opusforlife2 · 2020-10-16T19:38:14Z

@mehedihasanziku We don't need the screenshots. Your word is enough.

AnonymousSeal · 2020-10-17T21:55:22Z

so i had the same issue the past couple of days and I was wondering what I should do now. Will a fix be released or should I use the apk that you provided?

opusforlife2 · 2020-10-17T22:05:15Z

@EliasKomar It's already released.

AnonymousSeal · 2020-10-17T22:19:02Z

I'm not sure where to put this question, but i can't install the apk from the website and f-droid warns me that the version is signed with a different key and that I would have to delete the old app (I would lose all the data) in order to install it. Why did the key change and how can I transition without losing my data?

opusforlife2 · 2020-10-17T22:24:24Z

@EliasKomar Export database, uninstall the app, install the new version, import database.

wb9688 · 2020-10-18T06:51:25Z

@EliasKomar: If you've downloaded it from F-Droid, it's possible you downloaded the version that was signed by F-Droid. On GitHub, and on our F-Droid repo we of course sign it with our own keys. Normal F-Droid nowadays has an .apk signed by us and one signed by them.

AnonymousSeal · 2020-10-18T07:28:25Z

Thanks, it works now and I am going to use the NewPipe signed version from now on since I trust the project :)

opusforlife2 · 2020-10-18T07:30:57Z

@EliasKomar Since Newpipe is reproducible, F-Droid's server also signs using Newpipe's key, which means your trust is verified as well. ;)

vomindoraan · 2020-11-11T18:26:39Z

I was able to sidestep this issue by changing my DNS resolver to 1.1.1.1 using the Cloudflare 1.1.1.1 app from the Play Store. Only after doing this has NewPipe v0.20.2 started working over mobile data on my Android 7.1.1 phone.

The issue seems to have occurred because www.youtube.com was inaccessible, whereas m.youtube.com was working fine.

mehedihasanziku · 2020-11-12T09:12:25Z

I was able to sidestep this issue by changing my DNS resolver to 1.1.1.1 using the Cloudflare 1.1.1.1 app from the Play Store. Only after doing this has NewPipe v0.20.2 started working over mobile data on my Android 7.1.1 phone.

The issue seems to have occurred because www.youtube.com was inaccessible, whereas m.youtube.com was working fine.

It was fixed on last version and it was captcha cookie issue, so your issue seems to me different.

G-i-o · 2021-05-15T03:53:22Z

HI.

Just wanted to report that I also was unable to do any search nor downloads or even access any video. Then I read few comments above and sb deleted the app data with success. It happened to me too; once I deleted the cache + data NewPipe appeared to work again.

I have saved the report log of when the issue presented and if you want me to post it or send it somewhere, JLMK. 🙏🏼

P.S. Big thank You to the devs, by the way, for all their great efforts.

opusforlife2 · 2021-05-15T05:51:02Z

@G-i-o Please send it right here as an attachment to your comment. 👍

G-i-o · 2021-05-15T06:26:06Z

👍 @opusforlife2

Please find it below:

2021.05.15 NewPipe Report.txt

Hope it helps.

opusforlife2 · 2021-05-15T07:56:12Z

Oh. @G-i-o I thought you meant you took a logcat or network activity log of when the issue occurred. What you've sent is the Newpipe crash report, which is the same as the original poster's crash report. But thanks, anyway!

G-i-o · 2021-05-15T08:03:13Z

Thought so. Sorry for that. I'll report if it happens again and then try to get a better report following your instructions (I'll ask again then). 🙏️

…

On Sat, 2021-05-15 at 00:56 -0700, opusforlife2 wrote: Oh. @G-i-o I thought you meant you took a logcat or network activity log of when the issue occurred. What you've sent is the Newpipe crash report, which is the same as the original poster's crash report. But thanks, anyway! — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

WickyNilliams · 2021-05-15T19:15:09Z

Exporting my database, clearing data, then reimporting without settings fixed this issue for me. Thanks!

mhdzli added the bug Issue is related to a bug label Aug 28, 2020

opusforlife2 added the youtube Service, https://www.youtube.com/ label Aug 29, 2020

opusforlife2 mentioned this issue Sep 3, 2020

YouTube search and playback broken #4217

Closed

This comment has been minimized.

Sign in to view

opusforlife2 mentioned this issue Sep 8, 2020

Can't search for anything #4250

Closed

This comment has been minimized.

Sign in to view

Stypox closed this as completed Oct 5, 2020

opusforlife2 reopened this Oct 5, 2020

This comment has been minimized.

Sign in to view

Stypox closed this as completed Oct 5, 2020

opusforlife2 mentioned this issue Oct 16, 2020

Always says something went wrong when searching something #4531

Closed

wb9688 mentioned this issue Oct 16, 2020

Fix parsing new ytInitialData TeamNewPipe/NewPipeExtractor#415

Merged

3 tasks

This comment has been minimized.

Sign in to view

wb9688 mentioned this issue Oct 16, 2020

Issue while search on newpipe #4535

Closed

TobiGr closed this as completed in TeamNewPipe/NewPipeExtractor#415 Oct 16, 2020

This was referenced Oct 17, 2020

Search Error #4538

Closed

searching for anything produces crash #4539

Closed

FireMasterK mentioned this issue Oct 21, 2020

[YouTube Change] Search result are sometimes empty iv-org/invidious#1422

Closed

johnth3doe mentioned this issue May 11, 2021

"Debugger" NewPipe for better logs? #6267

Open

3 tasks

AudricV removed the more info needed label May 18, 2021

newpipe can't load any youtube link and show no result for any search #4201

newpipe can't load any youtube link and show no result for any search #4201

Comments

mhdzli commented Aug 28, 2020

Version

Steps to reproduce the bug

Screenshots/Screen recordings

Logs

Exception

opusforlife2 commented Aug 29, 2020

sandeeptardigrade commented Aug 31, 2020

mhdzli commented Aug 31, 2020

wb9688 commented Aug 31, 2020

mhdzli commented Aug 31, 2020

wb9688 commented Aug 31, 2020

mhdzli commented Aug 31, 2020

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Tybalta commented Sep 15, 2020

opusforlife2 commented Sep 15, 2020

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Tybalta commented Sep 18, 2020 • edited Loading

opusforlife2 commented Sep 18, 2020

mhdzli commented Oct 5, 2020

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

Stypox commented Oct 16, 2020

Exception

This comment has been minimized.

wb9688 commented Oct 16, 2020 • edited Loading

mehedihasanziku commented Oct 16, 2020

opusforlife2 commented Oct 16, 2020

AnonymousSeal commented Oct 17, 2020

opusforlife2 commented Oct 17, 2020

AnonymousSeal commented Oct 17, 2020

opusforlife2 commented Oct 17, 2020

wb9688 commented Oct 18, 2020

AnonymousSeal commented Oct 18, 2020

opusforlife2 commented Oct 18, 2020

vomindoraan commented Nov 11, 2020

mehedihasanziku commented Nov 12, 2020

G-i-o commented May 15, 2021

opusforlife2 commented May 15, 2021

G-i-o commented May 15, 2021

opusforlife2 commented May 15, 2021

G-i-o commented May 15, 2021 via email

WickyNilliams commented May 15, 2021

Tybalta commented Sep 18, 2020 •

edited

Loading

wb9688 commented Oct 16, 2020 •

edited

Loading