Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Temporary fix for foxaholic (turnstile) #2341

Closed
wants to merge 0 commits into from
Closed

Conversation

watzeedzad
Copy link
Contributor

  • Implement seleniumbase to foxaholic which able to bypass turnstile

Notes:

  • Still unable to figure out how to persist browser window when downloading chapter contents
  • Current implementation for every chapters or images it will open 1 browser window then close. May need to update BasicBrowserTemplate class to implement seleniumbase
  • But at least it work for now XD

@zGadli
Copy link
Contributor

zGadli commented Apr 15, 2024

using nodriver is probably a better idea. check #2326

@watzeedzad
Copy link
Contributor Author

Tested with https://www.foxaholic.com/novel/i-was-caught-up-in-a-hero-summoning-but-that-world-is-at-peace

Able to crawl all of tthe chapters and images but the time the duration is quite long (8-9 hours).

@zGadli For nodriver I not too sure about it as I saw that we need to put async in front for the method and did not sure whether or not it will impact overall functionality of the application or not.

@watzeedzad
Copy link
Contributor Author

@zGadli Also if you insist on go with driverless route. There is another lib call selenium-driverless as well.

But I will not implement it is I already achive my goal on made epub of I Was Caught up in a Hero Summoning, but That World Is at Peace for myself already.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants