hybrid between scraper and selenium

[alzamer2]

so here is the thing i have this script
FETCH_JS_SCRIPT = """ var url = arguments[0]; var options = JSON.parse(arguments[1]); var callback = arguments[arguments.length - 1]; async function dispatch() { var data = null; try { const resp = await fetch(url, options); data = { 'headers': Object.fromEntries(resp.headers.entries()), 'ok': resp.ok, 'status': { 'code': resp.status, 'text': resp.statusText, }, 'text': await resp.text(), } callback(data); } catch (error) { callback(data); } }; dispatch(); """

that i can use it with
self._driver.execute_async_script(FETCH_JS_SCRIPT, url, json.dumps(opt_string))

to get the chapter text while bypassing cloudflare
url = api_url
opt_string = is dict information for calling
example

opt_string = {"headers": {
"authorization": "Bearer eyJhbGciOiJSUzI1NiIsImtpZCI6IjZBOEYzN",
"content-type": "application/grpc-web+proto",
"x-grpc-web": "1"
},
"referrer": "https://www.wuxiaworld.com/novel/nine-star-hegemon/nshba-chapter-4448",
"referrerPolicy": "no-referrer-when-downgrade",
"body": "\u0000\u0000\u0000\u0000+\n)\u0012'\n\u0011nine-star-hegemon\u0012\u0012nshba-chapter-4448",
"method": "POST",
}

of course this is selenium base (undetected_chromedriver) but its only loading the apiurl like how requests do