-
-
Notifications
You must be signed in to change notification settings - Fork 16.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: added puppeteer loader node #314
feat: added puppeteer loader node #314
Conversation
It seems that there are some merge conflicts now since the new emergency changes were made. I will update this tomorrow. |
How are you testing it? |
I ran the build and start command according to the contributing guidelines. I also created the above chain for testing purposes. I confirmed that the "Puppeteer Web Scraper" node was scraping documents successfully. Then I used the "Pinecone Upsert Document" node to confirm that they were being scraped and then pulled into memory by the language model. Everything works the same as the cherio reference code. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks @AidanTilgner! lgtm
* feat: adFlow auto layout * chore: delete file and build pnpm lock file
This reverts commit ba1451a.
I updated the
components
package to add the puppeteer integration described in this issue. This is my first PR here, so let me know if I need to change anything/everything.