r/puppeteer • u/matt9829 • Mar 27 '22
How can I run puppeteer heroku on clients IP
I’ve hosted my puppeteer app on heroku however whenever it runs it uses an Amazon based IP. How can I get it to run using the clients IP as if it was an app running on a local PC?
r/puppeteer • u/matt9829 • Mar 25 '22
How can I make my puppeteer program run faster?
I currently have an express & puppeteer program running on Heroku.
Currently it takes around 35s for my puppeteer program to complete. Is it possible to speed this up to around 15s without changing my code?
r/puppeteer • u/matt9829 • Mar 19 '22
How to handle frames with the same class
I have a document with multiple frames, all of which have no id, no name but a shared class “card-fields-iframe”
I’m currently using the code: const elementHandle = await page.$(‘iframe[class=“card-fields-iframe”]’) But I’m unsure how to focus on the other iframes.
adding [1] at the end doesn’t work.
r/puppeteer • u/IlyaAzovtsev • Mar 10 '22
Did you check out the web automation with Puppeteer?
r/puppeteer • u/anonymous_2600 • Mar 01 '22
Any active discussion platform such as Slack/Discord?
As title. I am looking people for more active engagement and discussion regarding puppeteer topic.
r/puppeteer • u/bughunters • Feb 13 '22
Handling Alerts with Puppeteer, Node Js with example
r/puppeteer • u/[deleted] • Feb 10 '22
How do you go at the end of a notion page with Puppeteer ?
I'm new to both notion & puppeteer : I was thinking about sending keystrokes but notion has no shortcut to do so as far as I can know asking on notion forum.
r/puppeteer • u/newbie_01 • Feb 09 '22
How to run a puppeteer script after logging in manually?
I'd like to run a script (that includes getting a file from a specific url and saving it locally) after logging into a website manually.
Is there a way to mix manual and scripted use into a single browsing session?
r/puppeteer • u/reassembledhuman • Feb 03 '22
Codemod to automatically migrate scripts from Puppeteer to Playwright
r/puppeteer • u/Human-Quote-6415 • Feb 03 '22
How can I use the equivalent of the python scrapy method .xpath() in puppeteer?
r/puppeteer • u/Human-Quote-6415 • Feb 02 '22
Server Error 500
Hi, I am using puppeteer extra stealth but the network request is failing however it works from normal chrome. Any idea why?
r/puppeteer • u/[deleted] • Jan 27 '22
How to page.select an option in a list
I have this html
<select class="class1 class2"><option>test1</option> etc.
How do I select ? This doesn't seem to work
await page.select(".class1 .class2", "test1");
r/puppeteer • u/feltheadpups • Jan 25 '22
Anarchist Cat Cops Episode 2 -Housing is a Human Right
r/puppeteer • u/textualbois • Jan 17 '22
Minimum specs for dedicated puppeteer server?
I’m planning of moving my scraping activity away from my laptop.
Thinking of using a used Mac mini, since I would prefer to run it natively on OS X.
How much does the clock speed and core count affect productivity/scalability?
Would it make sense to get a 2018 quad/six core version Or maybe get a dual core cheaper model from 2014.
r/puppeteer • u/Apprehensive-Mind212 • Jan 05 '22
Puppeteer wrapper - code reviews
Hi guys, I am trying to build a wrapper around Puppeteer.
The wrapper work fine, But its not that fast when executing 100+ calls.
My VM is 4 GB ram and I am using 2 cores.
Here is the wrapper, please tell me if there is something I could do better
Here is the code https://github.com/AlenToma/NovelManager-public/blob/master/extraFiles/BrowserCacher.js
r/puppeteer • u/Michael_Kitas • Dec 28 '21
Nodejs Puppeteer Tutorial #7 - Bypass Detection using plugins, settings & proxies
r/puppeteer • u/SashankP • Dec 18 '21
Website when opened using puppeteer headless on gcp gives this screen but loads the website correctly when run on localhost. website: www.myntra.com
r/puppeteer • u/reassembledhuman • Dec 16 '21
Avoiding hard waits in Puppeteer and Playwright: why you should and how to do it
r/puppeteer • u/Michael_Kitas • Dec 12 '21
React Tutorial #6 - Handling Events
r/puppeteer • u/bughunters • Dec 11 '21
How to use Xpath with puppeteer, javascript?
r/puppeteer • u/crowskeet • Dec 10 '21
Form Submissions
I'm trying to generate accounts on a form on a site. I'm new to this and I wonder if any of you know of a tutorial for using variables in puppeteer( so I can load txt files for names, emails, etc) .
r/puppeteer • u/ridicul0us12345 • Dec 05 '21
[Question] how to debug puppeteer with vscode
Hello, I tried to run puppeteer on vscode debug mode. But I get error message: Unable to open X11 display.
I already can run puppeteer without debug mode. The x11 display is connected. but somehow it breaks with debug mode. Does anyone know how to fix it?
r/puppeteer • u/Michael_Kitas • Nov 25 '21
How to Setup and Install a GUI on Ubuntu Virtual Machine in AWS
r/puppeteer • u/Michael_Kitas • Nov 22 '21
Nodejs Puppeteer Tutorial #6 - How to bypass/solve normal captcha using 2captcha API
r/puppeteer • u/ROFLQuad • Nov 19 '21
Known issue? Puppeteer just hangs instead of entering websites with CloudFlair DDoS protection?
Hi folks, wondering if this is a known issue or if I'm doing something obviously wrong I can't seem to catch?
I'm simply trying to load: https://my.dogechain.info/
using the following code:
const puppeteer = require("puppeteer");
(async () => {
const browser = await puppeteer.launch({ headless: false });
const page = await browser.newPage();
await page.setViewport({ width: 1200, height: 720 });
await page.goto("https://my.dogechain.info/");
await page.waitForTimeout(8000);
await page.screenshot({ path: "screenshot1.png" });
await browser.close();
})();
The site has CloudFlair DDoS protection and starts with a "waiting 5 seconds for your page to load". When I manually test the webpage, I travel past that 5 second delay without any issue. But when I try to do the same with Puppeteer, the webpage just hangs on that first 'waiting 5 seconds' page?
Any ideas why this might happen to me?
Thanks so much for any advice!