How to use crawler with Rcrawler for automatic download in r?

rstudio

#1

i want to download tools in this web with Rcrawler and Rselenium package but the process is long time
and this is my code

url <- "https://www.knowledgeleader.com/KnowledgeLeader/Content.nsf/klTools.xsp"
Rcrawler(Website = "https://www.knowledgeleader.com/KnowledgeLeader/Content.nsf/klTools.xsp", urlregexfilter ="klTools.xsp" )

i want to simple this code and download all page in tools tab but it’s download anything in the website,
can anyone help me how to correctly download for all tools in tab ?
thank for anyone who want to help me :slight_smile:


#2

I am not too familiar with Rcrawler, but I’d encourage you to start with by working through examples posted online. Here’s one using rvest.
And if you’re stuck on using RCrawler, just google for “RCrawler examples”.

If you have some problematic code you’d like feedback on, be sure to post a reproducible example. This will make it easier for people to help you out.