In web scraping there are many times you need to play with cookies to extract data from website. In web world, cookies refers to a small piece of data stored on the user’s computer by the web browser while browsing a website. They record user’s browsing information and later it can be recalled. It is mainly used for web analytics and digital ad campaigns. For example how many users visited a particular link and how many of them clicked on the ad. Ecommerce companies also use this to track information of customers who added an item in the cart but transaction has not been made yet.
Make sure selenium is already installed and loaded. In R you can install selenium by using RSelenium package. Also you need to install chrome webdriver for the version of your chrome browser installed on your machine. Once done you can run the commands below to load package and activate the driver.
library(RSelenium)
driverremDr
By using remDr$getAllCookies() you can extract all the cookies and later you can save it in RDS format.
remDr$navigate(“https://www.zillow.com/homes/”)
cookies saveRDS(cookies, “cookies.rds”)
By using remDr$deleteAllCookies() you can delete all the cookies of your browser.
# Delete Cookies
remDr$deleteAllCookies()
You can add previously saved cookies by using function addCookie().
To add a partcular cookies you can use the syntax below.
remDr$addCookie(name = cookies[[1]][[“name”]], value = cookies[[1]][[“value”]])
To add all cookies in loop (one by one). cookies.rds was saved previously, we are reading that RDS file.
remDr$navigate(“https://www.zillow.com/homes/”)
cookies for (i in 1:length(cookies)) {
remDr$addCookie(name = cookies[[i]][[“name”]], value = cookies[[i]][[“value”]])
}
Read MoreListenData
