I’m trying to reproduce the same code that I test in Rstudio desktop on Rstudio cloud. I have a little example to test how to use sparklyr in a local spark (installed like a package).
It works properly in Rstudio desktop, but It doesn’t work with Rstudio cloud.
When I run the R code, the connection with spark local doesn’t work and I can not continue.
This is my simple code:
install.packages("sparklyr") library(sparklyr) spark_install(version = "2.1.0") devtools::install_github("rstudio/sparklyr") library(sparklyr) install.packages(c("nycflights13", "Lahman")) library(nycflights13) library(Lahman) library(dplyr) sc <- spark_connect(master = "local") iris_tbl <- copy_to(sc, iris) flights_tbl <- copy_to(sc, nycflights13::flights, "flights") batting_tbl <- copy_to(sc, Lahman::Batting, "batting") src_tbls(sc) flights_tbl %>% filter(dep_delay == 2)
Are there problems to support this?
The code works properly in RStudio Desktop.