Cool. Here is the sample I got.
install.packages("sparklyr")
library(sparklyr)
spark_install(version = "2.1.0")
sc <- spark_connect(master = "local")
library(dplyr)
iris_tbl <- copy_to(sc,iris)
Here Iris dataset is getting copied to spark right? So in order to copy the data into a spark, first we need to load data into R right? If that is the case, my data is very huge, I cannot even import in R due to which I cannot copy into Spark.
please correct me if my understanding is wrong