I'm now getting the following error when running the collect function when creating the object "match_cat"
Error in storage.mode(x) <- "double" : (list) object cannot be coerced to type 'double'
if I separate the code into two blocks
match_cat <- df2_n2_s %>%
filter(SalesRankProductCategoryID %in% df2_s)
match <- collect(match_cat)
then I get this error
Error in UseMethod("escape") : no applicable method for 'escape' applied to an object of class "c('tbl_spark', 'tbl_sql', 'tbl_lazy', 'tbl')"
Any ideas?