Quick update, I've been trying to get a test to deploy to RStudio Connect for reading fst files from S3. I'm getting the following error when I deploy to connect. I tried changing all factors to characters in my data frame and still get this error when I move to connect. It works locally, performance isn't better locally but it might be on the server, if I could get it to deploy.
09/04 13:49:01.855
Error in `levels<-`(`*tmp*`, value = as.character(levels)) :
09/04 13:49:01.855
factor level [8] is duplicated
I then went on to try the new arrow package. Again slower locally but I cannot get this to deploy to connect. I tried including the Rcpp library, not including it and also adding the arrow::install_arrow() but I still get the error message below.
library(Rcpp)
library(arrow)
arrow::install_arrow()
09/16 13:58:06.293
Error in io___MemoryMappedFile__Open(fs::path_abs(path), mode) :
09/16 13:58:06.293
Cannot call io___MemoryMappedFile__Open(). Please use arrow::install_arrow() to install required runtime libraries.
09/16 13:58:06.293
Calls: local ... shared_ptr -> shared_ptr_is_null -> io___MemoryMappedFile__Open
Not sure if anyone has gotten fst or the new arrow feather/parquet to work on connect?