I am running RStudio Connect version 220.127.116.11-7 with R 3.5.1 on an EC2 instance. For my shiny apps I'm reading large feather files, my largest being almost 2 GB. When I read the files locally, feather is by far the fastest but when I read from the server feather files take more than 7 times what they do locally and RData and Rds are faster. Below are the run benchmark times for local and on the Connect Server.
Local Results, Feather is
Here are the results run from Connect, which includes pulling the file from S3:
In the logs I do see that I frequently get the following error:
Error in value[[3L]](cond) : IO error: Memory mapping file failed 06/20 02:19:46.934 Calls: local ... tryCatch -> tryCatchList -> tryCatchOne -> <Anonymous> 06/20 02:19:46.934 Execution halted
These 3 issues seems to be somewhat related to what I'm seeing but it sounds like an issue with feather files and it appears they will likely not be resolved.
Because all my apps have fairly large data sets I'm hoping I can find a solution that get's me much closer to that 1.7 avg. read time that I see locally. 14 seconds is not ideal for the end user experience. Any thoughts on this would be appreciated!