RStudio Cloud installs arrow package without support for compression or S3

When I set up a new project on RStudio Cloud and install the arrow package from CRAN, the Linux binary does not include support for compression or reading directly from S3:

install.packages('arrow')
library(arrow)
codec_is_available('snappy')
[1] FALSE
codec_is_available('gzip')
[1] FALSE
codec_is_available('brotli')
[1] FALSE
codec_is_available('zstd')
[1] FALSE
codec_is_available('lz4')
[1] FALSE
codec_is_available('bz2')
[1] FALSE
arrow_with_s3()
[1] FALSE

These all show as TRUE if I install the arrow package from the RStudio Public Package Manager on a Linux Docker container. Is there a way to have RStudio Cloud install the version of the package from the RStudio Public Package Manager that supports compression and reading files from S3?

Hi,

You could try something like this and install the package directly from RSPM:

> options(repos = c(RPSM = "https://packagemanager.rstudio.com/all/__linux__/xenial/latest"))
> options('repos')
$repos
                                                            RPSM 
"https://packagemanager.rstudio.com/all/__linux__/xenial/latest" 

> install.packages('arrow')
Installing package into ‘/home/rstudio-user/R/x86_64-pc-linux-gnu-library/4.0’
(as ‘lib’ is unspecified)
trying URL 'https://packagemanager.rstudio.com/all/__linux__/xenial/latest/src/contrib/arrow_3.0.0.tar.gz'
Content type 'binary/octet-stream' length 17238743 bytes (16.4 MB)
==================================================
downloaded 16.4 MB

* installing *binary* package ‘arrow’ ...
* DONE (arrow)

The downloaded source packages are in
	‘/tmp/RtmpuvUCSu/downloaded_packages’
> library(arrow)

Attaching package: ‘arrow’

The following object is masked from ‘package:utils’:

    timestamp

> arrow_with_s3()
[1] TRUE

RStudio Cloud doesn't use RSPM by default because a handful of binary packages it produces are not compatible with RStudio Cloud. We're working to address that issue, but I think you should be totally fine in this case.

1 Like

That worked, thank you!

1 Like

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.

If you have a query related to it or one of the replies, start a new topic and refer back with a link.