I am not sure how I can run an R function like Prime() from the numbers package in Spark using Sparklyr or any other pacakage. I know that the I can use mutate to to perform arithmetic operations on the dataframe, and use spark.apply for running a defined function. But not sure how to convert a Packaged function like Prime to Spark code for faster processing.
This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.