Getting error while using grepl commands in sparklyr code

General
1

Pulled data from hdfs path and stored it in spark data frame.
Have a requirement of adding new column from the existing column data .If it contains one specific word, we have to add new value to that new column. So tried using grepl command in sparklyr code.

But unfortunately , encountering issue in running that piece of code. Below is the error. Will grepl commands work in sparklyr code. Kindly let me know further.

Error: org.apache.spark.sql.catalyst.parser.ParseException: extraneous input '(' expecting {<EOF>, ',', 'FROM', 'WHERE', 'GROUP', 'ORDER', 'HAVING', 'LIMIT', 'LATERAL', 'WINDOW', 'UNION', 'EXCEPT', 'MINUS', 'INTERSECT', 'SORT', 'CLUSTER', 'DISTRIBUTE'} -----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------^^^ FROM (SELECT FROM (SELECT In addition: Warning messages: 1: Named arguments ignored for SQL GREPL 2: Named arguments ignored for SQL GREPL

1 Like
2

@sankar1749
lease show a reproducible example. reprex might help you.

3

This topic was automatically closed 21 days after the last reply. New replies are no longer allowed.

If you have a query related to it or one of the replies, start a new topic and refer back with a link.