I'm trying to load a CSV file from google cloud storage to BigQuery. Problem is that the file has nulls for fields that are integers.
I'm using the following
bq_table_load(bq_Temp, bucket_uri, source_format ="CSV", fields = fields_spec, quiet=FALSE)
but the process is erroring out with a bunch of errors like "Could not parse Field as INT64 'with message 'Unable to parse'
Seems BigQuery can't handle nulls unless the field is string. But I'd love to avoid having to re-parse the file when it's in BigQuery. I've tried the autodetect function but the field names come out labelled as 'String1', 'String2', etc. Which is no good either.
Using BigRQuery and BigQueryR