[ 
https://issues.apache.org/jira/browse/NIFI-8486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17335774#comment-17335774
 ] 

Reese Ann commented on NIFI-8486:
---------------------------------

[~harjitdotsingh] Here's the documentation for the [Job 
resource|https://cloud.google.com/bigquery/docs/reference/rest/v2/Job] in the 
BQ API.
 * Parquet has a group of options job.parquetOptions. Resource type is 
ParquetOptions and is documented 
[here|https://cloud.google.com/bigquery/docs/reference/rest/v2/tables#ParquetOptions].
 * Datastore Backup has a property job.projectionFields[]. 
 * Not seeing any additional options for ORC
 * Turns out Firestore Backup is the same as Datastore Backup. I'll cross it 
out in the description.

 

> Support more options for PutBigQueryBatch Load File Type
> --------------------------------------------------------
>
>                 Key: NIFI-8486
>                 URL: https://issues.apache.org/jira/browse/NIFI-8486
>             Project: Apache NiFi
>          Issue Type: New Feature
>          Components: Extensions
>            Reporter: Reese Ann
>            Assignee: Harjit Singh
>            Priority: Major
>
> The BigQuery API supports the following file type formats:
>  * Avro
>  * CSV
>  * JSON
>  * ORC
>  * Parquet
>  * Datastore exports
>  * Firestore exports
> The GCP PutBigQueryBatch processor only supports the first three. 
> It would be great to support others, particularly Parquet.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to