[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17131260#comment-17131260 ] Beam JIRA Bot commented on BEAM-8089: - This issue was marked "stale-assigned" and has not received a

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121920#comment-17121920 ] Kenneth Knowles commented on BEAM-8089: --- This issue is assigned but has not received an update in 30

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916117#comment-16916117 ] Chamikara Jayalath commented on BEAM-8089: -- Have you tried running Dataflow in the same region as

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916053#comment-16916053 ] Harshit Dwivedi commented on BEAM-8089: --- The data ingested into GCS is around 250Gb for us per day,

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916052#comment-16916052 ] Chamikara Jayalath commented on BEAM-8089: -- BTW may I ask why you cannot use GCS in this case ?

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916051#comment-16916051 ] Chamikara Jayalath commented on BEAM-8089: -- I don't think we can fork Beam code for a very

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916037#comment-16916037 ] Harshit Dwivedi commented on BEAM-8089: --- For my use-case, I have a single worker and since that runs

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916033#comment-16916033 ] Chamikara Jayalath commented on BEAM-8089: -- True, seems like this is supported in a limited way

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916022#comment-16916022 ] Harshit Dwivedi commented on BEAM-8089: --- But the BQ documentation says that this can be done, 

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915992#comment-16915992 ] Chamikara Jayalath commented on BEAM-8089: -- BQ cannot execute load jobs from local files. Files

[jira] [Commented] (BEAM-8089) Error while using customGcsTempLocation() with Dataflow

[ https://issues.apache.org/jira/browse/BEAM-8089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915624#comment-16915624 ] Ismaël Mejía commented on BEAM-8089: Reassigned to you [~chamikara], maybe you can take a look or find