[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086675#comment-16086675
]
Dmitry Demeshchuk commented on BEAM-2572:
-
[~altay] I actually had to struggle quite a lot before I
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086535#comment-16086535
]
Dmitry Demeshchuk commented on BEAM-2572:
-
re 1: I just don't want us to end up in a situation like
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086434#comment-16086434
]
Dmitry Demeshchuk commented on BEAM-2572:
-
Couple problems that come to my mind about
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086231#comment-16086231
]
Dmitry Demeshchuk commented on BEAM-2572:
-
[~ste...@apache.org]: Hundred percent agree. My thinking
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086202#comment-16086202
]
Dmitry Demeshchuk commented on BEAM-2572:
-
Hi Cham,
That sounds good, let's focus on the
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084981#comment-16084981
]
Dmitry Demeshchuk commented on BEAM-2572:
-
Also, just a random thought. How does this look to you?
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084978#comment-16084978
]
Dmitry Demeshchuk commented on BEAM-2572:
-
I agree that resource access is a filesystem problem,
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16084932#comment-16084932
]
Dmitry Demeshchuk commented on BEAM-2572:
-
So, what do you folks think about the approach from
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083268#comment-16083268
]
Dmitry Demeshchuk commented on BEAM-2572:
-
Nevermind my last comment, credentials would have to be
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083108#comment-16083108
]
Dmitry Demeshchuk edited comment on BEAM-2572 at 7/11/17 10:39 PM:
---
For
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083101#comment-16083101
]
Dmitry Demeshchuk commented on BEAM-2572:
-
[~robertwb]: yes, by "hidden" I meant not exposing some
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083113#comment-16083113
]
Dmitry Demeshchuk commented on BEAM-2572:
-
Or, alternatively, we could state that filesystem
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083108#comment-16083108
]
Dmitry Demeshchuk commented on BEAM-2572:
-
For example, in my particular case, it would be
[
https://issues.apache.org/jira/browse/BEAM-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082850#comment-16082850
]
Dmitry Demeshchuk commented on BEAM-2573:
-
Finally, after some fighting dependency issues, made it
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081374#comment-16081374
]
Dmitry Demeshchuk commented on BEAM-2572:
-
How about the following plan, then?
1. Add an ability
[
https://issues.apache.org/jira/browse/BEAM-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081179#comment-16081179
]
Dmitry Demeshchuk commented on BEAM-2573:
-
[~altay]: I was doing exactly the option 2, yes.
My
[
https://issues.apache.org/jira/browse/BEAM-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080997#comment-16080997
]
Dmitry Demeshchuk commented on BEAM-2573:
-
[~sb2nov] Thanks for the explanation! I'll wait till the
[
https://issues.apache.org/jira/browse/BEAM-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080933#comment-16080933
]
Dmitry Demeshchuk commented on BEAM-2573:
-
Hmm, looks like it was indeed a dependency issue which
[
https://issues.apache.org/jira/browse/BEAM-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080889#comment-16080889
]
Dmitry Demeshchuk commented on BEAM-2573:
-
Hmm, now it's getting a bit past that, but my pipeline
[
https://issues.apache.org/jira/browse/BEAM-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16080867#comment-16080867
]
Dmitry Demeshchuk commented on BEAM-2573:
-
So, I tried to switch to the head version of the SDK and
[
https://issues.apache.org/jira/browse/BEAM-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dmitry Demeshchuk updated BEAM-2573:
Affects Version/s: 2.0.0
> Better filesystem discovery mechanism in Python SDK
>
[
https://issues.apache.org/jira/browse/BEAM-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078889#comment-16078889
]
Dmitry Demeshchuk commented on BEAM-2573:
-
Here's a quick example of the file being picked up
Dmitry Demeshchuk created BEAM-2573:
---
Summary: Better filesystem discovery mechanism in Python SDK
Key: BEAM-2573
URL: https://issues.apache.org/jira/browse/BEAM-2573
Project: Beam
Issue
[
https://issues.apache.org/jira/browse/BEAM-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078746#comment-16078746
]
Dmitry Demeshchuk commented on BEAM-2572:
-
The biggest blocker for me right now is to make the
Dmitry Demeshchuk created BEAM-2572:
---
Summary: Implement an S3 filesystem for Python SDK
Key: BEAM-2572
URL: https://issues.apache.org/jira/browse/BEAM-2572
Project: Beam
Issue Type: Task
25 matches
Mail list logo
