[jira] [Commented] (BEAM-2794) Failed to run Wordcount example following quick start guide

2017-09-27 Thread Jing Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-2794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16183484#comment-16183484
 ] 

Jing Chen commented on BEAM-2794:
-

Hi Huafeng,
I believe it is not a bug.

I would suggest you get the word count code outside the beam project's root 
directory, which means, make sure that your current working directory is not 
the beam's root project when you run the maven command from java quickstart.

if you run command at the root directory of the beam project, it would lead to 
*transitive properties*. 

As you can see from your printed stack, version for beam-sdks-java-core, 
beam-sdks-java-extensions-google-cloud-platform-core and 
beam-sdks-java-extensions-protobuf are 0.1.

FYI, it makes difference if you run the command outside the root directory of 
the beam project. 

{noformat}
$ diff ~/beam/word-count-beam/pom.xml ~/word-count-beam/pom.xml 
17c17,20
< -->http://maven.apache.org/POM/4.0.0; 
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; 
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd;>
---
> -->
> http://maven.apache.org/POM/4.0.0;
>  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;
>  xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
> http://maven.apache.org/xsd/maven-4.0.0.xsd;>
19,23d21
<   
< beam-parent
< org.apache.beam
< 2.2.0-SNAPSHOT
<   
59a58
> true
130c129
< 
---
>  implementation="org.apache.maven.plugins.shade.resource.ServicesResourceTransformer"/>
{noformat}

> Failed to run Wordcount example following quick start guide
> ---
>
> Key: BEAM-2794
> URL: https://issues.apache.org/jira/browse/BEAM-2794
> Project: Beam
>  Issue Type: Bug
>  Components: examples-java
>Reporter: Huafeng Wang
>Assignee: Reuven Lax
>Priority: Minor
>
> Try to run the wordcount example according to the quick start but I got the 
> resolution failure:
> {code}
> [INFO] 
> 
> [INFO] Building word-count-beam 0.1
> [INFO] 
> 
> [WARNING] The POM for org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 is missing, 
> no dependency information available
> [WARNING] Failed to retrieve plugin descriptor for 
> org.eclipse.m2e:lifecycle-mapping:1.0.0: Plugin 
> org.eclipse.m2e:lifecycle-mapping:1.0.0 or one of its dependencies could not 
> be resolved: Failure to find org.eclipse.m2e:lifecycle-mapping:jar:1.0.0 in 
> https://repo.maven.apache.org/maven2 was cached in the local repository, 
> resolution will not be reattempted until the update interval of central has 
> elapsed or updates are forced
> [WARNING] The POM for org.apache.beam:beam-sdks-java-core:jar:0.1 is missing, 
> no dependency information available
> [WARNING] The POM for 
> org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:jar:0.1 
> is missing, no dependency information available
> [WARNING] The POM for 
> org.apache.beam:beam-sdks-java-extensions-protobuf:jar:0.1 is missing, no 
> dependency information available
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time: 0.960 s
> [INFO] Finished at: 2017-08-16T14:14:42+08:00
> [INFO] Final Memory: 18M/309M
> [INFO] 
> 
> [ERROR] Failed to execute goal on project word-count-beam: Could not resolve 
> dependencies for project org.example:word-count-beam:jar:0.1: The following 
> artifacts could not be resolved: 
> org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:jar:0.1, 
> org.apache.beam:beam-sdks-java-extensions-protobuf:jar:0.1: Failure to find 
> org.apache.beam:beam-sdks-java-extensions-google-cloud-platform-core:jar:0.1 
> in https://repo.maven.apache.org/maven2 was cached in the local repository, 
> resolution will not be reattempted until the update interval of central has 
> elapsed or updates are forced -> [Help 1]
> {code}
> My environment's network is all good.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (BEAM-2857) Create FileIO in Python

2017-09-26 Thread Jing Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181843#comment-16181843
 ] 

Jing Chen commented on BEAM-2857:
-

Ok, I just cannot see “assign to me” button, then I will create a pull request 
directly after I finish this.  Thanks

> Create FileIO in Python
> ---
>
> Key: BEAM-2857
> URL: https://issues.apache.org/jira/browse/BEAM-2857
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py-core
>Reporter: Eugene Kirpichov
>  Labels: starter
>
> Beam Java has a FileIO with operations: match()/matchAll(), readMatches(), 
> which together cover the majority of needs for general-purpose file 
> ingestion. Beam Python should have something similar.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Commented] (BEAM-2857) Create FileIO in Python

2017-09-26 Thread Jing Chen (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-2857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181780#comment-16181780
 ] 

Jing Chen commented on BEAM-2857:
-

i want to take a stab at this ticket, can you please add me to contributor 
list? Thanks

> Create FileIO in Python
> ---
>
> Key: BEAM-2857
> URL: https://issues.apache.org/jira/browse/BEAM-2857
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py-core
>Reporter: Eugene Kirpichov
>  Labels: starter
>
> Beam Java has a FileIO with operations: match()/matchAll(), readMatches(), 
> which together cover the majority of needs for general-purpose file 
> ingestion. Beam Python should have something similar.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)