bgeng777 commented on issue #282:
URL: 
https://github.com/apache/incubator-wayang/issues/282#issuecomment-1507208045

   Hi there, thanks for creating this issue. I am new to wayang and when I 
tried to follow the current README to run the wordcount example, I met the 
problem that there is no wayang-submit script. 
   I finally managed to run the example with wayang-submit and the process is 
as follows:
   #### 1. Get the wayang-submit binary
   As @zkaoudi mentioned, there is no wayang-submit binary file in the 
downloaded zip file. To get the binary, I build the main branch of the repo 
with `./mvnw clean install -DskipTests  ` and finally get the jar in the repo's 
`bin` folder:
   
![image](https://user-images.githubusercontent.com/80749729/231810865-45ab3141-5558-4d8e-8d74-ddea3b1c21a4.png)
   #### 2. Copy the binary to extracted apache-wayang-0.6.0-incubating folder 
and relevant jars for the WordCount example
   After copying wayang-submit to extracted apache-wayang-0.6.0-incubating 
folder, I tried to run command like `wayang-submit 
org.apache.wayang.apps.wordcount.Main java file://$(pwd)/README.md`, but I met 
many errors about class missing. 
   After some debugging, I make dir named 'jars' under WAYANG_HOME (it looks 
like Wayang will add jars under WAYANG_HOME/jars into the classpath) and copied 
following jars from the project repo into it(these jars should be built or 
downloaded by maven after building the project).
   
![image](https://user-images.githubusercontent.com/80749729/231811530-0afcb611-ed00-43a1-81a6-89be1a60ed1e.png)
   #### 3. Run `wayang-submit` with WordCount example
   After step 1 and 2, I can run:
   ```
   wayang-submit org.apache.wayang.apps.wordcount.Main java 
file://$(pwd)/README.md
   ```
   and get the output:
   
![image](https://user-images.githubusercontent.com/80749729/231813486-ee7eedf0-6d5e-4c17-bde1-91354c9ee509.png)
   
   
   So according to my experience, I believe there are at least 2 more things we 
may need to take care:
   1. Add necessary jars into the released package
   2. Avoid printing some meaningless info in the terminal like:
   
![image](https://user-images.githubusercontent.com/80749729/231814329-0c177e54-f896-4539-a46a-3ef93823a714.png)
   3. We may need to get rid of `aws-java-sdk-bundle-1.11.271.jar` dependency 
when running locally.
   
   I hope my experience can help others who just want to give a try on the 
quickstart and I am willing to help to make this process more smooth and 
user-friendly.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to