[jira] [Commented] (PIO-176) Clean up unmanaged sources in the data module

2018-10-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/PIO-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16637858#comment-16637858
 ] 

ASF GitHub Bot commented on PIO-176:


Github user asfgit closed the pull request at:

https://github.com/apache/predictionio/pull/477


> Clean up unmanaged sources in the data module
> -
>
> Key: PIO-176
> URL: https://issues.apache.org/jira/browse/PIO-176
> Project: PredictionIO
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.13.0
>Reporter: Donald Szeto
>Priority: Minor
>
> There was a hack in {{build.sbt}} for switching between Spark 1.x and 2.x 
> specific code. With PIO-171 completed, that should be cleaned up.
> Specifically, these 
> [lines|https://github.com/apache/predictionio/blob/718ebe2e8e98c5462d14ad2663c65288f0409972/build.sbt#L140-L141]
>  should be removed. The source that it refers to should be refactored 
> properly in the main source code.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (PIO-176) Clean up unmanaged sources in the data module

2018-10-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/PIO-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16637856#comment-16637856
 ] 

ASF GitHub Bot commented on PIO-176:


Github user dszeto commented on the issue:

https://github.com/apache/predictionio/pull/477
  
LGTM. Merging. Thanks @saurabh3091 !


> Clean up unmanaged sources in the data module
> -
>
> Key: PIO-176
> URL: https://issues.apache.org/jira/browse/PIO-176
> Project: PredictionIO
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.13.0
>Reporter: Donald Szeto
>Priority: Minor
>
> There was a hack in {{build.sbt}} for switching between Spark 1.x and 2.x 
> specific code. With PIO-171 completed, that should be cleaned up.
> Specifically, these 
> [lines|https://github.com/apache/predictionio/blob/718ebe2e8e98c5462d14ad2663c65288f0409972/build.sbt#L140-L141]
>  should be removed. The source that it refers to should be refactored 
> properly in the main source code.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (PIO-176) Clean up unmanaged sources in the data module

2018-10-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/PIO-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16636820#comment-16636820
 ] 

ASF GitHub Bot commented on PIO-176:


GitHub user saurabh3091 opened a pull request:

https://github.com/apache/predictionio/pull/477

[PIO-176] Clean up unmanaged sources in the data module



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/saurabh3091/predictionio develop

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/predictionio/pull/477.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #477


commit 093a4d0ab778064f1349c21be7ff4d606d4ebbf4
Author: saurabh gulati 
Date:   2018-10-02T14:22:23Z

[PIO-171] Hack in build.sbt for switching between Spark 1.x and 2.x should 
be cleaned up.

commit 977186ad43794885ca6d46606395eaccec0f292c
Author: saurabh gulati 
Date:   2018-10-03T09:42:56Z

[PIO-176] reverted PPythonEventStore and added it to 'data' module

commit 7b93a7c8796358cedf482419d3fe4ae9c990ccfb
Author: saurabh gulati 
Date:   2018-10-03T11:21:18Z

[PIO-176] added a new line at the end




> Clean up unmanaged sources in the data module
> -
>
> Key: PIO-176
> URL: https://issues.apache.org/jira/browse/PIO-176
> Project: PredictionIO
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.13.0
>Reporter: Donald Szeto
>Priority: Minor
>
> There was a hack in {{build.sbt}} for switching between Spark 1.x and 2.x 
> specific code. With PIO-171 completed, that should be cleaned up.
> Specifically, these 
> [lines|https://github.com/apache/predictionio/blob/718ebe2e8e98c5462d14ad2663c65288f0409972/build.sbt#L140-L141]
>  should be removed. The source that it refers to should be refactored 
> properly in the main source code.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (PIO-176) Clean up unmanaged sources in the data module

2018-10-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/PIO-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16636817#comment-16636817
 ] 

ASF GitHub Bot commented on PIO-176:


Github user saurabh3091 closed the pull request at:

https://github.com/apache/predictionio/pull/476


> Clean up unmanaged sources in the data module
> -
>
> Key: PIO-176
> URL: https://issues.apache.org/jira/browse/PIO-176
> Project: PredictionIO
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.13.0
>Reporter: Donald Szeto
>Priority: Minor
>
> There was a hack in {{build.sbt}} for switching between Spark 1.x and 2.x 
> specific code. With PIO-171 completed, that should be cleaned up.
> Specifically, these 
> [lines|https://github.com/apache/predictionio/blob/718ebe2e8e98c5462d14ad2663c65288f0409972/build.sbt#L140-L141]
>  should be removed. The source that it refers to should be refactored 
> properly in the main source code.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (PIO-176) Clean up unmanaged sources in the data module

2018-10-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/PIO-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16636709#comment-16636709
 ] 

ASF GitHub Bot commented on PIO-176:


Github user saurabh3091 commented on the issue:

https://github.com/apache/predictionio/pull/476
  
IntelliJ was unable to figure out the usage of PPythonEventOperator in 
python module.
How do you guys check this? (or do i need to find the word usage through 
whole project)


> Clean up unmanaged sources in the data module
> -
>
> Key: PIO-176
> URL: https://issues.apache.org/jira/browse/PIO-176
> Project: PredictionIO
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.13.0
>Reporter: Donald Szeto
>Priority: Minor
>
> There was a hack in {{build.sbt}} for switching between Spark 1.x and 2.x 
> specific code. With PIO-171 completed, that should be cleaned up.
> Specifically, these 
> [lines|https://github.com/apache/predictionio/blob/718ebe2e8e98c5462d14ad2663c65288f0409972/build.sbt#L140-L141]
>  should be removed. The source that it refers to should be refactored 
> properly in the main source code.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (PIO-176) Clean up unmanaged sources in the data module

2018-10-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/PIO-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16636701#comment-16636701
 ] 

ASF GitHub Bot commented on PIO-176:


GitHub user saurabh3091 opened a pull request:

https://github.com/apache/predictionio/pull/476

[PIO-176] Revert PPythonEventStore and add it to 'data' module



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/saurabh3091/predictionio develop

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/predictionio/pull/476.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #476


commit 093a4d0ab778064f1349c21be7ff4d606d4ebbf4
Author: saurabh gulati 
Date:   2018-10-02T14:22:23Z

[PIO-171] Hack in build.sbt for switching between Spark 1.x and 2.x should 
be cleaned up.

commit 977186ad43794885ca6d46606395eaccec0f292c
Author: saurabh gulati 
Date:   2018-10-03T09:42:56Z

[PIO-176] reverted PPythonEventStore and added it to 'data' module




> Clean up unmanaged sources in the data module
> -
>
> Key: PIO-176
> URL: https://issues.apache.org/jira/browse/PIO-176
> Project: PredictionIO
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.13.0
>Reporter: Donald Szeto
>Priority: Minor
>
> There was a hack in {{build.sbt}} for switching between Spark 1.x and 2.x 
> specific code. With PIO-171 completed, that should be cleaned up.
> Specifically, these 
> [lines|https://github.com/apache/predictionio/blob/718ebe2e8e98c5462d14ad2663c65288f0409972/build.sbt#L140-L141]
>  should be removed. The source that it refers to should be refactored 
> properly in the main source code.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (PIO-176) Clean up unmanaged sources in the data module

2018-10-03 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/PIO-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16636699#comment-16636699
 ] 

ASF GitHub Bot commented on PIO-176:


Github user saurabh3091 closed the pull request at:

https://github.com/apache/predictionio/pull/475


> Clean up unmanaged sources in the data module
> -
>
> Key: PIO-176
> URL: https://issues.apache.org/jira/browse/PIO-176
> Project: PredictionIO
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.13.0
>Reporter: Donald Szeto
>Priority: Minor
>
> There was a hack in {{build.sbt}} for switching between Spark 1.x and 2.x 
> specific code. With PIO-171 completed, that should be cleaned up.
> Specifically, these 
> [lines|https://github.com/apache/predictionio/blob/718ebe2e8e98c5462d14ad2663c65288f0409972/build.sbt#L140-L141]
>  should be removed. The source that it refers to should be refactored 
> properly in the main source code.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (PIO-176) Clean up unmanaged sources in the data module

2018-10-02 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/PIO-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16636372#comment-16636372
 ] 

ASF GitHub Bot commented on PIO-176:


Github user shimamoto commented on the issue:

https://github.com/apache/predictionio/pull/475
  
Yeah, it's necessary for python/pypio for now. We can probably remove it 
after supporting Spark ML natively.


> Clean up unmanaged sources in the data module
> -
>
> Key: PIO-176
> URL: https://issues.apache.org/jira/browse/PIO-176
> Project: PredictionIO
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.13.0
>Reporter: Donald Szeto
>Priority: Minor
>
> There was a hack in {{build.sbt}} for switching between Spark 1.x and 2.x 
> specific code. With PIO-171 completed, that should be cleaned up.
> Specifically, these 
> [lines|https://github.com/apache/predictionio/blob/718ebe2e8e98c5462d14ad2663c65288f0409972/build.sbt#L140-L141]
>  should be removed. The source that it refers to should be refactored 
> properly in the main source code.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (PIO-176) Clean up unmanaged sources in the data module

2018-10-02 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/PIO-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16636216#comment-16636216
 ] 

ASF GitHub Bot commented on PIO-176:


Github user marevol commented on the issue:

https://github.com/apache/predictionio/pull/475
  
PPythonEventStore is used in python/pypio.


> Clean up unmanaged sources in the data module
> -
>
> Key: PIO-176
> URL: https://issues.apache.org/jira/browse/PIO-176
> Project: PredictionIO
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.13.0
>Reporter: Donald Szeto
>Priority: Minor
>
> There was a hack in {{build.sbt}} for switching between Spark 1.x and 2.x 
> specific code. With PIO-171 completed, that should be cleaned up.
> Specifically, these 
> [lines|https://github.com/apache/predictionio/blob/718ebe2e8e98c5462d14ad2663c65288f0409972/build.sbt#L140-L141]
>  should be removed. The source that it refers to should be refactored 
> properly in the main source code.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (PIO-176) Clean up unmanaged sources in the data module

2018-10-02 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/PIO-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16635588#comment-16635588
 ] 

ASF GitHub Bot commented on PIO-176:


Github user saurabh3091 commented on the issue:

https://github.com/apache/predictionio/pull/475
  
Please review and let me know if I missed anything.
Thanks a lot for your support guys.


> Clean up unmanaged sources in the data module
> -
>
> Key: PIO-176
> URL: https://issues.apache.org/jira/browse/PIO-176
> Project: PredictionIO
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.13.0
>Reporter: Donald Szeto
>Priority: Minor
>
> There was a hack in {{build.sbt}} for switching between Spark 1.x and 2.x 
> specific code. With PIO-171 completed, that should be cleaned up.
> Specifically, these 
> [lines|https://github.com/apache/predictionio/blob/718ebe2e8e98c5462d14ad2663c65288f0409972/build.sbt#L140-L141]
>  should be removed. The source that it refers to should be refactored 
> properly in the main source code.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (PIO-176) Clean up unmanaged sources in the data module

2018-10-02 Thread ASF GitHub Bot (JIRA)


[ 
https://issues.apache.org/jira/browse/PIO-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16635580#comment-16635580
 ] 

ASF GitHub Bot commented on PIO-176:


GitHub user saurabh3091 opened a pull request:

https://github.com/apache/predictionio/pull/475

[PIO-176] Hack in build.sbt for switching between Spark 1.x and 2.x s…

- Removed unmanagedSourceDirectories in data module
- refactored sqlSession code blocks to use SparkSession instead of 
SqlContext
- removed PPythonEventStore.scala as it was not being used anywhere.



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/saurabh3091/predictionio develop

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/predictionio/pull/475.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #475


commit 093a4d0ab778064f1349c21be7ff4d606d4ebbf4
Author: saurabh gulati 
Date:   2018-10-02T14:22:23Z

[PIO-171] Hack in build.sbt for switching between Spark 1.x and 2.x should 
be cleaned up.




> Clean up unmanaged sources in the data module
> -
>
> Key: PIO-176
> URL: https://issues.apache.org/jira/browse/PIO-176
> Project: PredictionIO
>  Issue Type: Improvement
>  Components: Core
>Affects Versions: 0.13.0
>Reporter: Donald Szeto
>Priority: Minor
>
> There was a hack in {{build.sbt}} for switching between Spark 1.x and 2.x 
> specific code. With PIO-171 completed, that should be cleaned up.
> Specifically, these 
> [lines|https://github.com/apache/predictionio/blob/718ebe2e8e98c5462d14ad2663c65288f0409972/build.sbt#L140-L141]
>  should be removed. The source that it refers to should be refactored 
> properly in the main source code.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)