[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread myui
Github user myui commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126868602 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -170,6 +192,100 @@ private static CharArraySet stopWords(@Nonnull final

[GitHub] incubator-hivemall issue #100: [HOTFIX] Update documents for DataFrame in Sp...

2017-07-11 Thread coveralls
Github user coveralls commented on the issue: https://github.com/apache/incubator-hivemall/pull/100 [![Coverage Status](https://coveralls.io/builds/12354068/badge)](https://coveralls.io/builds/12354068) Coverage remained the same at 40.267% when pulling

[GitHub] incubator-hivemall pull request #100: [HOTFIX] Update documents for DataFram...

2017-07-11 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/incubator-hivemall/pull/100 [HOTFIX] Update documents for DataFrame in Spark ## What changes were proposed in this pull request? This pr updated documents for `DataFrame` in Spark. ## What type of PR is

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread takuti
Github user takuti commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126860711 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -170,6 +192,100 @@ private static CharArraySet stopWords(@Nonnull final

[GitHub] incubator-hivemall issue #97: [HIVEMALL-130] Support user-defined dictionary...

2017-07-11 Thread coveralls
Github user coveralls commented on the issue: https://github.com/apache/incubator-hivemall/pull/97 [![Coverage Status](https://coveralls.io/builds/12353348/badge)](https://coveralls.io/builds/12353348) Coverage decreased (-0.02%) to 40.249% when pulling

[GitHub] incubator-hivemall issue #97: [HIVEMALL-130] Support user-defined dictionary...

2017-07-11 Thread coveralls
Github user coveralls commented on the issue: https://github.com/apache/incubator-hivemall/pull/97 [![Coverage Status](https://coveralls.io/builds/12353348/badge)](https://coveralls.io/builds/12353348) Coverage decreased (-0.02%) to 40.249% when pulling

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread myui
Github user myui commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126858366 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -170,6 +192,100 @@ private static CharArraySet stopWords(@Nonnull final

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread myui
Github user myui commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126858262 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -170,6 +192,100 @@ private static CharArraySet stopWords(@Nonnull final

[GitHub] incubator-hivemall issue #99: [HIVEMALL-116][SPARK][DOC] Add docs for SQL ca...

2017-07-11 Thread myui
Github user myui commented on the issue: https://github.com/apache/incubator-hivemall/pull/99 Thanks!! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread takuti
Github user takuti commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126852235 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -170,6 +192,100 @@ private static CharArraySet stopWords(@Nonnull final

[GitHub] incubator-hivemall issue #99: [HIVEMALL-116][SPARK][DOC] Add docs for SQL ca...

2017-07-11 Thread coveralls
Github user coveralls commented on the issue: https://github.com/apache/incubator-hivemall/pull/99 [![Coverage Status](https://coveralls.io/builds/12351600/badge)](https://coveralls.io/builds/12351600) Coverage remained the same at 40.267% when pulling

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread takuti
Github user takuti commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126846757 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -170,6 +192,100 @@ private static CharArraySet stopWords(@Nonnull final

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread takuti
Github user takuti commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126846871 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -170,6 +192,100 @@ private static CharArraySet stopWords(@Nonnull final

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread takuti
Github user takuti commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126846200 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -170,6 +192,100 @@ private static CharArraySet stopWords(@Nonnull final

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread myui
Github user myui commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126839049 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -44,47 +53,52 @@ import

[jira] [Closed] (HIVEMALL-116) Add documentation about SQL in Spark

2017-07-11 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/HIVEMALL-116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro closed HIVEMALL-116. - Resolution: Fixed > Add documentation about SQL in Spark >

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread myui
Github user myui commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126839586 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -170,6 +192,100 @@ private static CharArraySet stopWords(@Nonnull final

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread myui
Github user myui commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126841323 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -170,6 +192,100 @@ private static CharArraySet stopWords(@Nonnull final

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread myui
Github user myui commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126841692 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -170,6 +192,100 @@ private static CharArraySet stopWords(@Nonnull final

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread myui
Github user myui commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126839282 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -170,6 +192,100 @@ private static CharArraySet stopWords(@Nonnull final

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread myui
Github user myui commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126841175 --- Diff: core/src/main/java/hivemall/utils/io/HttpUtils.java --- @@ -0,0 +1,50 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] incubator-hivemall issue #99: [HIVEMALL-116][SPARK][DOC] Add docs for SQL ca...

2017-07-11 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/incubator-hivemall/pull/99 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] incubator-hivemall issue #99: [HIVEMALL-116][SPARK][DOC] Add docs for SQL ca...

2017-07-11 Thread myui
Github user myui commented on the issue: https://github.com/apache/incubator-hivemall/pull/99 LGTM. @maropu Could you merge this pr to master? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] incubator-hivemall pull request #99: [HIVEMALL-116][SPARK][DOC] Add docs for...

2017-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-hivemall/pull/99 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Created] (HIVEMALL-133) Support spark-v2.2 in the hivemalls-spark module

2017-07-11 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created HIVEMALL-133: - Summary: Support spark-v2.2 in the hivemalls-spark module Key: HIVEMALL-133 URL: https://issues.apache.org/jira/browse/HIVEMALL-133 Project: Hivemall

[jira] [Updated] (HIVEMALL-133) Support spark-v2.2 in the hivemalls-spark module

2017-07-11 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/HIVEMALL-133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated HIVEMALL-133: -- Labels: spark (was: ) > Support spark-v2.2 in the hivemalls-spark module >

[GitHub] incubator-hivemall pull request #99: [HIVEMALL-116][SPARK][DOC] Add docs for...

2017-07-11 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/99#discussion_r126836953 --- Diff: docs/gitbook/spark/regression/e2006_sql.md --- @@ -0,0 +1,151 @@ + + +E2006 +===

[GitHub] incubator-hivemall pull request #99: [HIVEMALL-116][SPARK][DOC] Add docs for...

2017-07-11 Thread myui
Github user myui commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/99#discussion_r126714625 --- Diff: docs/gitbook/spark/regression/e2006_sql.md --- @@ -0,0 +1,151 @@ + + +E2006 +===

[GitHub] incubator-hivemall pull request #99: [HIVEMALL-116][SPARK][DOC] Add docs for...

2017-07-11 Thread myui
Github user myui commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/99#discussion_r126712024 --- Diff: docs/gitbook/spark/regression/e2006_sql.md --- @@ -0,0 +1,151 @@ + + +E2006 +===

[GitHub] incubator-hivemall issue #99: [HIVEMALL-116][SPARK][DOC] Add docs for SQL ca...

2017-07-11 Thread coveralls
Github user coveralls commented on the issue: https://github.com/apache/incubator-hivemall/pull/99 [![Coverage Status](https://coveralls.io/builds/12341761/badge)](https://coveralls.io/builds/12341761) Coverage increased (+0.3%) to 40.564% when pulling

[GitHub] incubator-hivemall issue #99: [HIVEMALL-116][SPARK][DOC] Add docs for SQL ca...

2017-07-11 Thread coveralls
Github user coveralls commented on the issue: https://github.com/apache/incubator-hivemall/pull/99 [![Coverage Status](https://coveralls.io/builds/12341761/badge)](https://coveralls.io/builds/12341761) Coverage increased (+0.3%) to 40.564% when pulling

[GitHub] incubator-hivemall pull request #99: [HIVEMALL-116][SQL][DOC] Add docs for S...

2017-07-11 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/incubator-hivemall/pull/99 [HIVEMALL-116][SQL][DOC] Add docs for SQL cases in hivemall-spark ## What changes were proposed in this pull request? This pr added docs for SQL cases in `hivemall-spark`. ##

[jira] [Created] (HIVEMALL-132) Generalize f1score UDAF to support any Beta value

2017-07-11 Thread Makoto Yui (JIRA)
Makoto Yui created HIVEMALL-132: --- Summary: Generalize f1score UDAF to support any Beta value Key: HIVEMALL-132 URL: https://issues.apache.org/jira/browse/HIVEMALL-132 Project: Hivemall Issue

[jira] [Updated] (HIVEMALL-132) Generalize f1score UDAF to support any Beta value

2017-07-11 Thread Makoto Yui (JIRA)
[ https://issues.apache.org/jira/browse/HIVEMALL-132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Makoto Yui updated HIVEMALL-132: Issue Type: Improvement (was: Bug) > Generalize f1score UDAF to support any Beta value >

[GitHub] incubator-hivemall issue #97: [HIVEMALL-130] Support user-defined dictionary...

2017-07-11 Thread myui
Github user myui commented on the issue: https://github.com/apache/incubator-hivemall/pull/97 @takuti please change PR tile `[WIP]` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread takuti
Github user takuti commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126635120 --- Diff: nlp/src/test/java/hivemall/nlp/tokenizer/KuromojiUDFTest.java --- @@ -192,6 +241,126 @@ public void prepare(int arg) throws HiveException

[GitHub] incubator-hivemall issue #98: [WIP][HIVEMALL-108-2] Support `-iter` option i...

2017-07-11 Thread myui
Github user myui commented on the issue: https://github.com/apache/incubator-hivemall/pull/98 still work in progress. https://github.com/apache/incubator-hivemall/pull/98/commits/5b1af8fea4659ec853b9eceebde90899e734071a is completely based on

[GitHub] incubator-hivemall pull request #97: [HIVEMALL-130] Support user-defined dic...

2017-07-11 Thread takuti
Github user takuti commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/97#discussion_r126622639 --- Diff: nlp/src/main/java/hivemall/nlp/tokenizer/KuromojiUDF.java --- @@ -239,6 +239,16 @@ private static UserDictionary userDictionary(@Nullable

[GitHub] incubator-hivemall issue #97: [HIVEMALL-130] Support user-defined dictionary...

2017-07-11 Thread takuti
Github user takuti commented on the issue: https://github.com/apache/incubator-hivemall/pull/97 Note: I'm planning to make further improvement on the document before merging this PR --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] incubator-hivemall issue #98: [WIP][HIVEMALL-108-2] Support `-iter` option i...

2017-07-11 Thread coveralls
Github user coveralls commented on the issue: https://github.com/apache/incubator-hivemall/pull/98 [![Coverage Status](https://coveralls.io/builds/12336290/badge)](https://coveralls.io/builds/12336290) Coverage increased (+0.3%) to 40.585% when pulling

[GitHub] incubator-hivemall issue #98: [WIP][HIVEMALL-108-2] Support `-iter` option i...

2017-07-11 Thread coveralls
Github user coveralls commented on the issue: https://github.com/apache/incubator-hivemall/pull/98 [![Coverage Status](https://coveralls.io/builds/12336290/badge)](https://coveralls.io/builds/12336290) Coverage increased (+0.3%) to 40.585% when pulling

[GitHub] incubator-hivemall pull request #98: [WIP][HIVEMALL-108-2] Support `-iter` o...

2017-07-11 Thread myui
GitHub user myui opened a pull request: https://github.com/apache/incubator-hivemall/pull/98 [WIP][HIVEMALL-108-2] Support `-iter` option in generic predictors ## What changes were proposed in this pull request? Support -iter option in both generic classifier and regression

[GitHub] incubator-hivemall pull request #87: [HIVEMALL-108] Support `-iter` option i...

2017-07-11 Thread myui
Github user myui commented on a diff in the pull request: https://github.com/apache/incubator-hivemall/pull/87#discussion_r126605795 --- Diff: core/src/main/java/hivemall/GeneralLearnerBaseUDTF.java --- @@ -220,6 +235,23 @@ protected PrimitiveObjectInspector

[GitHub] incubator-hivemall issue #97: [HIVEMALL-130] Support user-defined dictionary...

2017-07-11 Thread coveralls
Github user coveralls commented on the issue: https://github.com/apache/incubator-hivemall/pull/97 [![Coverage Status](https://coveralls.io/builds/12335614/badge)](https://coveralls.io/builds/12335614) Coverage increased (+0.3%) to 40.614% when pulling

[GitHub] incubator-hivemall issue #97: [HIVEMALL-130] Support user-defined dictionary...

2017-07-11 Thread coveralls
Github user coveralls commented on the issue: https://github.com/apache/incubator-hivemall/pull/97 [![Coverage Status](https://coveralls.io/builds/12335614/badge)](https://coveralls.io/builds/12335614) Coverage increased (+0.3%) to 40.614% when pulling

[jira] [Created] (HIVEMALL-131) Add documentation about Stratified Sampling in general tips

2017-07-11 Thread Makoto Yui (JIRA)
Makoto Yui created HIVEMALL-131: --- Summary: Add documentation about Stratified Sampling in general tips Key: HIVEMALL-131 URL: https://issues.apache.org/jira/browse/HIVEMALL-131 Project: Hivemall