[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15883097#comment-15883097
]
Pierre Regazzoni commented on KNOX-743:
---
Thanks Kevin.
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, KNOX-743.patch.02, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15882917#comment-15882917
]
Kevin Risden commented on KNOX-743:
---
[~lmccay] - Created KNOX-891
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, KNOX-743.patch.02, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15882914#comment-15882914
]
Kevin Risden commented on KNOX-743:
---
Absolutely I'll open a new JIRA in a minute.
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, KNOX-743.patch.02, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15882905#comment-15882905
]
Larry McCay commented on KNOX-743:
--
[~risdenk] - that's a good find. Could you file a separate JIRA for it and a
fix version of 0.12.0?
Also indicate whether you plan to provide a patch.
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, KNOX-743.patch.02, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15882877#comment-15882877
]
Kevin Risden commented on KNOX-743:
---
It would be great to get this documented in the user guide.
https://knox.apache.org/books/knox-0-11-0/user-guide.html has no mention of
Sqoop. The only reference I've found is the Knox blog here:
https://cwiki.apache.org/confluence/display/KNOX/2016/11/08/Running+SQOOP+job+via+KNOX+Shell+DSL
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, KNOX-743.patch.02, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624067#comment-15624067
]
ASF subversion and git services commented on KNOX-743:
--
Commit e5897775f84dcc810401ccb2a1a5ede45a628b14 in knox's branch
refs/heads/v0.10.0 from [~lmccay]
[ https://git-wip-us.apache.org/repos/asf?p=knox.git;h=e589777 ]
KNOX-743 - Add submitSqoop via knox shell api
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, KNOX-743.patch.02, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623183#comment-15623183
]
Larry McCay commented on KNOX-743:
--
[~pregazzoni] - I have just committed this to master and it will be available
for the 0.10.0 release.
Thank you for your contribution!
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, KNOX-743.patch.02, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623176#comment-15623176
]
ASF subversion and git services commented on KNOX-743:
--
Commit 43d07683b687e9302e390669bfeccdcf98fc in knox's branch
refs/heads/master from [~lmccay]
[ https://git-wip-us.apache.org/repos/asf?p=knox.git;h=43d0768 ]
KNOX-743 - Add submitSqoop via knox shell api
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, KNOX-743.patch.02, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15513776#comment-15513776
]
Pierre Regazzoni commented on KNOX-743:
---
[~lmccay] The driver should be in $SQOOP_HOME/lib. We can add following to the
information: Download the appropriate JDBC driver for the database you want to
import, and install the .jar file in the $SQOOP_HOME/lib directory on your
client machine e.g. /usr/lib/sqoop/lib. You can get mysql connector as follow:
{noformat}
yum install mysql-connector-java
ln -s /usr/share/java/mysql-connector-java.jar $SQOOP_HOME/lib/.
{noformat}
Agree wrt password it can be prompted (the one I included is basically
password-less) to be cleaner and added to the instruction.
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, KNOX-743.patch.02, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512968#comment-15512968
]
Larry McCay commented on KNOX-743:
--
I will also change the sample to prompt for the database username/password
rather than have them hardcoded in the script. It is poor practice to hardcode
passwords and static code analysis will bark if it is in there. We can put some
comments in place in the sample for documenting it. We might also consider just
using -P to read the password from the console.
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, KNOX-743.patch.02, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15512948#comment-15512948
]
Larry McCay commented on KNOX-743:
--
[~pregazzoni] - I've tried to test this but am having trouble getting sqoop to
find the mysql driver.
I've copied it to /usr/lib/sqoop/lib and also tried setting it explicitly in
the sqoop classpath through Ambari.
Can you tell me what you do to get it to find the driver?
We will also need to roll those instructions into the sample so that testing
during release is easier to do for everyone. I can do that once I get it
working.
Thanks!
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, KNOX-743.patch.02, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15442154#comment-15442154
]
Hadoop QA commented on KNOX-743:
Testing JIRA KNOX-743
Patch
[submitSqoop.md|https://issues.apache.org/jira/secure/attachment/12825883/submitSqoop.md]
downloaded at Sat Aug 27 19:56:19 UTC 2016
{color:red}-1{color} Patch failed to apply to head of branch
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15442140#comment-15442140
]
Pierre Regazzoni commented on KNOX-743:
---
Attached simple section similar to other webhcat section that can be used in
documentation.
Will look into making database source for the test instruction.
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch, submitSqoop.md
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15441849#comment-15441849
]
Larry McCay commented on KNOX-743:
--
Findbugs seem to be resolved - thanks [~pregazzoni]!
I think we are going to need docs for this and instructions for testing it for
release time.
Take a look at the docs for the other webhcat docs like
http://knox.apache.org/books/knox-0-9-1/user-guide.html#submitJava()+-+Submit+a+Java+MapReduce+job
as an example.
The testing instructions will need to include a details for a db to download or
already available and schema import.
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Fix For: 0.10.0
>
> Attachments: KNOX-743.patch
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438630#comment-15438630
]
Hadoop QA commented on KNOX-743:
Testing JIRA KNOX-743
Patch
[KNOX-743.patch|https://issues.apache.org/jira/secure/attachment/12825601/KNOX-743.patch]
downloaded at Fri Aug 26 07:31:00 UTC 2016
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
120
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac
warnings
.{color:red}WARNING{color}: the current HEAD has 76 javac warning(s)
{color:green}+1 FINDBUGS{color}
.{color:green}+1{color} the patch does not seem to introduce new Findbugs
warnings
.{color:red}WARNING: the current HEAD has Findbugs warning(s), they should
be addressed ASAP{color}
{color:green}+1 TESTS{color}
.Tests run: 664
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
{color:red}. There is at least one warning, please check{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/Knox-master-patch-verify/68/
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Attachments: KNOX-743.patch
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437656#comment-15437656
]
Pierre Regazzoni commented on KNOX-743:
---
Thanks [~lmccay], I guess not sure why 177 findbugs. Did not see that # from
the jenkins job. Will see what i can find.
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Attachments: KNOX-743.patch
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15436074#comment-15436074
]
Larry McCay commented on KNOX-743:
--
Hi [~pregazzoni] - I will review this in the next day or two.
Can you look into the 177 new Findbugs warnings that were supposedly introduced
by this?
Sounds a little outrageous. :)
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Attachments: KNOX-743.patch
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435969#comment-15435969
]
Hadoop QA commented on KNOX-743:
Testing JIRA KNOX-743
Patch
[KNOX-743.patch|https://issues.apache.org/jira/secure/attachment/12825368/KNOX-743.patch]
downloaded at Wed Aug 24 23:36:15 UTC 2016
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any line longer than
120
.{color:red}-1{color} the patch does not add/modify any testcase
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warnings
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac
warnings
.{color:red}WARNING{color}: the current HEAD has 76 javac warning(s)
{color:red}-1 FINDBUGS{color}
.{color:red}-1{color} the patch seems to introduce 177 new Findbugs
warning(s) in module(s) [gateway-shell]
.{color:red}WARNING: the current HEAD has Findbugs warning(s), they should
be addressed ASAP{color}
{color:green}+1 TESTS{color}
.Tests run: 664
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
{color:red}. There is at least one warning, please check{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/Knox-master-patch-verify/67/
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Attachments: KNOX-743.patch
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KNOX-743) Add submitSqoop via knox shell api
[
https://issues.apache.org/jira/browse/KNOX-743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435952#comment-15435952
]
Pierre Regazzoni commented on KNOX-743:
---
Added sample example as well as part of patch. It will require an RDBMS and
data to test with.
> Add submitSqoop via knox shell api
> --
>
> Key: KNOX-743
> URL: https://issues.apache.org/jira/browse/KNOX-743
> Project: Apache Knox
> Issue Type: Improvement
> Components: ClientDSL
>Affects Versions: 0.9.0
>Reporter: Pierre Regazzoni
>Assignee: Pierre Regazzoni
> Attachments: KNOX-743.patch
>
>
> Add ability to submitSqoop job via knox since templeton also support this
> functionality. I have a basic patch that I am trying and will submit it.
> Would be something like this:
> {code:java}
> sqoop_command = "import --connect ..."
> jobId = Job.submitSqoop(session) \
> .command(sqoop_command) \
> .statusDir("${jobDir}/output") \
> .now().jobId
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
