Hi Banmeet – I'm also seeing this issue, so I opened SQOOP-2681. This
appears to be caused by the connector jars (except for the Kafka connector)
getting created with identical file names (sqoop.jar), which then get
copied to the server/lib directory. I'm assuming the last file copied to
the server/lib directory is the one that gets picked up. Pending a more
authoritative answer, I think a workaround that will allow continued
test/dev is to update the connector poms to ensure unique names, for
example in the pom for each connector change:
<build>
<finalName>sqoop</finalName>
to:
<build>
<finalName>${artifactId}-${version}</finalName>
The exception to this is the Kafka connector pom, which is missing the
build element, which also accounts for the unique name for the jar.
On Tue, Nov 10, 2015 at 9:58 PM, Banmeet Singh <[email protected]>
wrote:
> Just clarifying in case I was unclear in my last post :). I had tried mvn
> clean package -Pbinary -DskipTests as well and still had the same problem.
>
> Thanks and regards
> Banmeet Singh
> Graduate Student
> Department of Computer Science
> Rutgers, The State University of New Jersey
> Mob.: (732)-779-9741
>
> On Tue, Nov 10, 2015 at 12:22 PM, Banmeet Singh <
> [email protected]>
> wrote:
>
> > Yes, sorry for missing this out. I've tried that as well.
> > On Nov 10, 2015 10:37 AM, "Jarek Jarcec Cecho" <[email protected]>
> wrote:
> >
> >> Can you try running:
> >>
> >> mvn *clean* package -Pbinary -DskipTests
> >>
> >> To force maven rebuild all files from scratch.
> >>
> >> Jarcec
> >>
> >> > On Nov 10, 2015, at 2:59 AM, Banmeet Singh <
> [email protected]>
> >> wrote:
> >> >
> >> > Hi
> >> >
> >> > I recently pulled upstream code into my local sqoop repo and checked
> >> out the sqoop2 branch. I can see only two connectors (Kafka and SFTP) on
> >> doing 'show connector' from the sqoop2-shell (screenshot attached). I
> did
> >> 'mvn package -Pbinary -DskipTests' for building the project and used
> >> '.../sqoop2-server start' to start the sqoop2 server. I am currently
> >> running the sqoop2 server and client on a single node (Ubuntu in a
> >> VirtualBox VM/Ubuntu on an Amazon EC2 instance) with Hadoop (on YARN) in
> >> pseudo distributed mode. The HEAD of my repo is currently at commit id
> >> 82d9f02; SQOOP-2654 (screenshot attached). On debugging the code, I
> found
> >> that the following line of code in
> >> ConnectorManagerUtils::getConnectorConfigs() returns an Enumeration
> >> containing only two URLs:
> >> >
> >> > Enumeration<URL> appPathConfigs =
> >> ConnectorManager.class.getClassLoader().getResources(
> >> > ConfigurationConstants.FILENAME_CONNECTOR_PROPERTIES);
> >> >
> >> > Any pointers as to what might be wrong would be helpful.
> >> >
> >> > Thanks and regards
> >> > Banmeet Singh
> >> > Graduate Student
> >> > Department of Computer Science
> >> > Rutgers, The State University of New Jersey
> >> > Mob.: (732)-779-9741
> >>
> >>
>
