[
https://issues.apache.org/jira/browse/SQOOP-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pratik Khadloya updated SQOOP-1470:
-----------------------------------
Description:
The schema query with the where clause (1 = 0) is printed 5 times in the logs.
I suspect it may be querying for schema 5 times as well.
{quote}
14/08/25 17:52:11 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-SNAPSHOT
14/08/25 17:52:11 WARN tool.BaseSqoopTool: Setting your password on the
command-line is insecure. Consider using -P instead.
14/08/25 17:52:11 INFO manager.SqlManager: Using default fetchSize of 1000
14/08/25 17:52:11 INFO tool.CodeGenTool: Beginning code generation
14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
mytable_id,
NAME,
type,
value
FROM mytable
WHERE (1 = 0) ;
14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
mytable_id,
NAME,
type,
value
FROM mytable
WHERE (1 = 0) ;
14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
mytable_id,
NAME,
type,
value
FROM mytable
WHERE (1 = 0) ;
14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
mytable_id,
NAME,
type,
value
FROM mytable
WHERE (1 = 0) ;
14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
mytable_id,
NAME,
type,
value
FROM mytable
WHERE (1 = 0) ;
{quote}
Command line:
{code}
bin/sqoop import -jt myjobtracker.com --connect jdbc:mysql://mydb.com/mydb
--username user --password ... --as-parquetfile --target-dir
/user/pkhadloya/sqoop/ --query "<my query>" -m 1
{code}
was:
The schema query with the where clause (1 = 0) is printed 5 times in the logs.
I suspect it may be querying for schema 5 times as well.
{quote}
14/08/25 17:52:11 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-SNAPSHOT
14/08/25 17:52:11 WARN tool.BaseSqoopTool: Setting your password on the
command-line is insecure. Consider using -P instead.
14/08/25 17:52:11 INFO manager.SqlManager: Using default fetchSize of 1000
14/08/25 17:52:11 INFO tool.CodeGenTool: Beginning code generation
14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
mytable_id,
NAME,
type,
value
FROM mytable
WHERE (1 = 0) ;
14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
mytable_id,
NAME,
type,
value
FROM mytable
WHERE (1 = 0) ;
14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
mytable_id,
NAME,
type,
value
FROM mytable
WHERE (1 = 0) ;
14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
mytable_id,
NAME,
type,
value
FROM mytable
WHERE (1 = 0) ;
14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
mytable_id,
NAME,
type,
value
FROM mytable
WHERE (1 = 0) ;
{quote}
Command line:
{quote}
bin/sqoop import -jt myjobtracker.com --connect jdbc:mysql://mydb.com/mydb
--username user --password ... --as-parquetfile --target-dir
/user/pkhadloya/sqoop/ --query "<my query>" -m 1
{quote}
> Sqoop1.4.5 prints the schema query 5 times even if executing with a single
> mapper
> ---------------------------------------------------------------------------------
>
> Key: SQOOP-1470
> URL: https://issues.apache.org/jira/browse/SQOOP-1470
> Project: Sqoop
> Issue Type: Bug
> Reporter: Pratik Khadloya
>
> The schema query with the where clause (1 = 0) is printed 5 times in the
> logs. I suspect it may be querying for schema 5 times as well.
> {quote}
> 14/08/25 17:52:11 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6-SNAPSHOT
> 14/08/25 17:52:11 WARN tool.BaseSqoopTool: Setting your password on the
> command-line is insecure. Consider using -P instead.
> 14/08/25 17:52:11 INFO manager.SqlManager: Using default fetchSize of 1000
> 14/08/25 17:52:11 INFO tool.CodeGenTool: Beginning code generation
> 14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
> mytable_id,
> NAME,
> type,
> value
> FROM mytable
> WHERE (1 = 0) ;
> 14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
> mytable_id,
> NAME,
> type,
> value
> FROM mytable
> WHERE (1 = 0) ;
> 14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
> mytable_id,
> NAME,
> type,
> value
> FROM mytable
> WHERE (1 = 0) ;
> 14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
> mytable_id,
> NAME,
> type,
> value
> FROM mytable
> WHERE (1 = 0) ;
> 14/08/25 17:52:12 INFO manager.SqlManager: Executing SQL statement: SELECT
> mytable_id,
> NAME,
> type,
> value
> FROM mytable
> WHERE (1 = 0) ;
> {quote}
> Command line:
> {code}
> bin/sqoop import -jt myjobtracker.com --connect jdbc:mysql://mydb.com/mydb
> --username user --password ... --as-parquetfile --target-dir
> /user/pkhadloya/sqoop/ --query "<my query>" -m 1
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
