[
https://issues.apache.org/jira/browse/CASSANDRA-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Henning Kropp updated CASSANDRA-7083:
-------------------------------------
Description:
The {{CqlRecordWriter}} seems not to support authentication. When the keyspace
in Cassandra is to set to use authentication our Pig job fails with, when
credentials are provided using the URI ('cql://username:password...):
{code}
java.lang.RuntimeException: InvalidRequestException(why:You have not logged in)
at
org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:123)
at
org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:90)
at
org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:76)
at
org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:57)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84)
at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: InvalidRequestException(why:You have not logged in)
at
org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result.read(Cassandra.java:38677)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
at
org.apache.cassandra.thrift.Cassandra$Client.recv_execute_cql3_query(Cassandra.java:1597)
at
org.apache.cassandra.thrift.Cassandra$Client.execute_cql3_query(Cassandra.java:1582)
at
org.apache.cassandra.hadoop.cql3.CqlRecordWriter.retrievePartitionKeyValidator(CqlRecordWriter.java:332)
at
org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:108)
... 7 more
{code}
If not supplied in the URI but as only in the {{JobConf}} the exception is:
{code}
Output Location Validation Failed for: 'cql://...' More info to follow:
InvalidRequestException(why:You have not logged in)
at org.apache.pig.newplan.logical.rules.InputOutputFileValidator$
{code}
Which let to the finding, that authentication is correctly supplied for
{{CqlStorage}} but not for the {{CqlRecordWriter}}.
May be it would make sense to put the authentication part into
{{ConfigHelper.getClientFromAddressList()}}? Then in {{CqlStorage} the username
and password in the conf would need to be set from the URI. If so the
{{ConfigHelper}} has all the information to authenticate and already returns
the client.
was:
The {{CqlRecordWriter}} seems not to support authentication. When the keyspace
in Cassandra is to set to use authentication our Pig job fails with, when
credentials are provided using the URI ('cql://username:password...):
{code}
java.lang.RuntimeException: InvalidRequestException(why:You have not logged in)
at
org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:123)
at
org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:90)
at
org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:76)
at
org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:57)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84)
at
org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
Caused by: InvalidRequestException(why:You have not logged in)
at
org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result.read(Cassandra.java:38677)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
at
org.apache.cassandra.thrift.Cassandra$Client.recv_execute_cql3_query(Cassandra.java:1597)
at
org.apache.cassandra.thrift.Cassandra$Client.execute_cql3_query(Cassandra.java:1582)
at
org.apache.cassandra.hadoop.cql3.CqlRecordWriter.retrievePartitionKeyValidator(CqlRecordWriter.java:332)
at
org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:108)
... 7 more
{code}
If not supplied in the URI but as a {{JobConf}} the exception:
{code}
Output Location Validation Failed for: 'cql://...' More info to follow:
InvalidRequestException(why:You have not logged in)
at org.apache.pig.newplan.logical.rules.InputOutputFileValidator$
{code}
Which let to the finding, that authentication is correctly supplied for
{{CqlStorage}} but not for the {{CqlRecordWriter}}.
May be it would make sense to put the authentication part into
{{ConfigHelper.getClientFromAddressList()}}? Then in {{CqlStorage} the username
and password in the conf would need to be set from the URI. If so the
{{ConfigHelper}} has all the information to authenticate and already returns
the client.
> Authentication Support for CqlRecordWriter
> ------------------------------------------
>
> Key: CASSANDRA-7083
> URL: https://issues.apache.org/jira/browse/CASSANDRA-7083
> Project: Cassandra
> Issue Type: Bug
> Components: Hadoop
> Reporter: Henning Kropp
> Labels: authentication, pig
> Attachments: auth_cql.patch
>
>
> The {{CqlRecordWriter}} seems not to support authentication. When the
> keyspace in Cassandra is to set to use authentication our Pig job fails with,
> when credentials are provided using the URI ('cql://username:password...):
> {code}
> java.lang.RuntimeException: InvalidRequestException(why:You have not logged
> in)
> at
> org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:123)
> at
> org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:90)
> at
> org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:76)
> at
> org.apache.cassandra.hadoop.cql3.CqlOutputFormat.getRecordWriter(CqlOutputFormat.java:57)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.getRecordWriter(PigOutputFormat.java:84)
> at
> org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:553)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> Caused by: InvalidRequestException(why:You have not logged in)
> at
> org.apache.cassandra.thrift.Cassandra$execute_cql3_query_result.read(Cassandra.java:38677)
> at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:78)
> at
> org.apache.cassandra.thrift.Cassandra$Client.recv_execute_cql3_query(Cassandra.java:1597)
> at
> org.apache.cassandra.thrift.Cassandra$Client.execute_cql3_query(Cassandra.java:1582)
> at
> org.apache.cassandra.hadoop.cql3.CqlRecordWriter.retrievePartitionKeyValidator(CqlRecordWriter.java:332)
> at
> org.apache.cassandra.hadoop.cql3.CqlRecordWriter.(CqlRecordWriter.java:108)
> ... 7 more
> {code}
> If not supplied in the URI but as only in the {{JobConf}} the exception is:
> {code}
> Output Location Validation Failed for: 'cql://...' More info to follow:
> InvalidRequestException(why:You have not logged in)
> at org.apache.pig.newplan.logical.rules.InputOutputFileValidator$
> {code}
> Which let to the finding, that authentication is correctly supplied for
> {{CqlStorage}} but not for the {{CqlRecordWriter}}.
> May be it would make sense to put the authentication part into
> {{ConfigHelper.getClientFromAddressList()}}? Then in {{CqlStorage} the
> username and password in the conf would need to be set from the URI. If so
> the {{ConfigHelper}} has all the information to authenticate and already
> returns the client.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
