[jira] [Updated] (CASSANDRA-15028) Autogenerate api docs in sidecar

2019-02-19 Thread Vinay Chella (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Vinay Chella updated CASSANDRA-15028:
-
Component/s: Sidecar

> Autogenerate api docs in sidecar
> 
>
> Key: CASSANDRA-15028
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15028
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Sidecar
>Reporter: Chris Lohfink
>Assignee: Chris Lohfink
>Priority: Minor
>  Labels: pull-request-available
> Attachments: screenshot-1.png, screenshot-2.png
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Swagger can provide us a way to define the api and autogenerate nice looking 
> docs and have interactive UI for trying the APIs. This can also be used to 
> autogenerate client libraries in many different libraries.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-14848) When upgrading 3.11.3->4.0 using SSL 4.0 nodes does not connect to old non seed nodes

2019-02-19 Thread Anonymous (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-14848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Anonymous updated CASSANDRA-14848:
--
Status: Ready to Commit  (was: Patch Available)

> When upgrading 3.11.3->4.0 using SSL 4.0 nodes does not connect to old non 
> seed nodes
> -
>
> Key: CASSANDRA-14848
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14848
> Project: Cassandra
>  Issue Type: Bug
>  Components: Messaging/Internode
>Reporter: Tommy Stendahl
>Assignee: Tommy Stendahl
>Priority: Blocker
>  Labels: security
> Fix For: 4.0
>
>
> When upgrading from 3.11.3 to 4.0 with server encryption enabled the new 4.0 
> node only connects to 3.11.3 seed node, there are no connection established 
> to non-seed nodes on the old version.
> I have four nodes, *.242 is upgraded to 4.0, *.243 and *.244 are 3.11.3 
> non-seed and *.246 are 3.11.3 seed. After starting the 4.0 node I get this 
> nodetool status on the different nodes:
> {noformat}
> *.242
> -- Address Load Tokens Owns (effective) Host ID Rack
> UN 10.216.193.242 1017.77 KiB 256 75,1% 7d278e14-d549-42f3-840d-77cfd852fbf4 
> RAC1
> DN 10.216.193.243 743.32 KiB 256 74,8% 5586243a-ca74-4125-8e7e-09e82e23c4e5 
> RAC1
> DN 10.216.193.244 711.54 KiB 256 75,2% c155e262-b898-4e86-9e1d-d4d0f97e88f6 
> RAC1
> UN 10.216.193.246 659.81 KiB 256 74,9% 502dd00f-fc02-4024-b65f-b98ba3808291 
> RAC1
> *.243 and *.244
> -- Address Load Tokens Owns (effective) Host ID Rack
> DN 10.216.193.242 657.4 KiB 256 75,1% 7d278e14-d549-42f3-840d-77cfd852fbf4 
> RAC1
> UN 10.216.193.243 471 KiB 256 74,8% 5586243a-ca74-4125-8e7e-09e82e23c4e5 RAC1
> UN 10.216.193.244 471.71 KiB 256 75,2% c155e262-b898-4e86-9e1d-d4d0f97e88f6 
> RAC1
> UN 10.216.193.246 388.54 KiB 256 74,9% 502dd00f-fc02-4024-b65f-b98ba3808291 
> RAC1
> *.246
> -- Address Load Tokens Owns (effective) Host ID Rack
> UN 10.216.193.242 657.4 KiB 256 75,1% 7d278e14-d549-42f3-840d-77cfd852fbf4 
> RAC1
> UN 10.216.193.243 471 KiB 256 74,8% 5586243a-ca74-4125-8e7e-09e82e23c4e5 RAC1
> UN 10.216.193.244 471.71 KiB 256 75,2% c155e262-b898-4e86-9e1d-d4d0f97e88f6 
> RAC1
> UN 10.216.193.246 388.54 KiB 256 74,9% 502dd00f-fc02-4024-b65f-b98ba3808291 
> RAC1
> {noformat}
>  
> I have built 4.0 with wire tracing activated and in my config the 
> storage_port=12700 and ssl_storage_port=12701. In the log I can see that the 
> 4.0 node start to connect to the 3.11.3 seed node on the storage_port but 
> quickly switch to the ssl_storage_port, but when connecting to the non-seed 
> nodes it never switch to the ssl_storage_port.
> {noformat}
> >grep 193.246 system.log | grep Outbound
> 2018-10-25T10:57:36.799+0200 [MessagingService-NettyOutbound-Thread-4-1] INFO 
> i.n.u.internal.logging.Slf4JLogger:101 info [id: 0x2f0e5e55] CONNECT: 
> /10.216.193.246:12700
> 2018-10-25T10:57:36.902+0200 [MessagingService-NettyOutbound-Thread-4-2] INFO 
> i.n.u.internal.logging.Slf4JLogger:101 info [id: 0x9e81f62c] CONNECT: 
> /10.216.193.246:12701
> 2018-10-25T10:57:36.905+0200 [MessagingService-NettyOutbound-Thread-4-2] INFO 
> i.n.u.internal.logging.Slf4JLogger:101 info [id: 0x9e81f62c, 
> L:/10.216.193.242:37252 - R:10.216.193.246/10.216.193.246:12701] ACTIVE
> 2018-10-25T10:57:36.906+0200 [MessagingService-NettyOutbound-Thread-4-2] INFO 
> i.n.u.internal.logging.Slf4JLogger:101 info [id: 0x9e81f62c, 
> L:/10.216.193.242:37252 - R:10.216.193.246/10.216.193.246:12701] WRITE: 8B
> >grep 193.243 system.log | grep Outbound
> 2018-10-25T10:57:38.438+0200 [MessagingService-NettyOutbound-Thread-4-3] INFO 
> i.n.u.internal.logging.Slf4JLogger:101 info [id: 0xd8f1d6c4] CONNECT: 
> /10.216.193.243:12700
> 2018-10-25T10:57:38.540+0200 [MessagingService-NettyOutbound-Thread-4-4] INFO 
> i.n.u.internal.logging.Slf4JLogger:101 info [id: 0xfde6cc9f] CONNECT: 
> /10.216.193.243:12700
> 2018-10-25T10:57:38.694+0200 [MessagingService-NettyOutbound-Thread-4-5] INFO 
> i.n.u.internal.logging.Slf4JLogger:101 info [id: 0x7e87fc4e] CONNECT: 
> /10.216.193.243:12700
> 2018-10-25T10:57:38.741+0200 [MessagingService-NettyOutbound-Thread-4-7] INFO 
> i.n.u.internal.logging.Slf4JLogger:101 info [id: 0x39395296] CONNECT: 
> /10.216.193.243:12700{noformat}
>  
> When I had the dbug log activated and started the 4.0 node I can see that it 
> switch port for *.246 but not for *.243 and *.244.
> {noformat}
> >grep DEBUG system.log| grep OutboundMessagingConnection | grep 
> >maybeUpdateConnectionId
> 2018-10-25T13:12:56.095+0200 [ScheduledFastTasks:1] DEBUG 
> o.a.c.n.a.OutboundMessagingConnection:314 maybeUpdateConnectionId changing 
> connectionId to 10.216.193.246:12701 (GOSSIP), with a different port for 
> secure communication, because peer version is 11
> 2018-10-25T13:12:58.100+0200 [ReadStage-1] 

[jira] [Commented] (CASSANDRA-15012) token_generator_test.TestTokenGenerator test fails on 2.2

2019-02-19 Thread Joseph Lynch (JIRA)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772557#comment-16772557
 ] 

Joseph Lynch commented on CASSANDRA-15012:
--

Man it's tricky to write py2/py3 compatible code without {{future}} and {{six}} 
isn't it haha. Ok, maybe third times the charm:
||2.2||
|Cassandra patch: 
[1c28ad23|https://github.com/apache/cassandra/commit/1c28ad235f0ceece4c822283447f2ccf6c73ee8c]|
|Cassandra 
[branch|https://github.com/apache/cassandra/compare/cassandra-2.2...jolynch:CASSANDRA-15012]|
|dtest patch [PR|https://github.com/apache/cassandra-dtest/pull/42]|
|dtest circleci run: 
[!https://circleci.com/gh/jolynch/cassandra/tree/CASSANDRA-15012.png?circle-token=
 
1102a59698d04899ec971dd36e925928f7b521f5!|https://circleci.com/gh/jolynch/cassandra/tree/CASSANDRA-15012]|

{noformat}
$ python2 --version
Python 2.7.15rc1

$ python2 tools/bin/token-generator --murmur3
Token Generator Interactive Mode


 How many datacenters will participate in this Cassandra cluster? 1
 How many nodes are in datacenter #1? 3

DC #1:
  Node #1:  -9223372036854775808
  Node #2:  -3074457345618258603
  Node #3:   3074457345618258602

$ python3 --version
Python 3.6.7

$ python3 tools/bin/token-generator --murmur3
Token Generator Interactive Mode


 How many datacenters will participate in this Cassandra cluster? 1
 How many nodes are in datacenter #1? 3

DC #1:
  Node #1:  -9223372036854775808
  Node #2:  -3074457345618258603
  Node #3:   3074457345618258602
{noformat}

> token_generator_test.TestTokenGenerator test fails on 2.2
> -
>
> Key: CASSANDRA-15012
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15012
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Test/dtest
>Reporter: Joseph Lynch
>Assignee: Joseph Lynch
>Priority: Minor
>  Labels: beginner, dtest, test
> Fix For: 2.2.x
>
> Attachments: --graph output.png, test-output.png
>
>
> While running tests for the 2.2.14 candidate I noticed that the 
> {{TestTokenGenerator}} dtests are broken. I reproduced locally as well, the 
> issue appears to be that we're running a python2 script with python3 (since 
> dtests run python3 now).
> Should be a quick fix to make the token generator script py2/3 compatible.
> Example local run:
> {noformat}
> pytest --cassandra-dir=/home/josephl/pg/cassandra_2 -k TestTokenGenerator 
>   
> 1 ↵
> ===
>  test session starts 
> 
> platform linux -- Python 3.6.7, pytest-3.6.4, py-1.7.0, pluggy-0.7.1
> rootdir: /home/josephl/pg/cassandra-dtest, inifile: pytest.ini
> plugins: timeout-1.3.3, flaky-3.4.0
> timeout: 900.0s
> timeout method: signal
> timeout func_only: False
> collected 1028 items / 1025 deselected
>   
>   
>  
> token_generator_test.py FFF   
>   
>   
>[100%]
> =
>  FAILURES 
> =
> _
>  TestTokenGenerator.test_multi_dc_tokens_default 
> __
> self = 
> def test_multi_dc_tokens_default(self):
> >   self._multi_dc_tokens()
> token_generator_test.py:167: 
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
> _ _ _ _ _ 
> token_generator_test.py:153: in _multi_dc_tokens
> generated_tokens = 
> self.call_token_generator(self.cluster.get_install_dir(), random, dc_nodes)
> token_generator_test.py:43: in call_token_generator
> token_gen_output = subprocess.check_output(args)
> 

[jira] [Comment Edited] (CASSANDRA-9384) Update jBCrypt dependency to version 0.4

2019-02-19 Thread Dinesh Joshi (JIRA)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772491#comment-16772491
 ] 

Dinesh Joshi edited comment on CASSANDRA-9384 at 2/20/19 12:58 AM:
---

Good idea. Here are the updated patches for 2.1 and trunk. You might have to 
actually merge it up to 2.2, 3.0, 3.11.

 
||2.1||trunk||
|[branch|https://github.com/dineshjoshi/cassandra/tree/9384-cassandra-2.1]|[branch|https://github.com/dineshjoshi/cassandra/tree/9384-trunk-v2]|
|[utests & 
dtests|https://circleci.com/gh/dineshjoshi/workflows/cassandra/tree/9384-cassandra-2.1]|[utests
 & 
dtests|https://circleci.com/gh/dineshjoshi/workflows/cassandra/tree/9384-trunk-v2]|


was (Author: djoshi3):
Good idea. Here are the updated patches for 2.1 and trunk. You might have to 
actually merge it up to 2.2, 3.0, 3.11.

 ||2.1||trunk||
|[branch|https://github.com/dineshjoshi/cassandra/tree/9384-cassandra-2.1]|[branch|https://github.com/dineshjoshi/cassandra/tree/9384-trunk-v2]|
|[utests  
dtests|https://circleci.com/gh/dineshjoshi/workflows/cassandra/tree/9384-cassandra-2.1]|[utests
  
dtests|https://circleci.com/gh/dineshjoshi/workflows/cassandra/tree/9384-trunk-v2]|
||

> Update jBCrypt dependency to version 0.4
> 
>
> Key: CASSANDRA-9384
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9384
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Sam Tunnicliffe
>Assignee: Dinesh Joshi
>Priority: Major
> Fix For: 2.1.x, 2.2.x, 3.0.x, 3.11.x
>
>
> https://bugzilla.mindrot.org/show_bug.cgi?id=2097
> Although the bug tracker lists it as NEW/OPEN, the release notes for 0.4 
> indicate that this is now fixed, so we should update.
> Thanks to [~Bereng] for identifying the issue.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-9384) Update jBCrypt dependency to version 0.4

2019-02-19 Thread Dinesh Joshi (JIRA)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772491#comment-16772491
 ] 

Dinesh Joshi commented on CASSANDRA-9384:
-

Good idea. Here are the updated patches for 2.1 and trunk. You might have to 
actually merge it up to 2.2, 3.0, 3.11.

 ||2.1||trunk||
|[branch|https://github.com/dineshjoshi/cassandra/tree/9384-cassandra-2.1]|[branch|https://github.com/dineshjoshi/cassandra/tree/9384-trunk-v2]|
|[utests  
dtests|https://circleci.com/gh/dineshjoshi/workflows/cassandra/tree/9384-cassandra-2.1]|[utests
  
dtests|https://circleci.com/gh/dineshjoshi/workflows/cassandra/tree/9384-trunk-v2]|
||

> Update jBCrypt dependency to version 0.4
> 
>
> Key: CASSANDRA-9384
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9384
> Project: Cassandra
>  Issue Type: Bug
>Reporter: Sam Tunnicliffe
>Assignee: Dinesh Joshi
>Priority: Major
> Fix For: 2.1.x, 2.2.x, 3.0.x, 3.11.x
>
>
> https://bugzilla.mindrot.org/show_bug.cgi?id=2097
> Although the bug tracker lists it as NEW/OPEN, the release notes for 0.4 
> indicate that this is now fixed, so we should update.
> Thanks to [~Bereng] for identifying the issue.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-15005) Configurable whilelist for UDFs

2019-02-19 Thread Jon Meredith (JIRA)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-15005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772473#comment-16772473
 ] 

Jon Meredith commented on CASSANDRA-15005:
--

You've found the correct place in the code for the whitelist (and blacklist) 
for functions.  I'm interested in extending functions available in CQL at the 
moment, although I'm not sure if I want to add UDFs or add additional 
functionality contained in jars distributed out of band as you describe.

Would being able to add functions through distributed jars be a possible 
alternative for your use case?

> Configurable whilelist for UDFs
> ---
>
> Key: CASSANDRA-15005
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15005
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CQL/Interpreter
>Reporter: A. Soroka
>Priority: Minor
>
> I would like to use the UDF system to distribute some simple calculations on 
> values. For some use cases, this would require access only to some Java API 
> classes that aren't on the (hardcoded) whitelist (e.g. 
> {{java.security.MessageDigest}}). In other cases, it would require access to 
> a little non-C* library code, pre-distributed to nodes by out-of-band means.
> As I understand the situation now, the whitelist for types UDFs can use is 
> hardcoded in java in 
> [UDFunction|[https://github.com/apache/cassandra/blob/trunk/src/java/org/apache/cassandra/cql3/functions/UDFunction.java#L99].]
> This ticket, then, is a request for a facility that would allow that list to 
> be extended via some kind of deployment-time configuration. I realize that 
> serious security concerns immediately arise for this kind of functionality, 
> but I hope that by restricting it (only used during startup, no exposing the 
> whitelist for introspection, etc.) it could be quite practical.
> I'd like very much to assist with this ticket if it is accepted. (I believe I 
> have sufficient Java skill to do that, but no real familiarity with C*'s 
> codebase, yet. :) )



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-15028) Autogenerate api docs in sidecar

2019-02-19 Thread Dinesh Joshi (JIRA)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772463#comment-16772463
 ] 

Dinesh Joshi commented on CASSANDRA-15028:
--

+1 LGTM

> Autogenerate api docs in sidecar
> 
>
> Key: CASSANDRA-15028
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15028
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Chris Lohfink
>Assignee: Chris Lohfink
>Priority: Minor
>  Labels: pull-request-available
> Attachments: screenshot-1.png, screenshot-2.png
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Swagger can provide us a way to define the api and autogenerate nice looking 
> docs and have interactive UI for trying the APIs. This can also be used to 
> autogenerate client libraries in many different libraries.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-15028) Autogenerate api docs in sidecar

2019-02-19 Thread Dinesh Joshi (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-15028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dinesh Joshi updated CASSANDRA-15028:
-
Status: Ready to Commit  (was: Patch Available)

> Autogenerate api docs in sidecar
> 
>
> Key: CASSANDRA-15028
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15028
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Chris Lohfink
>Assignee: Chris Lohfink
>Priority: Minor
>  Labels: pull-request-available
> Attachments: screenshot-1.png, screenshot-2.png
>
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Swagger can provide us a way to define the api and autogenerate nice looking 
> docs and have interactive UI for trying the APIs. This can also be used to 
> autogenerate client libraries in many different libraries.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-15030) Add support for SSL and bindable address to sidecar

2019-02-19 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-15030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated CASSANDRA-15030:
---
Labels: pull-request-available  (was: )

> Add support for SSL and bindable address to sidecar
> ---
>
> Key: CASSANDRA-15030
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15030
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Sidecar
>Reporter: Dinesh Joshi
>Assignee: Dinesh Joshi
>Priority: Minor
>  Labels: pull-request-available
>
> We need to support SSL for the sidecar's REST interface. We should also have 
> the ability to bind the sidecar's API to a specific network interface. This 
> patch adds support for both.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-15030) Add support for SSL and bindable address to sidecar

2019-02-19 Thread Jason Brown (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-15030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Brown updated CASSANDRA-15030:

Reviewers: Chris Lohfink, Vinay Chella
 Reviewer:   (was: Chris Lohfink)

> Add support for SSL and bindable address to sidecar
> ---
>
> Key: CASSANDRA-15030
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15030
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Sidecar
>Reporter: Dinesh Joshi
>Assignee: Dinesh Joshi
>Priority: Minor
>
> We need to support SSL for the sidecar's REST interface. We should also have 
> the ability to bind the sidecar's API to a specific network interface. This 
> patch adds support for both.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-15030) Add support for SSL and bindable address to sidecar

2019-02-19 Thread Dinesh Joshi (JIRA)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-15030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772251#comment-16772251
 ] 

Dinesh Joshi commented on CASSANDRA-15030:
--

Patch: https://github.com/dineshjoshi/cassandra-sidecar/tree/ssl

> Add support for SSL and bindable address to sidecar
> ---
>
> Key: CASSANDRA-15030
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15030
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Sidecar
>Reporter: Dinesh Joshi
>Assignee: Dinesh Joshi
>Priority: Minor
>
> We need to support SSL for the sidecar's REST interface. We should also have 
> the ability to bind the sidecar's API to a specific network interface. This 
> patch adds support for both.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-15030) Add support for SSL and bindable address to sidecar

2019-02-19 Thread Dinesh Joshi (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-15030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dinesh Joshi updated CASSANDRA-15030:
-
Status: Patch Available  (was: Open)

> Add support for SSL and bindable address to sidecar
> ---
>
> Key: CASSANDRA-15030
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15030
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Sidecar
>Reporter: Dinesh Joshi
>Assignee: Dinesh Joshi
>Priority: Minor
>
> We need to support SSL for the sidecar's REST interface. We should also have 
> the ability to bind the sidecar's API to a specific network interface. This 
> patch adds support for both.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-15030) Add support for SSL and bindable address to sidecar

2019-02-19 Thread Dinesh Joshi (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-15030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dinesh Joshi updated CASSANDRA-15030:
-
Issue Type: New Feature  (was: Bug)

> Add support for SSL and bindable address to sidecar
> ---
>
> Key: CASSANDRA-15030
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15030
> Project: Cassandra
>  Issue Type: New Feature
>Reporter: Dinesh Joshi
>Assignee: Dinesh Joshi
>Priority: Minor
>
> We need to support SSL for the sidecar's REST interface. We should also have 
> the ability to bind the sidecar's API to a specific network interface. This 
> patch adds support for both.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-15030) Add support for SSL and bindable address to sidecar

2019-02-19 Thread Dinesh Joshi (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-15030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dinesh Joshi updated CASSANDRA-15030:
-
Reviewer: Chris Lohfink

> Add support for SSL and bindable address to sidecar
> ---
>
> Key: CASSANDRA-15030
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15030
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Sidecar
>Reporter: Dinesh Joshi
>Assignee: Dinesh Joshi
>Priority: Minor
>
> We need to support SSL for the sidecar's REST interface. We should also have 
> the ability to bind the sidecar's API to a specific network interface. This 
> patch adds support for both.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-15030) Add support for SSL and bindable address to sidecar

2019-02-19 Thread Dinesh Joshi (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-15030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dinesh Joshi updated CASSANDRA-15030:
-
Component/s: Sidecar

> Add support for SSL and bindable address to sidecar
> ---
>
> Key: CASSANDRA-15030
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15030
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Sidecar
>Reporter: Dinesh Joshi
>Assignee: Dinesh Joshi
>Priority: Minor
>
> We need to support SSL for the sidecar's REST interface. We should also have 
> the ability to bind the sidecar's API to a specific network interface. This 
> patch adds support for both.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Created] (CASSANDRA-15030) Add support for SSL and bindable address to sidecar

2019-02-19 Thread Dinesh Joshi (JIRA)
Dinesh Joshi created CASSANDRA-15030:


 Summary: Add support for SSL and bindable address to sidecar
 Key: CASSANDRA-15030
 URL: https://issues.apache.org/jira/browse/CASSANDRA-15030
 Project: Cassandra
  Issue Type: Bug
Reporter: Dinesh Joshi
Assignee: Dinesh Joshi


We need to support SSL for the sidecar's REST interface. We should also have 
the ability to bind the sidecar's API to a specific network interface. This 
patch adds support for both.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-14482) ZSTD Compressor support in Cassandra

2019-02-19 Thread Blake Eggleston (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Blake Eggleston updated CASSANDRA-14482:

Reviewers:   (was: Dinesh Joshi)
 Reviewer: Blake Eggleston

> ZSTD Compressor support in Cassandra
> 
>
> Key: CASSANDRA-14482
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14482
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Dependencies, Feature/Compression
>Reporter: Sushma A Devendrappa
>Assignee: Dinesh Joshi
>Priority: Major
>  Labels: performance, pull-request-available
> Fix For: 4.x
>
>  Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> ZStandard has a great speed and compression ratio tradeoff. 
> ZStandard is open source compression from Facebook.
> More about ZSTD
> [https://github.com/facebook/zstd]
> https://code.facebook.com/posts/1658392934479273/smaller-and-faster-data-compression-with-zstandard/
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-15012) token_generator_test.TestTokenGenerator test fails on 2.2

2019-02-19 Thread Stefan Podkowinski (JIRA)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772090#comment-16772090
 ] 

Stefan Podkowinski commented on CASSANDRA-15012:


{noformat}
python2.7 tools/bin/token-generator
Traceback (most recent call last):
  File "tools/bin/token-generator", line 22, in 
from builtins import input
ImportError: No module named builtins
{noformat}

I think you'd have to install the future package for that?

> token_generator_test.TestTokenGenerator test fails on 2.2
> -
>
> Key: CASSANDRA-15012
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15012
> Project: Cassandra
>  Issue Type: Improvement
>  Components: Test/dtest
>Reporter: Joseph Lynch
>Assignee: Joseph Lynch
>Priority: Minor
>  Labels: beginner, dtest, test
> Fix For: 2.2.x
>
> Attachments: --graph output.png, test-output.png
>
>
> While running tests for the 2.2.14 candidate I noticed that the 
> {{TestTokenGenerator}} dtests are broken. I reproduced locally as well, the 
> issue appears to be that we're running a python2 script with python3 (since 
> dtests run python3 now).
> Should be a quick fix to make the token generator script py2/3 compatible.
> Example local run:
> {noformat}
> pytest --cassandra-dir=/home/josephl/pg/cassandra_2 -k TestTokenGenerator 
>   
> 1 ↵
> ===
>  test session starts 
> 
> platform linux -- Python 3.6.7, pytest-3.6.4, py-1.7.0, pluggy-0.7.1
> rootdir: /home/josephl/pg/cassandra-dtest, inifile: pytest.ini
> plugins: timeout-1.3.3, flaky-3.4.0
> timeout: 900.0s
> timeout method: signal
> timeout func_only: False
> collected 1028 items / 1025 deselected
>   
>   
>  
> token_generator_test.py FFF   
>   
>   
>[100%]
> =
>  FAILURES 
> =
> _
>  TestTokenGenerator.test_multi_dc_tokens_default 
> __
> self = 
> def test_multi_dc_tokens_default(self):
> >   self._multi_dc_tokens()
> token_generator_test.py:167: 
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
> _ _ _ _ _ 
> token_generator_test.py:153: in _multi_dc_tokens
> generated_tokens = 
> self.call_token_generator(self.cluster.get_install_dir(), random, dc_nodes)
> token_generator_test.py:43: in call_token_generator
> token_gen_output = subprocess.check_output(args)
> /usr/lib/python3.6/subprocess.py:336: in check_output
> **kwargs).stdout
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 
> _ _ _ _ _ 
> input = None, timeout = None, check = True, popenargs = 
> (['/home/josephl/pg/cassandra_2/tools/bin/token-generator', '3', '5'],), 
> kwargs = {'stdout': -1}, process =  0x7f5188b80208>, stdout = b'', stderr = None
> retcode = 1
> def run(*popenargs, input=None, timeout=None, check=False, **kwargs):
> """Run command with arguments and return a CompletedProcess instance.
> 
> The returned instance will have attributes args, returncode, stdout 
> and
> stderr. By default, stdout and stderr are not captured, and those 
> attributes
> will be None. Pass stdout=PIPE and/or stderr=PIPE in order to capture 
> them.
> 
> If check is True and the exit code was non-zero, it raises a
> CalledProcessError. The CalledProcessError object will have the 

[jira] [Updated] (CASSANDRA-14866) Issue a CQL native protocol warning if SASI indexes are enabled on a table

2019-02-19 Thread JIRA


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-14866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrés de la Peña updated CASSANDRA-14866:
--
Resolution: Fixed
Status: Resolved  (was: Ready to Commit)

> Issue a CQL native protocol warning if SASI indexes are enabled on a table
> --
>
> Key: CASSANDRA-14866
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14866
> Project: Cassandra
>  Issue Type: Bug
>  Components: Feature/SASI
>Reporter: Andrés de la Peña
>Assignee: Andrés de la Peña
>Priority: Major
>  Labels: pull-request-available
> Fix For: 4.0, 3.11.x, 4.x
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> If someone enables SASI indexes then we should return a native protocol 
> warning that will be printed by cqlsh saying that they are beta quality still 
> and you need to be careful with using them in production.
> This is motivated not only by [the existing bugs and 
> limitations|https://issues.apache.org/jira/browse/CASSANDRA-12674?jql=project%20%3D%20CASSANDRA%20AND%20status%20%3D%20Open%20AND%20component%20%3D%20sasi]
>  but for the fact that they haven't been extensively tested yet.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-14866) Issue a CQL native protocol warning if SASI indexes are enabled on a table

2019-02-19 Thread JIRA


[ 
https://issues.apache.org/jira/browse/CASSANDRA-14866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772069#comment-16772069
 ] 

Andrés de la Peña commented on CASSANDRA-14866:
---

Thanks for reviewing.

Committed to 3.11 as 
[e6a61be8c857106d5d99a270b2d17de9f84c4d67|https://github.com/apache/cassandra/commit/e6a61be8c857106d5d99a270b2d17de9f84c4d67]
 and merged to trunk.

Dtests committed as 
[227ae5e7aca25c668340e467a35dfb0f7e1546fa|https://github.com/apache/cassandra-dtest/commit/227ae5e7aca25c668340e467a35dfb0f7e1546fa].

> Issue a CQL native protocol warning if SASI indexes are enabled on a table
> --
>
> Key: CASSANDRA-14866
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14866
> Project: Cassandra
>  Issue Type: Bug
>  Components: Feature/SASI
>Reporter: Andrés de la Peña
>Assignee: Andrés de la Peña
>Priority: Major
>  Labels: pull-request-available
> Fix For: 4.0, 3.11.x, 4.x
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> If someone enables SASI indexes then we should return a native protocol 
> warning that will be printed by cqlsh saying that they are beta quality still 
> and you need to be careful with using them in production.
> This is motivated not only by [the existing bugs and 
> limitations|https://issues.apache.org/jira/browse/CASSANDRA-12674?jql=project%20%3D%20CASSANDRA%20AND%20status%20%3D%20Open%20AND%20component%20%3D%20sasi]
>  but for the fact that they haven't been extensively tested yet.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra-dtest] branch master updated: Adapt tests to materialized views disabled by default (CASSANDRA-14866)

2019-02-19 Thread adelapena
This is an automated email from the ASF dual-hosted git repository.

adelapena pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/cassandra-dtest.git


The following commit(s) were added to refs/heads/master by this push:
 new 227ae5e  Adapt tests to materialized views disabled by default 
(CASSANDRA-14866)
227ae5e is described below

commit 227ae5e7aca25c668340e467a35dfb0f7e1546fa
Author: Andrés de la Peña 
AuthorDate: Fri Feb 1 19:52:34 2019 +

Adapt tests to materialized views disabled by default (CASSANDRA-14866)
---
 auth_test.py   | 3 ++-
 commitlog_test.py  | 1 +
 concurrent_schema_changes_test.py  | 1 +
 cqlsh_tests/cqlsh_tests.py | 3 ++-
 jmx_test.py| 1 +
 materialized_views_test.py | 4 
 pushed_notifications_test.py   | 1 +
 sstable_generation_loading_test.py | 1 +
 upgrade_tests/cql_tests.py | 2 +-
 9 files changed, 14 insertions(+), 3 deletions(-)

diff --git a/auth_test.py b/auth_test.py
index 7c275e0..edcc936 100644
--- a/auth_test.py
+++ b/auth_test.py
@@ -1091,7 +1091,8 @@ class TestAuth(Tester):
 """
 config = {'authenticator': 
'org.apache.cassandra.auth.PasswordAuthenticator',
   'authorizer': 
'org.apache.cassandra.auth.CassandraAuthorizer',
-  'permissions_validity_in_ms': permissions_validity}
+  'permissions_validity_in_ms': permissions_validity,
+  'enable_materialized_views': 'true'}
 if self.dtest_config.cassandra_version_from_build >= '4.0':
 config['network_authorizer'] = 
'org.apache.cassandra.auth.CassandraNetworkAuthorizer'
 self.cluster.set_configuration_options(values=config)
diff --git a/commitlog_test.py b/commitlog_test.py
index 19fd385..02c25dc 100644
--- a/commitlog_test.py
+++ b/commitlog_test.py
@@ -32,6 +32,7 @@ class TestCommitLog(Tester):
 
 @pytest.fixture(scope='function', autouse=True)
 def fixture_set_cluster_settings(self, fixture_dtest_setup):
+
fixture_dtest_setup.cluster.set_configuration_options({'enable_materialized_views':
 'true'})
 fixture_dtest_setup.cluster.populate(1)
 [self.node1] = fixture_dtest_setup.cluster.nodelist()
 
diff --git a/concurrent_schema_changes_test.py 
b/concurrent_schema_changes_test.py
index a975876..fba75e4 100644
--- a/concurrent_schema_changes_test.py
+++ b/concurrent_schema_changes_test.py
@@ -247,6 +247,7 @@ class TestConcurrentSchemaChanges(Tester):
 create materialized views across multiple threads concurrently
 """
 cluster = self.cluster
+cluster.set_configuration_options({'enable_materialized_views': 
'true'})
 cluster.populate(3).start()
 node1, node2, node3 = cluster.nodelist()
 session = self.cql_connection(node1)
diff --git a/cqlsh_tests/cqlsh_tests.py b/cqlsh_tests/cqlsh_tests.py
index e5c601c..ba30b75 100644
--- a/cqlsh_tests/cqlsh_tests.py
+++ b/cqlsh_tests/cqlsh_tests.py
@@ -802,9 +802,9 @@ VALUES (4, blobAsInt(0x), '', blobAsBigint(0x), 0x, 
blobAsBoolean(0x), blobAsDec
 """
 @jira_ticket CASSANDRA-9961
 """
+self.cluster.set_configuration_options({'enable_materialized_views': 
'true'})
 self.cluster.populate(1)
 self.cluster.start(wait_for_binary_proto=True)
-node1, = self.cluster.nodelist()
 
 self.execute(
 cql="""
@@ -1533,6 +1533,7 @@ Tracing session:""")
 Test operations on a materialized view: create, describe, select from, 
drop, create using describe output.
 @jira_ticket CASSANDRA-9961 and CASSANDRA-10348
 """
+self.cluster.set_configuration_options({'enable_materialized_views': 
'true'})
 self.cluster.populate(1)
 self.cluster.start(wait_for_binary_proto=True)
 node1, = self.cluster.nodelist()
diff --git a/jmx_test.py b/jmx_test.py
index 76d4c06..caf1d04 100644
--- a/jmx_test.py
+++ b/jmx_test.py
@@ -108,6 +108,7 @@ class TestJMX(Tester):
 Test that the right mbeans are created and released when creating mvs
 """
 cluster = self.cluster
+cluster.set_configuration_options({'enable_materialized_views': 
'true'})
 cluster.populate(1)
 node = cluster.nodelist()[0]
 remove_perf_disable_shared_mem(node)
diff --git a/materialized_views_test.py b/materialized_views_test.py
index feac99e..009ca16 100644
--- a/materialized_views_test.py
+++ b/materialized_views_test.py
@@ -53,6 +53,7 @@ class TestMaterializedViews(Tester):
 
 def prepare(self, user_table=False, rf=1, options=None, nodes=3, 
install_byteman=False, **kwargs):
 cluster = self.cluster
+cluster.set_configuration_options({'enable_materialized_views': 
'true'})
 cluster.populate([nodes, 0], install_byteman=install_byteman)
 if options:
 cluster.set_configuration_options(values=options)
@@ 

[jira] [Commented] (CASSANDRA-15005) Configurable whilelist for UDFs

2019-02-19 Thread A. Soroka (JIRA)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-15005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772050#comment-16772050
 ] 

A. Soroka commented on CASSANDRA-15005:
---

Thank you for the response [~cscotta]. I've only gotten as far as beginning to 
set up C* in my IDE, so I'm afraid I haven't done much. Perhaps that's good, 
though, because if  [~jmeredithco] is also interested in this, I do not want to 
tread on toes or redo someone else's work. I'll wait to hear from him.

> Configurable whilelist for UDFs
> ---
>
> Key: CASSANDRA-15005
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15005
> Project: Cassandra
>  Issue Type: Improvement
>  Components: CQL/Interpreter
>Reporter: A. Soroka
>Priority: Minor
>
> I would like to use the UDF system to distribute some simple calculations on 
> values. For some use cases, this would require access only to some Java API 
> classes that aren't on the (hardcoded) whitelist (e.g. 
> {{java.security.MessageDigest}}). In other cases, it would require access to 
> a little non-C* library code, pre-distributed to nodes by out-of-band means.
> As I understand the situation now, the whitelist for types UDFs can use is 
> hardcoded in java in 
> [UDFunction|[https://github.com/apache/cassandra/blob/trunk/src/java/org/apache/cassandra/cql3/functions/UDFunction.java#L99].]
> This ticket, then, is a request for a facility that would allow that list to 
> be extended via some kind of deployment-time configuration. I realize that 
> serious security concerns immediately arise for this kind of functionality, 
> but I hope that by restricting it (only used during startup, no exposing the 
> whitelist for introspection, etc.) it could be quite practical.
> I'd like very much to assist with this ticket if it is accepted. (I believe I 
> have sufficient Java skill to do that, but no real familiarity with C*'s 
> codebase, yet. :) )



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Updated] (CASSANDRA-14866) Issue a CQL native protocol warning if SASI indexes are enabled on a table

2019-02-19 Thread ASF GitHub Bot (JIRA)


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-14866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated CASSANDRA-14866:
---
Labels: pull-request-available  (was: )

> Issue a CQL native protocol warning if SASI indexes are enabled on a table
> --
>
> Key: CASSANDRA-14866
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14866
> Project: Cassandra
>  Issue Type: Bug
>  Components: Feature/SASI
>Reporter: Andrés de la Peña
>Assignee: Andrés de la Peña
>Priority: Major
>  Labels: pull-request-available
> Fix For: 4.0, 3.11.x, 4.x
>
>
> If someone enables SASI indexes then we should return a native protocol 
> warning that will be printed by cqlsh saying that they are beta quality still 
> and you need to be careful with using them in production.
> This is motivated not only by [the existing bugs and 
> limitations|https://issues.apache.org/jira/browse/CASSANDRA-12674?jql=project%20%3D%20CASSANDRA%20AND%20status%20%3D%20Open%20AND%20component%20%3D%20sasi]
>  but for the fact that they haven't been extensively tested yet.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra] branch trunk updated (47d4971 -> 094689a)

2019-02-19 Thread adelapena
This is an automated email from the ASF dual-hosted git repository.

adelapena pushed a change to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra.git.


from 47d4971  Fix SimpleStrategy option validation
 new e6a61be  Add flag to disable SASI indexes, and warning on creation
 new 094689a  Merge branch 'cassandra-3.11' into trunk

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 CHANGES.txt|  3 +-
 NEWS.txt   | 17 +++-
 conf/cassandra.yaml| 23 ++
 src/java/org/apache/cassandra/config/Config.java   |  4 +-
 .../cassandra/config/DatabaseDescriptor.java   | 17 +++-
 .../statements/schema/CreateIndexStatement.java| 15 +++
 .../statements/schema/CreateViewStatement.java |  6 +--
 src/java/org/apache/cassandra/db/view/View.java|  2 +
 .../org/apache/cassandra/index/sasi/SASIIndex.java |  2 +
 test/conf/cassandra-murmur.yaml|  2 +
 test/conf/cassandra.yaml   |  2 +
 test/unit/org/apache/cassandra/cql3/ViewTest.java  | 51 ++
 .../apache/cassandra/index/sasi/SASICQLTest.java   | 49 +
 13 files changed, 178 insertions(+), 15 deletions(-)


-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[cassandra] 01/01: Merge branch 'cassandra-3.11' into trunk

2019-02-19 Thread adelapena
This is an automated email from the ASF dual-hosted git repository.

adelapena pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra.git

commit 094689acf10bf133637c53aeebd3e8157832a279
Merge: 47d4971 e6a61be
Author: Andrés de la Peña 
AuthorDate: Tue Feb 19 15:08:10 2019 +

Merge branch 'cassandra-3.11' into trunk

# Conflicts:
#   CHANGES.txt
#   conf/cassandra.yaml
#   src/java/org/apache/cassandra/config/Config.java
#   src/java/org/apache/cassandra/config/DatabaseDescriptor.java
#   src/java/org/apache/cassandra/cql3/statements/CreateIndexStatement.java
#   src/java/org/apache/cassandra/cql3/statements/CreateViewStatement.java
#   src/java/org/apache/cassandra/db/view/View.java
#   test/unit/org/apache/cassandra/cql3/ViewTest.java
#   test/unit/org/apache/cassandra/index/sasi/SASICQLTest.java

 CHANGES.txt|  3 +-
 NEWS.txt   | 17 +++-
 conf/cassandra.yaml| 23 ++
 src/java/org/apache/cassandra/config/Config.java   |  4 +-
 .../cassandra/config/DatabaseDescriptor.java   | 17 +++-
 .../statements/schema/CreateIndexStatement.java| 15 +++
 .../statements/schema/CreateViewStatement.java |  6 +--
 src/java/org/apache/cassandra/db/view/View.java|  2 +
 .../org/apache/cassandra/index/sasi/SASIIndex.java |  2 +
 test/conf/cassandra-murmur.yaml|  2 +
 test/conf/cassandra.yaml   |  2 +
 test/unit/org/apache/cassandra/cql3/ViewTest.java  | 51 ++
 .../apache/cassandra/index/sasi/SASICQLTest.java   | 49 +
 13 files changed, 178 insertions(+), 15 deletions(-)

diff --cc CHANGES.txt
index 09d1733,f520aed..02233dd
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@@ -1,354 -1,5 +1,355 @@@
 +4.0
 + * Fix SimpleStrategy option validation (CASSANDRA-15007)
 + * Don't try to cancel 2i compactions when starting anticompaction 
(CASSANDRA-15024)
 + * Avoid NPE in RepairRunnable.recordFailure (CASSANDRA-15025)
 + * SSL Cert Hot Reloading should check for sanity of the new 
keystore/truststore before loading it (CASSANDRA-14991)
 + * Avoid leaking threads when failing anticompactions and rate limit 
anticompactions (CASSANDRA-15002)
 + * Validate token() arguments early instead of throwing NPE at execution 
(CASSANDRA-14989)
 + * Add a new tool to dump audit logs (CASSANDRA-14885)
 + * Fix generating javadoc with Java11 (CASSANDRA-14988)
 + * Only cancel conflicting compactions when starting anticompactions and sub 
range compactions (CASSANDRA-14935)
 + * Use a stub IndexRegistry for non-daemon use cases (CASSANDRA-14938)
 + * Don't enable client transports when bootstrap is pending (CASSANDRA-14525)
 + * Make antiCompactGroup throw exception on error and anticompaction non 
cancellable
 +   again (CASSANDRA-14936)
 + * Catch empty/invalid bounds in SelectStatement (CASSANDRA-14849)
 + * Auto-expand replication_factor for NetworkTopologyStrategy 
(CASSANDRA-14303)
 + * Transient Replication: support EACH_QUORUM (CASSANDRA-14727)
 + * BufferPool: allocating thread for new chunks should acquire directly 
(CASSANDRA-14832)
 + * Send correct messaging version in internode messaging handshake's third 
message (CASSANDRA-14896)
 + * Make Read and Write Latency columns consistent for proxyhistograms and 
tablehistograms (CASSANDRA-11939)
 + * Make protocol checksum type option case insensitive (CASSANDRA-14716)
 + * Forbid re-adding static columns as regular and vice versa (CASSANDRA-14913)
 + * Audit log allows system keyspaces to be audited via configuration options 
(CASSANDRA-14498)
 + * Lower default chunk_length_in_kb from 64kb to 16kb (CASSANDRA-13241)
 + * Startup checker should wait for count rather than percentage 
(CASSANDRA-14297)
 + * Fix incorrect sorting of replicas in 
SimpleStrategy.calculateNaturalReplicas (CASSANDRA-14862)
 + * Partitioned outbound internode TCP connections can occur when nodes 
restart (CASSANDRA-14358)
 + * Don't write to system_distributed.repair_history, system_traces.sessions, 
system_traces.events in mixed version 3.X/4.0 clusters (CASSANDRA-14841)
 + * Avoid running query to self through messaging service (CASSANDRA-14807)
 + * Allow using custom script for chronicle queue BinLog archival 
(CASSANDRA-14373)
 + * Transient->Full range movements mishandle consistency level upgrade 
(CASSANDRA-14759)
 + * ReplicaCollection follow-up (CASSANDRA-14726)
 + * Transient node receives full data requests (CASSANDRA-14762)
 + * Enable snapshot artifacts publish (CASSANDRA-12704)
 + * Introduce RangesAtEndpoint.unwrap to simplify 
StreamSession.addTransferRanges (CASSANDRA-14770)
 + * LOCAL_QUORUM may speculate to non-local nodes, resulting in Timeout 
instead of Unavailable (CASSANDRA-14735)
 + * Avoid creating empty compaction tasks after truncate (CASSANDRA-14780)
 + * Fail incremental repair 

[cassandra] branch cassandra-3.11 updated: Add flag to disable SASI indexes, and warning on creation

2019-02-19 Thread adelapena
This is an automated email from the ASF dual-hosted git repository.

adelapena pushed a commit to branch cassandra-3.11
in repository https://gitbox.apache.org/repos/asf/cassandra.git


The following commit(s) were added to refs/heads/cassandra-3.11 by this push:
 new e6a61be  Add flag to disable SASI indexes, and warning on creation
e6a61be is described below

commit e6a61be8c857106d5d99a270b2d17de9f84c4d67
Author: Andrés de la Peña 
AuthorDate: Tue Nov 6 19:01:47 2018 +

Add flag to disable SASI indexes, and warning on creation

patch by Andres de la Peña; reviewed by Robert Stupp for CASSANDRA-14866
---
 CHANGES.txt|  5 +-
 NEWS.txt   |  8 
 conf/cassandra.yaml| 19 ++--
 src/java/org/apache/cassandra/config/Config.java   |  2 +
 .../cassandra/config/DatabaseDescriptor.java   | 17 ++-
 .../cql3/statements/CreateIndexStatement.java  | 15 +-
 .../cql3/statements/CreateViewStatement.java   |  9 ++--
 src/java/org/apache/cassandra/db/view/View.java|  3 +-
 .../org/apache/cassandra/index/sasi/SASIIndex.java |  2 +
 test/unit/org/apache/cassandra/cql3/ViewTest.java  | 55 --
 .../apache/cassandra/index/sasi/SASICQLTest.java   | 48 +++
 11 files changed, 164 insertions(+), 19 deletions(-)

diff --git a/CHANGES.txt b/CHANGES.txt
index 2f9813e..f520aed 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,10 +1,11 @@
 3.11.5
+ * Add flag to disable SASI indexes, and warnings on creation (CASSANDRA-14866)
 Merged from 3.0:
  * Improve `nodetool status -r` speed (CASSANDRA-14847)
  * Improve merkle tree size and time on heap (CASSANDRA-14096)
  * Add missing commands to nodetool_completion (CASSANDRA-14916)
  * Anti-compaction temporarily corrupts sstable state for readers 
(CASSANDRA-15004)
- Merged from 2.2:
+Merged from 2.2:
  * Multi-version in-JVM dtests (CASSANDRA-14937)
 
 
@@ -43,7 +44,7 @@ Merged from 3.0:
  * Fix static column order for SELECT * wildcard queries (CASSANDRA-14638)
  * sstableloader should use discovered broadcast address to connect 
intra-cluster (CASSANDRA-14522)
  * Fix reading columns with non-UTF names from schema (CASSANDRA-14468)
- Merged from 2.2:
+Merged from 2.2:
  * CircleCI docker image should bake in more dependencies (CASSANDRA-14985)
  * Don't enable client transports when bootstrap is pending (CASSANDRA-14525)
  * MigrationManager attempts to pull schema from different major version nodes 
(CASSANDRA-14928)
diff --git a/NEWS.txt b/NEWS.txt
index d5a9128..2feac81 100644
--- a/NEWS.txt
+++ b/NEWS.txt
@@ -50,6 +50,14 @@ Upgrading
- repair_session_max_tree_depth setting has been added to 
cassandra.yaml to allow operators to reduce
  merkle tree size if repair is creating too much heap pressure. See 
CASSANDRA-14096 for details.
 
+Experimental features
+-
+- An 'enable_sasi_indexes' flag, true by default, has been added to 
cassandra.yaml to allow operators to prevent
+  the creation of new SASI indexes, which are considered experimental and 
are not recommended for production use.
+  (See https://www.mail-archive.com/dev@cassandra.apache.org/msg13582.html)
+- The flags 'enable_sasi_indexes' and 'enable_materialized_views' have 
been grouped under an experimental features
+  section in cassandra.yaml.
+
 3.11.4
 ==
 
diff --git a/conf/cassandra.yaml b/conf/cassandra.yaml
index a263d8a..9182008 100644
--- a/conf/cassandra.yaml
+++ b/conf/cassandra.yaml
@@ -1112,10 +1112,6 @@ enable_user_defined_functions: false
 # This option has no effect, if enable_user_defined_functions is false.
 enable_scripted_user_defined_functions: false
 
-# Enables materialized view creation on this node.
-# Materialized views are considered experimental and are not recommended for 
production use.
-enable_materialized_views: true
-
 # The default Windows kernel timer and scheduling resolution is 15.6ms for 
power conservation.
 # Lowering this value on Windows can provide much tighter latency and better 
throughput, however
 # some virtualized environments may see a negative performance impact from 
changing this setting
@@ -1247,4 +1243,17 @@ back_pressure_strategy:
 # time and queue contention while iterating the backlog of messages.
 # An interval of 0 disables any wait time, which is the behavior of former 
Cassandra versions.
 #
-# otc_backlog_expiration_interval_ms: 200
\ No newline at end of file
+# otc_backlog_expiration_interval_ms: 200
+
+
+#
+# EXPERIMENTAL FEATURES #
+#
+
+# Enables materialized view creation on this node.
+# Materialized views are considered experimental and are not recommended for 
production use.
+enable_materialized_views: true
+
+# Enables SASI index creation on this node.
+# SASI indexes are considered experimental and are not recommended for 
production use.

[jira] [Updated] (CASSANDRA-14336) sstableloader fails if sstables contains removed columns

2019-02-19 Thread JIRA


 [ 
https://issues.apache.org/jira/browse/CASSANDRA-14336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hannu Kröger updated CASSANDRA-14336:
-
Reproduced In: 3.11.4, 3.11.1  (was: 3.11.1)

> sstableloader fails if sstables contains removed columns
> 
>
> Key: CASSANDRA-14336
> URL: https://issues.apache.org/jira/browse/CASSANDRA-14336
> Project: Cassandra
>  Issue Type: Bug
>  Components: Legacy/Tools
>Reporter: Hannu Kröger
>Assignee: Jaydeepkumar Chovatia
>Priority: Major
>
> If I copy the schema and try to load in sstables with sstableloader, loading 
> sometimes fails with
> {code:java}
> Exception in thread "main" org.apache.cassandra.tools.BulkLoadException: 
> java.lang.RuntimeException: Failed to list files in /tmp/test/bug3_dest-acdc
>     at org.apache.cassandra.tools.BulkLoader.load(BulkLoader.java:93)
>     at org.apache.cassandra.tools.BulkLoader.main(BulkLoader.java:48)
> Caused by: java.lang.RuntimeException: Failed to list files in 
> /tmp/test/bug3_dest-acdc
>     at 
> org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:77)
>     at 
> org.apache.cassandra.db.lifecycle.LifecycleTransaction.getFiles(LifecycleTransaction.java:561)
>     at 
> org.apache.cassandra.io.sstable.SSTableLoader.openSSTables(SSTableLoader.java:76)
>     at 
> org.apache.cassandra.io.sstable.SSTableLoader.stream(SSTableLoader.java:165)
>     at org.apache.cassandra.tools.BulkLoader.load(BulkLoader.java:80)
>     ... 1 more
> Caused by: java.lang.RuntimeException: Unknown column d during deserialization
>     at 
> org.apache.cassandra.db.SerializationHeader$Component.toHeader(SerializationHeader.java:321)
>     at 
> org.apache.cassandra.io.sstable.format.SSTableReader.openForBatch(SSTableReader.java:440)
>     at 
> org.apache.cassandra.io.sstable.SSTableLoader.lambda$openSSTables$0(SSTableLoader.java:121)
>     at 
> org.apache.cassandra.db.lifecycle.LogAwareFileLister.lambda$innerList$2(LogAwareFileLister.java:99)
>     at 
> java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174)
>     at java.util.TreeMap$EntrySpliterator.forEachRemaining(TreeMap.java:2969)
>     at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
>     at 
> java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
>     at 
> java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
>     at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
>     at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
>     at 
> org.apache.cassandra.db.lifecycle.LogAwareFileLister.innerList(LogAwareFileLister.java:101)
>     at 
> org.apache.cassandra.db.lifecycle.LogAwareFileLister.list(LogAwareFileLister.java:73)
>     ... 5 more{code}
> This requires that we have dropped columns in the source table and sstables 
> exist from the "old schema" time.
> This can be very easily reproduced. I used following script:
> {code:java}
> KS=test
> SRCTABLE=bug3_source
> DESTTABLE=bug3_dest
> DATADIR=/usr/local/var/lib/cassandra/data
> TMPDIR=/tmp
> cqlsh -e "CREATE TABLE $KS.$SRCTABLE(a int primary key, b int, c int, d int);"
> cqlsh -e "CREATE TABLE $KS.$DESTTABLE(a int primary key, b int, c int);"
> cqlsh -e "INSERT INTO $KS.$SRCTABLE(a,b,c,d) values(1,2,3,4);"
> nodetool flush $KS $SRCTABLE
> cqlsh -e "ALTER TABLE $KS.$SRCTABLE DROP d;"
> nodetool flush $KS $SRCTABLE
> mkdir -p $TMPDIR/$KS/$DESTTABLE-acdc
> cp $DATADIR/$KS/$SRCTABLE-*/* $TMPDIR/$KS/$DESTTABLE-acdc
> sstableloader -d 127.0.0.1 $TMPDIR/$KS/$DESTTABLE-acdc{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org



[jira] [Commented] (CASSANDRA-9633) Add ability to encrypt sstables

2019-02-19 Thread Shaurya Gupta (JIRA)


[ 
https://issues.apache.org/jira/browse/CASSANDRA-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771705#comment-16771705
 ] 

Shaurya Gupta commented on CASSANDRA-9633:
--

Hi [~jasobrown]

Will this be included in 4.x release?

Thanks

> Add ability to encrypt sstables
> ---
>
> Key: CASSANDRA-9633
> URL: https://issues.apache.org/jira/browse/CASSANDRA-9633
> Project: Cassandra
>  Issue Type: New Feature
>  Components: Legacy/Core
>Reporter: Jason Brown
>Priority: Major
>  Labels: encryption, security, sstable
> Fix For: 4.x
>
>
> Add option to allow encrypting of sstables.
> I have a version of this functionality built on cassandra 2.0 that 
> piggy-backs on the existing sstable compression functionality and ICompressor 
> interface (similar in nature to what DataStax Enterprise does). However, if 
> we're adding the feature to the main OSS product, I'm not sure if we want to 
> use the pluggable compression framework or if it's worth investigating a 
> different path. I think there's a lot of upside in reusing the sstable 
> compression scheme, but perhaps add a new component in cqlsh for table 
> encryption and a corresponding field in CFMD.
> Encryption configuration in the yaml can use the same mechanism as 
> CASSANDRA-6018 (which is currently pending internal review).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org
For additional commands, e-mail: commits-h...@cassandra.apache.org