Re: Cassandra upgrade from 2.1 to 3.0

2018-05-14 Thread kooljava2 
 We are using datstax java driver  1.5.0
Thank you.

On Saturday, 12 May 2018, 10:37:04 GMT-7, Jeff Jirsa  
wrote:  
 
 I haven't seen this before, but I have a guess.
What client/driver are you using?
Are you using a prepared statement that has every column listed for the update, 
and leaving the un-set columns as null? If so, the null is being translated 
into a delete, which is clearly not what you want.
The differentiation between UNSET and NULL went into 2.2 ( 
https://issues.apache.org/jira/browse/CASSANDRA-7304 ) , and most drivers have 
been updated to know the difference ( https://github.com/gocql/gocql/issues/861 
, https://datastax-oss.atlassian.net/browse/JAVA-777 , etc). I haven't read the 
patch for 7304, but I suspect that maybe there's some sort of mixup along the 
way (maybe in your driver, or maybe you upgraded the driver to support 3.0 and 
picked up a new feature you didnt realize you picked up, etc)

On Fri, May 11, 2018 at 11:26 AM, kooljava2  wrote:

 After further analyzing the data. I see some pattern. The rows which were 
updated in last 2-3 weeks, the column which were not part of this update have 
the null values.  

Has anyone encountered this issue during the upgrade? 


Thank you,

On Thursday, 10 May 2018, 19:49:50 GMT-7, kooljava2 
 wrote:  
 
  Hello Jeff,
2.1.19 to 3.0.15.
Thank you. 

On Thursday, 10 May 2018, 17:43:58 GMT-7, Jeff Jirsa  
wrote:  
 
 Which minor version of 3.0

-- Jeff Jirsa

On May 11, 2018, at 2:54 AM, kooljava2  wrote:



Hello,

Upgraded Cassandra 2.1 to 3.0.  We see certain data in few columns being set to 
"null". These null columns were created during the row creation time.

After looking at the data see a pattern where update was done on these rows. 
Rows which were updated has data but rows which were not part of the update are 
set to null.

 created_on    | created_by  | id
-- ---+-+ 
-- ---
    null |    null |    
12345



sstabledump:- 

WARN  20:47:38,741 Small cdc volume detected at /var/lib/cassandra/cdc_raw; 
setting cdc_total_space_in_mb to 1278.  You can override this in cassandra.yaml
[
  {
    "partition" : {
  "key" : [ "12345" ],
  "position" : 5155159
    },
    "rows" : [
  {
    "type" : "row",
    "position" : 5168738,
    "deletion_info" : { "marked_deleted" : "2018-03-28T20:38:08.05Z", 
"local_delete_time" : "2018-03-28T20:38:08Z" },
    "cells" : [
  { "name" : "doc_type", "value" : false, "tstamp" : 
"2018-03-28T20:38:08.060Z" },
  { "name" : "industry", "deletion_info" : { "local_delete_time" : 
"2018-03-28T20:38:08Z" },
    "tstamp" : "2018-03-28T20:38:08.060Z"
  },
  { "name" : "last_modified_by", "value" : "12345", "tstamp" : 
"2018-03-28T20:38:08.060Z" },
  { "name" : "last_modified_date", "value" : "2018-03-28 
20:38:08.059Z", "tstamp" : "2018-03-28T20:38:08.060Z" },
  { "name" : "locale", "deletion_info" : { "local_delete_time" : 
"2018-03-28T20:38:08Z" },
    "tstamp" : "2018-03-28T20:38:08.060Z"
  },
  { "name" : "postal_code", "deletion_info" : { "local_delete_time" : 
"2018-03-28T20:38:08Z" },
    "tstamp" : "2018-03-28T20:38:08.060Z"
  },
  { "name" : "ticket", "deletion_info" : { "marked_deleted" : 
"2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z" } },
  { "name" : "ticket", "path" : [ "TEMP_DATA" ], "value" : 
"{\"name\":\"TEMP_DATA\",\" ticket\":\" a42638dae8350e889f2603be1427ac 
6f5dec5e486d4db164a76bf80820cd f68d635cff5e7d555e6d4eabb9b5b8 
2597b68bec0fcd735fcca\",\" lastRenewedDate\":\"2018-03- 28T20:38:08Z\"}", 
"tstamp" : "2018-03-28T20:38:08.060Z" },
  { "name" : "ticket", "path" : [ "TEMP_TEMP2" ], "value" : 
"{\"name\":\"TEMP_TEMP2\",\" ticket\":\"a4263b7350d1f2683\" 
,\"lastRenewedDate\":\"2018- 03-28T20:38:07Z\"}", "tstamp" : 
"2018-03-28T20:38:08.060Z" },
  { "name" : "ppstatus_pf", "deletion_info" : { "marked_deleted" : 
"2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z" } },
  { "name" : "ppstatus_pers", "deletion_info" : { "marked_deleted" : 
"2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z" } }
    ]
  }
    ]
  }
]WARN  20:47:41,325 Small cdc volume detected at /var/lib/cassandra/cdc_raw; 
setting cdc_total_space_in_mb to 1278.  You can override this in cassandra.yaml
[
  {
    "partition" : {
  "key" : [ "12345" ],
  "position" : 18743072
    },
    "rows" : [
  {
    "type" : "row",
    "position" : 18751808,
    "liveness_info" : { "tstamp" : "2017-10-25T10:22:41.612Z" },
    "cells" : [
  { "name" :

Re: Cassandra upgrade from 2.1 to 3.0

2018-05-12 Thread Jeff Jirsa 
I haven't seen this before, but I have a guess.

What client/driver are you using?

Are you using a prepared statement that has every column listed for the
update, and leaving the un-set columns as null? If so, the null is being
translated into a delete, which is clearly not what you want.

The differentiation between UNSET and NULL went into 2.2 (
https://issues.apache.org/jira/browse/CASSANDRA-7304 ) , and most drivers
have been updated to know the difference (
https://github.com/gocql/gocql/issues/861 ,
https://datastax-oss.atlassian.net/browse/JAVA-777 , etc). I haven't read
the patch for 7304, but I suspect that maybe there's some sort of mixup
along the way (maybe in your driver, or maybe you upgraded the driver to
support 3.0 and picked up a new feature you didnt realize you picked up,
etc)


On Fri, May 11, 2018 at 11:26 AM, kooljava2 
wrote:

> After further analyzing the data. I see some pattern. The rows which were
> updated in last 2-3 weeks, the column which were not part of this update
> have the null values.
>
> Has anyone encountered this issue during the upgrade?
>
>
> Thank you,
>
>
> On Thursday, 10 May 2018, 19:49:50 GMT-7, kooljava2
>  wrote:
>
>
> Hello Jeff,
>
> 2.1.19 to 3.0.15.
>
> Thank you.
>
> On Thursday, 10 May 2018, 17:43:58 GMT-7, Jeff Jirsa 
> wrote:
>
>
> Which minor version of 3.0
>
> --
> Jeff Jirsa
>
>
> On May 11, 2018, at 2:54 AM, kooljava2 
> wrote:
>
>
> Hello,
>
> Upgraded Cassandra 2.1 to 3.0.  We see certain data in few columns being
> set to "null". These null columns were created during the row creation time.
>
> After looking at the data see a pattern where update was done on these
> rows. Rows which were updated has data but rows which were not part of the
> update are set to null.
>
>  created_on| created_by  | id
> -+-+
> -
> null |null
> |12345
>
>
>
> sstabledump:-
>
> WARN  20:47:38,741 Small cdc volume detected at
> /var/lib/cassandra/cdc_raw; setting cdc_total_space_in_mb to 1278.  You can
> override this in cassandra.yaml
> [
>   {
> "partition" : {
>   "key" : [ "12345" ],
>   "position" : 5155159
> },
> "rows" : [
>   {
> "type" : "row",
> "position" : 5168738,
> "deletion_info" : { "marked_deleted" :
> "2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z"
> },
> "cells" : [
>   { "name" : "doc_type", "value" : false, "tstamp" :
> "2018-03-28T20:38:08.060Z" },
>   { "name" : "industry", "deletion_info" : { "local_delete_time" :
> "2018-03-28T20:38:08Z" },
> "tstamp" : "2018-03-28T20:38:08.060Z"
>   },
>   { "name" : "last_modified_by", "value" : "12345", "tstamp" :
> "2018-03-28T20:38:08.060Z" },
>   { "name" : "last_modified_date", "value" : "2018-03-28
> 20:38:08.059Z", "tstamp" : "2018-03-28T20:38:08.060Z" },
>   { "name" : "locale", "deletion_info" : { "local_delete_time" :
> "2018-03-28T20:38:08Z" },
> "tstamp" : "2018-03-28T20:38:08.060Z"
>   },
>   { "name" : "postal_code", "deletion_info" : {
> "local_delete_time" : "2018-03-28T20:38:08Z" },
> "tstamp" : "2018-03-28T20:38:08.060Z"
>   },
>   { "name" : "ticket", "deletion_info" : { "marked_deleted" :
> "2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z"
> } },
>   { "name" : "ticket", "path" : [ "TEMP_DATA" ], "value" :
> "{\"name\":\"TEMP_DATA\",\"ticket\":\"a42638dae8350e889f2603be1427ac
> 6f5dec5e486d4db164a76bf80820cdf68d635cff5e7d555e6d4eabb9b5b8
> 2597b68bec0fcd735fcca\",\"lastRenewedDate\":\"2018-03-28T20:38:08Z\"}",
> "tstamp" : "2018-03-28T20:38:08.060Z" },
>   { "name" : "ticket", "path" : [ "TEMP_TEMP2" ], "value" :
> "{\"name\":\"TEMP_TEMP2\",\"ticket\":\"a4263b7350d1f2683\"
> ,\"lastRenewedDate\":\"2018-03-28T20:38:07Z\"}", "tstamp" :
> "2018-03-28T20:38:08.060Z" },
>   { "name" : "ppstatus_pf", "deletion_info" : { "marked_deleted" :
> "2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z"
> } },
>   { "name" : "ppstatus_pers", "deletion_info" : { "marked_deleted"
> : "2018-03-28T20:38:08.05Z", "local_delete_time" :
> "2018-03-28T20:38:08Z" } }
> ]
>   }
> ]
>   }
> ]WARN  20:47:41,325 Small cdc volume detected at
> /var/lib/cassandra/cdc_raw; setting cdc_total_space_in_mb to 1278.  You can
> override this in cassandra.yaml
> [
>   {
> "partition" : {
>   "key" : [ "12345" ],
>   "position" : 18743072
> },
> "rows" : [
>   {
> "type" : "row",
> "position" : 18751808,
> "liveness_info" : { "tstamp" : "2017-10-25T10:22:41.612Z" },
> "cells" : [
>

Re: Cassandra upgrade from 2.1 to 3.0

2018-05-11 Thread kooljava2 
 After further analyzing the data. I see some pattern. The rows which were 
updated in last 2-3 weeks, the column which were not part of this update have 
the null values.  

Has anyone encountered this issue during the upgrade? 


Thank you,

On Thursday, 10 May 2018, 19:49:50 GMT-7, kooljava2 
 wrote:  
 
  Hello Jeff,
2.1.19 to 3.0.15.
Thank you. 

On Thursday, 10 May 2018, 17:43:58 GMT-7, Jeff Jirsa  
wrote:  
 
 Which minor version of 3.0

-- Jeff Jirsa

On May 11, 2018, at 2:54 AM, kooljava2  wrote:



Hello,

Upgraded Cassandra 2.1 to 3.0.  We see certain data in few columns being set to 
"null". These null columns were created during the row creation time.

After looking at the data see a pattern where update was done on these rows. 
Rows which were updated has data but rows which were not part of the update are 
set to null.

 created_on    | created_by  | id
-+-+-
    null |    null |    
12345



sstabledump:- 

WARN  20:47:38,741 Small cdc volume detected at /var/lib/cassandra/cdc_raw; 
setting cdc_total_space_in_mb to 1278.  You can override this in cassandra.yaml
[
  {
    "partition" : {
  "key" : [ "12345" ],
  "position" : 5155159
    },
    "rows" : [
  {
    "type" : "row",
    "position" : 5168738,
    "deletion_info" : { "marked_deleted" : "2018-03-28T20:38:08.05Z", 
"local_delete_time" : "2018-03-28T20:38:08Z" },
    "cells" : [
  { "name" : "doc_type", "value" : false, "tstamp" : 
"2018-03-28T20:38:08.060Z" },
  { "name" : "industry", "deletion_info" : { "local_delete_time" : 
"2018-03-28T20:38:08Z" },
    "tstamp" : "2018-03-28T20:38:08.060Z"
  },
  { "name" : "last_modified_by", "value" : "12345", "tstamp" : 
"2018-03-28T20:38:08.060Z" },
  { "name" : "last_modified_date", "value" : "2018-03-28 
20:38:08.059Z", "tstamp" : "2018-03-28T20:38:08.060Z" },
  { "name" : "locale", "deletion_info" : { "local_delete_time" : 
"2018-03-28T20:38:08Z" },
    "tstamp" : "2018-03-28T20:38:08.060Z"
  },
  { "name" : "postal_code", "deletion_info" : { "local_delete_time" : 
"2018-03-28T20:38:08Z" },
    "tstamp" : "2018-03-28T20:38:08.060Z"
  },
  { "name" : "ticket", "deletion_info" : { "marked_deleted" : 
"2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z" } },
  { "name" : "ticket", "path" : [ "TEMP_DATA" ], "value" : 
"{\"name\":\"TEMP_DATA\",\"ticket\":\"a42638dae8350e889f2603be1427ac6f5dec5e486d4db164a76bf80820cdf68d635cff5e7d555e6d4eabb9b5b82597b68bec0fcd735fcca\",\"lastRenewedDate\":\"2018-03-28T20:38:08Z\"}",
 "tstamp" : "2018-03-28T20:38:08.060Z" },
  { "name" : "ticket", "path" : [ "TEMP_TEMP2" ], "value" : 
"{\"name\":\"TEMP_TEMP2\",\"ticket\":\"a4263b7350d1f2683\",\"lastRenewedDate\":\"2018-03-28T20:38:07Z\"}",
 "tstamp" : "2018-03-28T20:38:08.060Z" },
  { "name" : "ppstatus_pf", "deletion_info" : { "marked_deleted" : 
"2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z" } },
  { "name" : "ppstatus_pers", "deletion_info" : { "marked_deleted" : 
"2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z" } }
    ]
  }
    ]
  }
]WARN  20:47:41,325 Small cdc volume detected at /var/lib/cassandra/cdc_raw; 
setting cdc_total_space_in_mb to 1278.  You can override this in cassandra.yaml
[
  {
    "partition" : {
  "key" : [ "12345" ],
  "position" : 18743072
    },
    "rows" : [
  {
    "type" : "row",
    "position" : 18751808,
    "liveness_info" : { "tstamp" : "2017-10-25T10:22:41.612Z" },
    "cells" : [
  { "name" : "created_by", "value" : "12345" },
  { "name" : "created_on", "value" : "2017-10-25 10:22:41.637Z" },
  { "name" : "doc_type", "value" : false, "tstamp" : 
"2017-10-25T10:22:42.487Z" },
  { "name" : "last_modified_by", "value" : "12345", "tstamp" : 
"2017-10-25T10:22:42.487Z" },
  { "name" : "last_modified_date", "value" : "2017-11-10 
00:09:52.668Z", "tstamp" : "2017-11-10T00:09:52.668Z" },
  { "name" : "per_type", "value" : "user" },
  { "name" : "lists", "path" : [ "cn.cncn.bpnp" ], "value" : 
"[\"::accid:ab\",\"::accid:e1\",\"::accid:d2\",\"::accid:d3\",\"::accid:f3\",\"::accid:g3\",\"::accid:f4\",\"::accid:9c486ae5-00b2-3c63-af70-cff2950c4181\"]",
 "tstamp" : "2017-10-25T10:22:42.782Z" },
  { "name" : "ticket", "path" : [ "TEMP_TEMP2" ], "value" :

Re: Cassandra upgrade from 2.1 to 3.0

2018-05-10 Thread kooljava2 
 Hello Jeff,
2.1.19 to 3.0.15.
Thank you. 

On Thursday, 10 May 2018, 17:43:58 GMT-7, Jeff Jirsa  
wrote:  
 
 Which minor version of 3.0

-- Jeff Jirsa

On May 11, 2018, at 2:54 AM, kooljava2  wrote:



Hello,

Upgraded Cassandra 2.1 to 3.0.  We see certain data in few columns being set to 
"null". These null columns were created during the row creation time.

After looking at the data see a pattern where update was done on these rows. 
Rows which were updated has data but rows which were not part of the update are 
set to null.

 created_on    | created_by  | id
-+-+-
    null |    null |    
12345



sstabledump:- 

WARN  20:47:38,741 Small cdc volume detected at /var/lib/cassandra/cdc_raw; 
setting cdc_total_space_in_mb to 1278.  You can override this in cassandra.yaml
[
  {
    "partition" : {
  "key" : [ "12345" ],
  "position" : 5155159
    },
    "rows" : [
  {
    "type" : "row",
    "position" : 5168738,
    "deletion_info" : { "marked_deleted" : "2018-03-28T20:38:08.05Z", 
"local_delete_time" : "2018-03-28T20:38:08Z" },
    "cells" : [
  { "name" : "doc_type", "value" : false, "tstamp" : 
"2018-03-28T20:38:08.060Z" },
  { "name" : "industry", "deletion_info" : { "local_delete_time" : 
"2018-03-28T20:38:08Z" },
    "tstamp" : "2018-03-28T20:38:08.060Z"
  },
  { "name" : "last_modified_by", "value" : "12345", "tstamp" : 
"2018-03-28T20:38:08.060Z" },
  { "name" : "last_modified_date", "value" : "2018-03-28 
20:38:08.059Z", "tstamp" : "2018-03-28T20:38:08.060Z" },
  { "name" : "locale", "deletion_info" : { "local_delete_time" : 
"2018-03-28T20:38:08Z" },
    "tstamp" : "2018-03-28T20:38:08.060Z"
  },
  { "name" : "postal_code", "deletion_info" : { "local_delete_time" : 
"2018-03-28T20:38:08Z" },
    "tstamp" : "2018-03-28T20:38:08.060Z"
  },
  { "name" : "ticket", "deletion_info" : { "marked_deleted" : 
"2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z" } },
  { "name" : "ticket", "path" : [ "TEMP_DATA" ], "value" : 
"{\"name\":\"TEMP_DATA\",\"ticket\":\"a42638dae8350e889f2603be1427ac6f5dec5e486d4db164a76bf80820cdf68d635cff5e7d555e6d4eabb9b5b82597b68bec0fcd735fcca\",\"lastRenewedDate\":\"2018-03-28T20:38:08Z\"}",
 "tstamp" : "2018-03-28T20:38:08.060Z" },
  { "name" : "ticket", "path" : [ "TEMP_TEMP2" ], "value" : 
"{\"name\":\"TEMP_TEMP2\",\"ticket\":\"a4263b7350d1f2683\",\"lastRenewedDate\":\"2018-03-28T20:38:07Z\"}",
 "tstamp" : "2018-03-28T20:38:08.060Z" },
  { "name" : "ppstatus_pf", "deletion_info" : { "marked_deleted" : 
"2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z" } },
  { "name" : "ppstatus_pers", "deletion_info" : { "marked_deleted" : 
"2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z" } }
    ]
  }
    ]
  }
]WARN  20:47:41,325 Small cdc volume detected at /var/lib/cassandra/cdc_raw; 
setting cdc_total_space_in_mb to 1278.  You can override this in cassandra.yaml
[
  {
    "partition" : {
  "key" : [ "12345" ],
  "position" : 18743072
    },
    "rows" : [
  {
    "type" : "row",
    "position" : 18751808,
    "liveness_info" : { "tstamp" : "2017-10-25T10:22:41.612Z" },
    "cells" : [
  { "name" : "created_by", "value" : "12345" },
  { "name" : "created_on", "value" : "2017-10-25 10:22:41.637Z" },
  { "name" : "doc_type", "value" : false, "tstamp" : 
"2017-10-25T10:22:42.487Z" },
  { "name" : "last_modified_by", "value" : "12345", "tstamp" : 
"2017-10-25T10:22:42.487Z" },
  { "name" : "last_modified_date", "value" : "2017-11-10 
00:09:52.668Z", "tstamp" : "2017-11-10T00:09:52.668Z" },
  { "name" : "per_type", "value" : "user" },
  { "name" : "lists", "path" : [ "cn.cncn.bpnp" ], "value" : 
"[\"::accid:ab\",\"::accid:e1\",\"::accid:d2\",\"::accid:d3\",\"::accid:f3\",\"::accid:g3\",\"::accid:f4\",\"::accid:9c486ae5-00b2-3c63-af70-cff2950c4181\"]",
 "tstamp" : "2017-10-25T10:22:42.782Z" },
  { "name" : "ticket", "path" : [ "TEMP_TEMP2" ], "value" : 
"{\"name\":\"TEMP_TEMP2\",\"ticket\":\"a4263820be49c3a222e0248532bcefc80c773194a804057561a97382e595b51f36bb46b8675589fc89dea4a5c0ceb944d63861b39d63c0067161e84c79328077c650df33530c7625857444711dc4b1051638123694ba6e9e29b1f906663f3\",\"lastRenewedDate\":\"2017-11-10T00:09:52Z\"}",
 "tstamp" : "2017-11-10T00:09:52.668Z" }
    ]
  }
    ]
  }
]

Re: Cassandra upgrade from 2.1 to 3.0

2018-05-10 Thread Jeff Jirsa 
Which minor version of 3.0

-- 
Jeff Jirsa


> On May 11, 2018, at 2:54 AM, kooljava2  wrote:
> 
> 
> Hello,
> 
> Upgraded Cassandra 2.1 to 3.0.  We see certain data in few columns being set 
> to "null". These null columns were created during the row creation time.
> 
> After looking at the data see a pattern where update was done on these rows. 
> Rows which were updated has data but rows which were not part of the update 
> are set to null.
> 
>  created_on| created_by  | id
> -+-+-
> null |null |  
>   12345
> 
> 
> 
> sstabledump:- 
> 
> WARN  20:47:38,741 Small cdc volume detected at /var/lib/cassandra/cdc_raw; 
> setting cdc_total_space_in_mb to 1278.  You can override this in 
> cassandra.yaml
> [
>   {
> "partition" : {
>   "key" : [ "12345" ],
>   "position" : 5155159
> },
> "rows" : [
>   {
> "type" : "row",
> "position" : 5168738,
> "deletion_info" : { "marked_deleted" : "2018-03-28T20:38:08.05Z", 
> "local_delete_time" : "2018-03-28T20:38:08Z" },
> "cells" : [
>   { "name" : "doc_type", "value" : false, "tstamp" : 
> "2018-03-28T20:38:08.060Z" },
>   { "name" : "industry", "deletion_info" : { "local_delete_time" : 
> "2018-03-28T20:38:08Z" },
> "tstamp" : "2018-03-28T20:38:08.060Z"
>   },
>   { "name" : "last_modified_by", "value" : "12345", "tstamp" : 
> "2018-03-28T20:38:08.060Z" },
>   { "name" : "last_modified_date", "value" : "2018-03-28 
> 20:38:08.059Z", "tstamp" : "2018-03-28T20:38:08.060Z" },
>   { "name" : "locale", "deletion_info" : { "local_delete_time" : 
> "2018-03-28T20:38:08Z" },
> "tstamp" : "2018-03-28T20:38:08.060Z"
>   },
>   { "name" : "postal_code", "deletion_info" : { "local_delete_time" : 
> "2018-03-28T20:38:08Z" },
> "tstamp" : "2018-03-28T20:38:08.060Z"
>   },
>   { "name" : "ticket", "deletion_info" : { "marked_deleted" : 
> "2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z" } 
> },
>   { "name" : "ticket", "path" : [ "TEMP_DATA" ], "value" : 
> "{\"name\":\"TEMP_DATA\",\"ticket\":\"a42638dae8350e889f2603be1427ac6f5dec5e486d4db164a76bf80820cdf68d635cff5e7d555e6d4eabb9b5b82597b68bec0fcd735fcca\",\"lastRenewedDate\":\"2018-03-28T20:38:08Z\"}",
>  "tstamp" : "2018-03-28T20:38:08.060Z" },
>   { "name" : "ticket", "path" : [ "TEMP_TEMP2" ], "value" : 
> "{\"name\":\"TEMP_TEMP2\",\"ticket\":\"a4263b7350d1f2683\",\"lastRenewedDate\":\"2018-03-28T20:38:07Z\"}",
>  "tstamp" : "2018-03-28T20:38:08.060Z" },
>   { "name" : "ppstatus_pf", "deletion_info" : { "marked_deleted" : 
> "2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z" } 
> },
>   { "name" : "ppstatus_pers", "deletion_info" : { "marked_deleted" : 
> "2018-03-28T20:38:08.05Z", "local_delete_time" : "2018-03-28T20:38:08Z" } 
> }
> ]
>   }
> ]
>   }
> ]WARN  20:47:41,325 Small cdc volume detected at /var/lib/cassandra/cdc_raw; 
> setting cdc_total_space_in_mb to 1278.  You can override this in 
> cassandra.yaml
> [
>   {
> "partition" : {
>   "key" : [ "12345" ],
>   "position" : 18743072
> },
> "rows" : [
>   {
> "type" : "row",
> "position" : 18751808,
> "liveness_info" : { "tstamp" : "2017-10-25T10:22:41.612Z" },
> "cells" : [
>   { "name" : "created_by", "value" : "12345" },
>   { "name" : "created_on", "value" : "2017-10-25 10:22:41.637Z" },
>   { "name" : "doc_type", "value" : false, "tstamp" : 
> "2017-10-25T10:22:42.487Z" },
>   { "name" : "last_modified_by", "value" : "12345", "tstamp" : 
> "2017-10-25T10:22:42.487Z" },
>   { "name" : "last_modified_date", "value" : "2017-11-10 
> 00:09:52.668Z", "tstamp" : "2017-11-10T00:09:52.668Z" },
>   { "name" : "per_type", "value" : "user" },
>   { "name" : "lists", "path" : [ "cn.cncn.bpnp" ], "value" : 
> "[\"::accid:ab\",\"::accid:e1\",\"::accid:d2\",\"::accid:d3\",\"::accid:f3\",\"::accid:g3\",\"::accid:f4\",\"::accid:9c486ae5-00b2-3c63-af70-cff2950c4181\"]",
>  "tstamp" : "2017-10-25T10:22:42.782Z" },
>   { "name" : "ticket", "path" : [ "TEMP_TEMP2" ], "value" : 
> "{\"name\":\"TEMP_TEMP2\",\"ticket\":\"a4263820be49c3a222e0248532bcefc80c773194a804057561a97382e595b51f36bb46b8675589fc89dea4a5c0ceb944d63861b39d63c0067161e84c79328077c650df33530c7625857444711dc4b1051638123694ba6e9e29b1f906663f3\",\"lastRenewedDate\":\"2017-11-10T00:09:52Z\"}",
>  "tstamp" : "2017-11-10T00:09:52.668Z" }
> ]
>   }
> ]
>   }
> ]