Hi all,
Today, after updating an AIO instance to the latest release
("release-75"), Cassandra was refusing to start with the following error:
******
INFO [main] 2015-07-06 11:42:41,480 YamlConfigurationLoader.java (line
80) Loading settings from file:/etc/cassandra/cassandra.yaml
ERROR [main] 2015-07-06 11:42:41,515 CassandraDaemon.java (line 441)
Fatal configuration error
org.apache.cassandra.exceptions.ConfigurationException: Cannot change
the number of tokens from 1 to 256
at
org.apache.cassandra.service.StorageService.joinTokenRing(StorageService.java:836)
at
org.apache.cassandra.service.StorageService.initServer(StorageService.java:621)
at
org.apache.cassandra.service.StorageService.initServer(StorageService.java:510)
at
org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:437)
at
org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:567)
at
org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:656)
******
I was able to fix this by commenting the line "num_tokens=256" in the
"cassandra.yaml" file (as suggested here:
http://stackoverflow.com/questions/29583586/is-it-possible-to-shut-down-cassandra-cluster-and-restart-it-back-without-loosin).
After this, the AIO instance restarted correctly but I'm unable to
register any SIP client as Sprout is returning "500 Internal Server
Error" due to this (complete log attached):
******
06-07-2015 10:59:50.541 UTC Debug authentication.cpp:454: Sending
{"impi": "[email protected]", "impu": "sip:[email protected]",
"nonce": "754803617f7e1427"} to Chronos to set AV timer
Signal 11 caught
Basic stack dump:
/usr/share/clearwater/bin/sprout(_ZN6Logger9backtraceEPKc+0x6d)[0x4b33bd]
/usr/share/clearwater/bin/sprout(_ZN3Log9backtraceEPKcz+0x10d)[0x57987d]
/usr/share/clearwater/bin/sprout(_Z14signal_handleri+0x2c)[0x5d008c]
/lib/x86_64-linux-gnu/libc.so.6(+0x36150)[0x7f5b92dc5150]
/usr/share/clearwater/bin/sprout(_Z16create_challengeP23pjsip_authorization_hdriSsP13pjsip_rx_dataP13pjsip_tx_data+0x13c8)[0x4f5838]
/usr/share/clearwater/bin/sprout[0x4f7372]
/usr/share/clearwater/bin/sprout(pjsip_endpt_process_rx_data+0x1f6)[0x63a973]
/usr/share/clearwater/bin/sprout[0x5c4d5b]
/usr/share/clearwater/bin/sprout[0x6b5dec]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a)[0x7f5b93967e9a]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f5b92e828bd]
Advanced stack dump (requires gdb):
sh: 1: /usr/bin/gdb: not found
gdb failed with return code 32512
******
Can you help me figure out how make this work again?
Thanks in advance,
Nuno Campos
WIT Software| Senior Software Engineer
This email was sent under WIT Software's Confidentiality Policy
<https://www.wit-software.com/confidentiality-policy/>
06-07-2015 10:59:50.502 UTC Debug pjsip: sip_endpoint.c Processing incoming message: Request msg REGISTER/cseq=50598 (rdata0x7f5b7c0243b0)
06-07-2015 10:59:50.502 UTC Verbose common_sip_processing.cpp:120: RX 875 bytes Request msg REGISTER/cseq=50598 (rdata0x7f5b7c0243b0) from TCP 10.39.40.30:49687:
--start msg--
REGISTER sip:example.com SIP/2.0
Via: SIP/2.0/TCP 10.39.40.30:49687;rport;branch=z9hG4bKPjfRqcHAWP2xqRWamOP4wd7JFlmbrc-3bI
Path: <sip:[email protected]:5058;transport=TCP;lr;ob>
Via: SIP/2.0/TCP 172.22.0.106:65217;rport=65217;received=172.22.0.106;branch=z9hG4bKPj7f67b6922e9d4e76af494189211a4eaf
Max-Forwards: 70
From: <sip:[email protected]>;tag=0331be8722a24be9b0d37532e87f1d18
To: <sip:[email protected]>
Call-ID: f96a2462d6d94ab6b9b6e0986a9eabdc
CSeq: 50598 REGISTER
User-Agent: IM-client/OMA1.0 RCSe PC Communicator/3.2.24.13915
Contact: <sip:[email protected]:5060;transport=TCP>;audio;video;+g.3gpp.cs-voice;+g.oma.sip-im;+g.3gpp.iari-ref="urn%3Aurn-7%3A3gpp-application.ims.iari.gsma-is"
Expires: 600
P-Visited-Network-ID: example.com
Session-Expires: 600
Route: <sip:10.39.40.30:5054;transport=TCP;lr;orig>
Content-Length: 0
--end msg--
06-07-2015 10:59:50.502 UTC Debug statistic.cpp:103: Send new value for statistic incoming_requests, size 1
06-07-2015 10:59:50.502 UTC Debug zmq_lvc.cpp:172: Update to incoming_requests statistic
06-07-2015 10:59:50.502 UTC Debug zmq_lvc.cpp:256: Clearing message cache for 0x7f5b8002a270
06-07-2015 10:59:50.502 UTC Debug thread_dispatcher.cpp:236: Queuing cloned received message 0x7f5b7c03ef68 for worker threads
06-07-2015 10:59:50.502 UTC Debug statistic.cpp:103: Send new value for statistic queue_size, size 5
06-07-2015 10:59:50.502 UTC Debug zmq_lvc.cpp:172: Update to queue_size statistic
06-07-2015 10:59:50.502 UTC Debug zmq_lvc.cpp:256: Clearing message cache for 0x7f5b800335b0
06-07-2015 10:59:50.502 UTC Debug thread_dispatcher.cpp:149: Worker thread dequeue message 0x7f5b7c03ef68
06-07-2015 10:59:50.502 UTC Debug pjsip: sip_endpoint.c Distributing rdata to modules: Request msg REGISTER/cseq=50598 (rdata0x7f5b7c03ef68)
06-07-2015 10:59:50.503 UTC Debug acr.cpp:49: Created ACR (0x7f5b7000a070)
06-07-2015 10:59:50.503 UTC Debug authentication.cpp:730: No authentication information in request or stale nonce, so reject with challenge
06-07-2015 10:59:50.503 UTC Debug pjsip: endpoint Response msg 401/REGISTER/cseq=50598 (tdta0x7f5b70007360) created
06-07-2015 10:59:50.503 UTC Debug pjutils.cpp:470: Private identity defaulted from public identity = [email protected]
06-07-2015 10:59:50.503 UTC Debug httpconnection.cpp:191: Allocated CURL handle 0x7f5b7002c9c0
06-07-2015 10:59:50.504 UTC Debug httpresolver.cpp:71: HttpResolver::resolve for host 10.39.40.30, port 8888, family 2
06-07-2015 10:59:50.504 UTC Debug baseresolver.cpp:503: Attempt to parse 10.39.40.30 as IP address
06-07-2015 10:59:50.504 UTC Debug httpresolver.cpp:79: Target is an IP address
06-07-2015 10:59:50.504 UTC Debug httpconnection.cpp:614: Sending HTTP request : http://10.39.40.30:8888/impi/6505550728%40example.com/av?impu=sip%3A6505550728%40example.com (trying 10.39.40.30) on new connection
06-07-2015 10:59:50.539 UTC Debug httpconnection.cpp:629: Received HTTP response: status=200, doc={"digest":{"ha1":"f5724972c9abd2cfce0cab7a34386613","realm":"example.com","qop":"auth"}}
06-07-2015 10:59:50.540 UTC Debug statistic.cpp:103: Send new value for statistic connected_homesteads, size 2
06-07-2015 10:59:50.540 UTC Debug zmq_lvc.cpp:172: Update to connected_homesteads statistic
06-07-2015 10:59:50.540 UTC Debug zmq_lvc.cpp:256: Clearing message cache for 0x7f5b80009cb0
06-07-2015 10:59:50.540 UTC Debug statistic.cpp:103: Send new value for statistic hss_latency_us, size 5
06-07-2015 10:59:50.540 UTC Debug zmq_lvc.cpp:172: Update to hss_latency_us statistic
06-07-2015 10:59:50.540 UTC Debug zmq_lvc.cpp:256: Clearing message cache for 0x7f5b80017980
06-07-2015 10:59:50.540 UTC Debug statistic.cpp:103: Send new value for statistic hss_digest_latency_us, size 5
06-07-2015 10:59:50.540 UTC Debug zmq_lvc.cpp:172: Update to hss_digest_latency_us statistic
06-07-2015 10:59:50.540 UTC Debug zmq_lvc.cpp:256: Clearing message cache for 0x7f5b8001c320
06-07-2015 10:59:50.540 UTC Debug authentication.cpp:124: Verifying AV: {"digest":{"ha1":"f5724972c9abd2cfce0cab7a34386613","realm":"example.com","qop":"auth"}}
06-07-2015 10:59:50.540 UTC Debug authentication.cpp:151: Digest specified
06-07-2015 10:59:50.540 UTC Debug authentication.cpp:334: Valid AV - generate challenge
06-07-2015 10:59:50.540 UTC Debug authentication.cpp:340: Create WWW-Authenticate header
06-07-2015 10:59:50.540 UTC Debug authentication.cpp:402: Add Digest information
06-07-2015 10:59:50.540 UTC Debug authentication.cpp:444: Write AV to store
06-07-2015 10:59:50.540 UTC Debug avstore.cpp:72: Set AV for [email protected]\754803617f7e1427
{"digest":{"ha1":"f5724972c9abd2cfce0cab7a34386613","realm":"example.com","qop":"auth"},"branch":"z9hG4bKPjfRqcHAWP2xqRWamOP4wd7JFlmbrc-3bI"}
06-07-2015 10:59:50.540 UTC Debug memcachedstore.cpp:542: Writing 141 bytes to table av key [email protected]\754803617f7e1427, CAS = 0, expiry = 40
06-07-2015 10:59:50.540 UTC Debug memcachedstore.cpp:195: Key av\\[email protected]\754803617f7e1427 hashes to vbucket 40 via hash 0x85d99528
06-07-2015 10:59:50.540 UTC Debug memcachedstore.cpp:236: Set up new view 1 for thread
06-07-2015 10:59:50.540 UTC Debug memcachedstore.cpp:243: Setting up server 0 for connection 0x7f5b700968b0 (--CONNECT-TIMEOUT=10 --SUPPORT-CAS --POLL-TIMEOUT=250 --BINARY-PROTOCOL)
06-07-2015 10:59:50.540 UTC Debug memcachedstore.cpp:245: Set up connection 0x7f5b70096920 to server 10.39.40.30:11211
06-07-2015 10:59:50.540 UTC Debug memcachedstore.cpp:256: Setting server to IP address 10.39.40.30 port 11211
06-07-2015 10:59:50.541 UTC Debug memcachedstore.cpp:562: 1 write replicas for key av\\[email protected]\754803617f7e1427
06-07-2015 10:59:50.541 UTC Debug memcachedstore.cpp:616: Attempt conditional write to vbucket 40 on replica 0 (connection 0x7f5b70096920), CAS = 0, expiry = 40
06-07-2015 10:59:50.541 UTC Debug memcachedstore.cpp:816: Attempting to add data for key av\\[email protected]\754803617f7e1427
06-07-2015 10:59:50.541 UTC Debug memcachedstore.cpp:826: Attempting memcached ADD command
06-07-2015 10:59:50.541 UTC Debug memcachedstore.cpp:916: ADD/CAS returned rc = 0 (SUCCESS)
SUCCESS
06-07-2015 10:59:50.541 UTC Debug memcachedstore.cpp:657: Conditional write succeeded to replica 0
06-07-2015 10:59:50.541 UTC Debug authentication.cpp:454: Sending {"impi": "[email protected]", "impu": "sip:[email protected]", "nonce": "754803617f7e1427"} to Chronos to set AV timer
Signal 11 caught
Basic stack dump:
/usr/share/clearwater/bin/sprout(_ZN6Logger9backtraceEPKc+0x6d)[0x4b33bd]
/usr/share/clearwater/bin/sprout(_ZN3Log9backtraceEPKcz+0x10d)[0x57987d]
/usr/share/clearwater/bin/sprout(_Z14signal_handleri+0x2c)[0x5d008c]
/lib/x86_64-linux-gnu/libc.so.6(+0x36150)[0x7f5b92dc5150]
/usr/share/clearwater/bin/sprout(_Z16create_challengeP23pjsip_authorization_hdriSsP13pjsip_rx_dataP13pjsip_tx_data+0x13c8)[0x4f5838]
/usr/share/clearwater/bin/sprout[0x4f7372]
/usr/share/clearwater/bin/sprout(pjsip_endpt_process_rx_data+0x1f6)[0x63a973]
/usr/share/clearwater/bin/sprout[0x5c4d5b]
/usr/share/clearwater/bin/sprout[0x6b5dec]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a)[0x7f5b93967e9a]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d)[0x7f5b92e828bd]
Advanced stack dump (requires gdb):
sh: 1: /usr/bin/gdb: not found
gdb failed with return code 32512
06-07-2015 10:59:50.636 UTC Debug pjsip: endpoint Response msg 500/REGISTER/cseq=50598 (tdta0x7f5b7009e6c0) created
06-07-2015 10:59:50.636 UTC Verbose common_sip_processing.cpp:136: TX 531 bytes Response msg 500/REGISTER/cseq=50598 (tdta0x7f5b7009e6c0) to TCP 10.39.40.30:49687:
--start msg--
SIP/2.0 500 Internal Server Error
Via: SIP/2.0/TCP 10.39.40.30:49687;rport=49687;received=10.39.40.30;branch=z9hG4bKPjfRqcHAWP2xqRWamOP4wd7JFlmbrc-3bI
Via: SIP/2.0/TCP 172.22.0.106:65217;rport=65217;received=172.22.0.106;branch=z9hG4bKPj7f67b6922e9d4e76af494189211a4eaf
Call-ID: f96a2462d6d94ab6b9b6e0986a9eabdc
From: <sip:[email protected]>;tag=0331be8722a24be9b0d37532e87f1d18
To: <sip:[email protected]>;tag=z9hG4bKPjfRqcHAWP2xqRWamOP4wd7JFlmbrc-3bI
CSeq: 50598 REGISTER
Retry-After: 600
Content-Length: 0
--end msg--
06-07-2015 10:59:50.637 UTC Debug pjsip: tdta0x7f5b7009 Destroying txdata Response msg 500/REGISTER/cseq=50598 (tdta0x7f5b7009e6c0)
06-07-2015 10:59:50.637 UTC Debug statistic.cpp:103: Send new value for statistic connected_homesteads, size 0
06-07-2015 10:59:50.637 UTC Debug zmq_lvc.cpp:172: Update to connected_homesteads statistic
06-07-2015 10:59:50.637 UTC Debug zmq_lvc.cpp:256: Clearing message cache for 0x7f5b80009cb0
_______________________________________________
Clearwater mailing list
[email protected]
http://lists.projectclearwater.org/listinfo/clearwater
