Dear Fiachra, Here are the dmaap-dr-db logs. In the logs: IP address '10.42.0.1' could not be resolved: Name or service not known
However kube-dns is working. Does it can be the reason of my problem? How can i fix it ? Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 11m default-scheduler Successfully assigned onap/dev1-dmaap-dmaap-dr-db-5b55bbf486-l9rx8 to kub1 Warning FailedCreatePodSandBox 11m kubelet, kub1 Failed create pod sandbox: rpc error: code = Unknown desc = [failed to set up sandbox container "d323889ffc2fdc40881779dce5827b50748c8f4e76af7a08d18960e460662820" network for pod "dev1-dmaap-dmaap-dr-db-5b55bbf486-l9rx8": NetworkPlugin cni failed to set up pod "dev1-dmaap-dmaap-dr-db-5b55bbf486-l9rx8_onap" network: No MAC address found, failed to clean up sandbox container "d323889ffc2fdc40881779dce5827b50748c8f4e76af7a08d18960e460662820" network for pod "dev1-dmaap-dmaap-dr-db-5b55bbf486-l9rx8": NetworkPlugin cni failed to teardown pod "dev1-dmaap-dmaap-dr-db-5b55bbf486-l9rx8_onap" network: failed to get IP addresses for "eth0": <nil>] Normal SandboxChanged 11m kubelet, kub1 Pod sandbox changed, it will be killed and re-created. Normal Pulling 10m kubelet, kub1 pulling image "nexus3.onap.org:10001/mariadb:10.2.14" Normal Pulled 10m kubelet, kub1 Successfully pulled image "nexus3.onap.org:10001/mariadb:10.2.14" Normal Created 10m kubelet, kub1 Created container Normal Started 10m kubelet, kub1 Started container ubuntu@kub1:~$ kubectl logs -f dev1-dmaap-dmaap-dr-db-5b55bbf486-l9rx8 -n onap 2018-12-18 7:31:26 140063251330944 [Note] mysqld (mysqld 10.2.14-MariaDB-10.2.14+maria~jessie-log) starting as process 1 ... 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Read nil XID from storage engines, skipping position init 2018-12-18 7:31:26 140063251330944 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' 2018-12-18 7:31:26 140063251330944 [Note] WSREP: wsrep_load(): Galera 25.3.23(r3789) by Codership Oy <[email protected]> loaded successfully. 2018-12-18 7:31:26 140063251330944 [Note] WSREP: CRC-32C: using hardware acceleration. 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Found saved state: 007eb283-ffb7-11e8-8d9e-b2eaa813ec64:0, safe_to_bootstrap: 1 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.42.68.192; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 1G; gcache.recover = no; gcache.size = 1G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignor 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Assign initial position for certification: 0, protocol version: -1 2018-12-18 7:31:26 140063251330944 [Note] WSREP: wsrep_sst_grab() 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Start replication 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Setting initial position to 007eb283-ffb7-11e8-8d9e-b2eaa813ec64:0 2018-12-18 7:31:26 140063251330944 [Note] WSREP: protonet asio version 0 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Using CRC-32C for message checksums. 2018-12-18 7:31:26 140063251330944 [Note] WSREP: backend: asio 2018-12-18 7:31:26 140063251330944 [Note] WSREP: gcomm thread scheduling priority set to other:0 2018-12-18 7:31:26 140063251330944 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) 2018-12-18 7:31:26 140063251330944 [Note] WSREP: restore pc from disk failed 2018-12-18 7:31:26 140063251330944 [Note] WSREP: GMCast version 0 2018-12-18 7:31:26 140063251330944 [Note] WSREP: (edcb71b3, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 2018-12-18 7:31:26 140063251330944 [Note] WSREP: (edcb71b3, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 2018-12-18 7:31:26 140063251330944 [Note] WSREP: EVS version 0 2018-12-18 7:31:26 140063251330944 [Note] WSREP: gcomm: connecting to group 'MSO-automated-tests-cluster', peer '' 2018-12-18 7:31:26 140063251330944 [Note] WSREP: start_prim is enabled, turn off pc_recovery 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Node edcb71b3 state prim 2018-12-18 7:31:26 140063251330944 [Note] WSREP: view(view_id(PRIM,edcb71b3,1) memb { edcb71b3,0 } joined { } left { } partitioned { }) 2018-12-18 7:31:26 140063251330944 [Note] WSREP: save pc into disk 2018-12-18 7:31:26 140063251330944 [Note] WSREP: gcomm: connected 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Opened channel 'MSO-automated-tests-cluster' 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Waiting for SST to complete. 2018-12-18 7:31:26 140063122654976 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 2018-12-18 7:31:26 140063122654976 [Note] WSREP: STATE_EXCHANGE: sent state UUID: edcd1a0b-0296-11e9-981c-4e404a2df58b 2018-12-18 7:31:26 140063122654976 [Note] WSREP: STATE EXCHANGE: sent state msg: edcd1a0b-0296-11e9-981c-4e404a2df58b 2018-12-18 7:31:26 140063122654976 [Note] WSREP: STATE EXCHANGE: got state msg: edcd1a0b-0296-11e9-981c-4e404a2df58b from 0 (mariadb1) 2018-12-18 7:31:26 140063122654976 [Note] WSREP: Quorum results: version = 4, component = PRIMARY, conf_id = 0, members = 1/1 (joined/total), act_id = 0, last_appl. = -1, protocols = 0/8/3 (gcs/repl/appl), group UUID = 007eb283-ffb7-11e8-8d9e-b2eaa813ec64 2018-12-18 7:31:26 140063122654976 [Note] WSREP: Flow-control interval: [16, 16] 2018-12-18 7:31:26 140063122654976 [Note] WSREP: Trying to continue unpaused monitor 2018-12-18 7:31:26 140063122654976 [Note] WSREP: Restored state OPEN -> JOINED (0) 2018-12-18 7:31:26 140063122654976 [Note] WSREP: Member 0.0 (mariadb1) synced with group. 2018-12-18 7:31:26 140063122654976 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 0) 2018-12-18 7:31:26 140063249602304 [Note] WSREP: New cluster view: global state: 007eb283-ffb7-11e8-8d9e-b2eaa813ec64:0, view# 1: Primary, number of nodes: 1, my index: 0, protocol version 3 2018-12-18 7:31:27 140063251330944 [Note] WSREP: SST complete, seqno: 0 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: For Galera, using innodb_lock_schedule_algorithm=fcfs 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Uses event mutexes 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Compressed tables use zlib 1.2.8 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Using Linux native AIO 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Number of pools: 1 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Using SSE2 crc32 instructions 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Initializing buffer pool, total size = 256M, instances = 1, chunk size = 128M 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Completed initialization of buffer pool 2018-12-18 7:31:27 140061275969280 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2018-12-18 7:31:28 140063251330944 [Note] InnoDB: Highest supported file format is Barracuda. 2018-12-18 7:31:31 140063251330944 [Note] InnoDB: 128 out of 128 rollback segments are active. 2018-12-18 7:31:31 140063251330944 [Note] InnoDB: Creating shared tablespace for temporary tables 2018-12-18 7:31:31 140063251330944 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2018-12-18 7:31:31 140063251330944 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2018-12-18 7:31:31 140063251330944 [Note] InnoDB: Waiting for purge to start 2018-12-18 7:31:31 140063251330944 [Note] InnoDB: 5.7.21 started; log sequence number 1878210 2018-12-18 7:31:31 140061114865408 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2018-12-18 7:31:31 140063251330944 [Note] Plugin 'FEEDBACK' is disabled. 181218 7:31:31 server_audit: MariaDB Audit Plugin version 1.4.3 STARTED. 181218 7:31:31 server_audit: logging started to the file //var/lib/mysql/audit.log. 2018-12-18 7:31:32 140063251330944 [Note] Server socket created on IP: '::'. 2018-12-18 7:31:32 140063249602304 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2018-12-18 7:31:32 140063249602304 [Note] WSREP: REPL Protocols: 8 (3, 2) 2018-12-18 7:31:32 140063249602304 [Note] WSREP: Assign initial position for certification: 0, protocol version: 3 2018-12-18 7:31:32 140063164618496 [Note] WSREP: Service thread queue flushed. 2018-12-18 7:31:32 140063249602304 [Note] WSREP: Synchronized with group, ready for connections 2018-12-18 7:31:32 140063249602304 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2018-12-18 7:31:32 140063251330944 [Note] Reading of all Master_info entries succeded 2018-12-18 7:31:32 140063251330944 [Note] Added new Master_info '' to hash table 2018-12-18 7:31:32 140063251330944 [Note] mysqld: ready for connections. Version: '10.2.14-MariaDB-10.2.14+maria~jessie-log' socket: '/var/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution 2018-12-18 7:31:32 140061114865408 [Note] InnoDB: Buffer pool(s) load completed at 181218 7:31:32 2018-12-18 7:36:26 140061919086336 [Warning] IP address '10.42.0.1' could not be resolved: Name or service not known ubuntu@kub1:~$ kubectl logs -f dev1-dmaap-dmaap-dr-db-5b55bbf486-l9rx8 -n onap 2018-12-18 7:31:26 140063251330944 [Note] mysqld (mysqld 10.2.14-MariaDB-10.2.14+maria~jessie-log) starting as process 1 ... 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Read nil XID from storage engines, skipping position init 2018-12-18 7:31:26 140063251330944 [Note] WSREP: wsrep_load(): loading provider library '/usr/lib/galera/libgalera_smm.so' 2018-12-18 7:31:26 140063251330944 [Note] WSREP: wsrep_load(): Galera 25.3.23(r3789) by Codership Oy <[email protected]> loaded successfully. 2018-12-18 7:31:26 140063251330944 [Note] WSREP: CRC-32C: using hardware acceleration. 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Found saved state: 007eb283-ffb7-11e8-8d9e-b2eaa813ec64:0, safe_to_bootstrap: 1 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Passing config to GCS: base_dir = /var/lib/mysql/; base_host = 10.42.68.192; base_port = 4567; cert.log_conflicts = no; debug = no; evs.auto_evict = 0; evs.delay_margin = PT1S; evs.delayed_keep_period = PT30S; evs.inactive_check_period = PT0.5S; evs.inactive_timeout = PT15S; evs.join_retrans_period = PT1S; evs.max_install_timeouts = 3; evs.send_window = 4; evs.stats_report_period = PT1M; evs.suspect_timeout = PT5S; evs.user_send_window = 2; evs.view_forget_timeout = PT24H; gcache.dir = /var/lib/mysql/; gcache.keep_pages_size = 0; gcache.mem_size = 0; gcache.name = /var/lib/mysql//galera.cache; gcache.page_size = 1G; gcache.recover = no; gcache.size = 1G; gcomm.thread_prio = ; gcs.fc_debug = 0; gcs.fc_factor = 1.0; gcs.fc_limit = 16; gcs.fc_master_slave = no; gcs.max_packet_size = 64500; gcs.max_throttle = 0.25; gcs.recv_q_hard_limit = 9223372036854775807; gcs.recv_q_soft_limit = 0.25; gcs.sync_donor = no; gmcast.segment = 0; gmcast.version = 0; pc.announce_timeout = PT3S; pc.checksum = false; pc.ignor 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Assign initial position for certification: 0, protocol version: -1 2018-12-18 7:31:26 140063251330944 [Note] WSREP: wsrep_sst_grab() 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Start replication 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Setting initial position to 007eb283-ffb7-11e8-8d9e-b2eaa813ec64:0 2018-12-18 7:31:26 140063251330944 [Note] WSREP: protonet asio version 0 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Using CRC-32C for message checksums. 2018-12-18 7:31:26 140063251330944 [Note] WSREP: backend: asio 2018-12-18 7:31:26 140063251330944 [Note] WSREP: gcomm thread scheduling priority set to other:0 2018-12-18 7:31:26 140063251330944 [Warning] WSREP: access file(/var/lib/mysql//gvwstate.dat) failed(No such file or directory) 2018-12-18 7:31:26 140063251330944 [Note] WSREP: restore pc from disk failed 2018-12-18 7:31:26 140063251330944 [Note] WSREP: GMCast version 0 2018-12-18 7:31:26 140063251330944 [Note] WSREP: (edcb71b3, 'tcp://0.0.0.0:4567') listening at tcp://0.0.0.0:4567 2018-12-18 7:31:26 140063251330944 [Note] WSREP: (edcb71b3, 'tcp://0.0.0.0:4567') multicast: , ttl: 1 2018-12-18 7:31:26 140063251330944 [Note] WSREP: EVS version 0 2018-12-18 7:31:26 140063251330944 [Note] WSREP: gcomm: connecting to group 'MSO-automated-tests-cluster', peer '' 2018-12-18 7:31:26 140063251330944 [Note] WSREP: start_prim is enabled, turn off pc_recovery 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Node edcb71b3 state prim 2018-12-18 7:31:26 140063251330944 [Note] WSREP: view(view_id(PRIM,edcb71b3,1) memb { edcb71b3,0 } joined { } left { } partitioned { }) 2018-12-18 7:31:26 140063251330944 [Note] WSREP: save pc into disk 2018-12-18 7:31:26 140063251330944 [Note] WSREP: gcomm: connected 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Changing maximum packet size to 64500, resulting msg size: 32636 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Shifting CLOSED -> OPEN (TO: 0) 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Opened channel 'MSO-automated-tests-cluster' 2018-12-18 7:31:26 140063251330944 [Note] WSREP: Waiting for SST to complete. 2018-12-18 7:31:26 140063122654976 [Note] WSREP: New COMPONENT: primary = yes, bootstrap = no, my_idx = 0, memb_num = 1 2018-12-18 7:31:26 140063122654976 [Note] WSREP: STATE_EXCHANGE: sent state UUID: edcd1a0b-0296-11e9-981c-4e404a2df58b 2018-12-18 7:31:26 140063122654976 [Note] WSREP: STATE EXCHANGE: sent state msg: edcd1a0b-0296-11e9-981c-4e404a2df58b 2018-12-18 7:31:26 140063122654976 [Note] WSREP: STATE EXCHANGE: got state msg: edcd1a0b-0296-11e9-981c-4e404a2df58b from 0 (mariadb1) 2018-12-18 7:31:26 140063122654976 [Note] WSREP: Quorum results: version = 4, component = PRIMARY, conf_id = 0, members = 1/1 (joined/total), act_id = 0, last_appl. = -1, protocols = 0/8/3 (gcs/repl/appl), group UUID = 007eb283-ffb7-11e8-8d9e-b2eaa813ec64 2018-12-18 7:31:26 140063122654976 [Note] WSREP: Flow-control interval: [16, 16] 2018-12-18 7:31:26 140063122654976 [Note] WSREP: Trying to continue unpaused monitor 2018-12-18 7:31:26 140063122654976 [Note] WSREP: Restored state OPEN -> JOINED (0) 2018-12-18 7:31:26 140063122654976 [Note] WSREP: Member 0.0 (mariadb1) synced with group. 2018-12-18 7:31:26 140063122654976 [Note] WSREP: Shifting JOINED -> SYNCED (TO: 0) 2018-12-18 7:31:26 140063249602304 [Note] WSREP: New cluster view: global state: 007eb283-ffb7-11e8-8d9e-b2eaa813ec64:0, view# 1: Primary, number of nodes: 1, my index: 0, protocol version 3 2018-12-18 7:31:27 140063251330944 [Note] WSREP: SST complete, seqno: 0 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: For Galera, using innodb_lock_schedule_algorithm=fcfs 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Uses event mutexes 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Compressed tables use zlib 1.2.8 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Using Linux native AIO 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Number of pools: 1 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Using SSE2 crc32 instructions 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Initializing buffer pool, total size = 256M, instances = 1, chunk size = 128M 2018-12-18 7:31:27 140063251330944 [Note] InnoDB: Completed initialization of buffer pool 2018-12-18 7:31:27 140061275969280 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority(). 2018-12-18 7:31:28 140063251330944 [Note] InnoDB: Highest supported file format is Barracuda. 2018-12-18 7:31:31 140063251330944 [Note] InnoDB: 128 out of 128 rollback segments are active. 2018-12-18 7:31:31 140063251330944 [Note] InnoDB: Creating shared tablespace for temporary tables 2018-12-18 7:31:31 140063251330944 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ... 2018-12-18 7:31:31 140063251330944 [Note] InnoDB: File './ibtmp1' size is now 12 MB. 2018-12-18 7:31:31 140063251330944 [Note] InnoDB: Waiting for purge to start 2018-12-18 7:31:31 140063251330944 [Note] InnoDB: 5.7.21 started; log sequence number 1878210 2018-12-18 7:31:31 140061114865408 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool 2018-12-18 7:31:31 140063251330944 [Note] Plugin 'FEEDBACK' is disabled. 181218 7:31:31 server_audit: MariaDB Audit Plugin version 1.4.3 STARTED. 181218 7:31:31 server_audit: logging started to the file //var/lib/mysql/audit.log. 2018-12-18 7:31:32 140063251330944 [Note] Server socket created on IP: '::'. 2018-12-18 7:31:32 140063249602304 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2018-12-18 7:31:32 140063249602304 [Note] WSREP: REPL Protocols: 8 (3, 2) 2018-12-18 7:31:32 140063249602304 [Note] WSREP: Assign initial position for certification: 0, protocol version: 3 2018-12-18 7:31:32 140063164618496 [Note] WSREP: Service thread queue flushed. 2018-12-18 7:31:32 140063249602304 [Note] WSREP: Synchronized with group, ready for connections 2018-12-18 7:31:32 140063249602304 [Note] WSREP: wsrep_notify_cmd is not defined, skipping notification. 2018-12-18 7:31:32 140063251330944 [Note] Reading of all Master_info entries succeded 2018-12-18 7:31:32 140063251330944 [Note] Added new Master_info '' to hash table 2018-12-18 7:31:32 140063251330944 [Note] mysqld: ready for connections. Version: '10.2.14-MariaDB-10.2.14+maria~jessie-log' socket: '/var/run/mysqld/mysqld.sock' port: 3306 mariadb.org binary distribution 2018-12-18 7:31:32 140061114865408 [Note] InnoDB: Buffer pool(s) load completed at 181218 7:31:32 2018-12-18 7:36:26 140061919086336 [Warning] IP address '10.42.0.1' could not be resolved: Name or service not known -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#14566): https://lists.onap.org/g/onap-discuss/message/14566 Mute This Topic: https://lists.onap.org/mt/27483391/21656 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
