A port forward rule operation spent:
not optimized 5min
optimized 3min
optmized+cProfile 8min
top 30 :
Fri Aug 19 11:27:50 2016 d:\temp\py_pro.data
614887355 function calls (614884838 primitive calls) in 548.846 seconds
Ordered by: cumulative time
List reduced from 404 to 30 due to restriction <30>
ncalls tottime percall cumtime percall filename:lineno(function)
1 0.000 0.000 548.846 548.846 <string>:1(<module>)
1 0.000 0.000 548.846 548.846 update_config.py:114(mainp)
1 0.000 0.000 548.846 548.846 update_config.py:50(process_file)
1 0.001 0.001 548.837 548.837 update_config.py:44(finish_config)
1 0.000 0.000 548.836 548.836 configure.py:903(main)
1 0.000 0.000 546.228 546.228 configure.py:717(process)
1088 53.936 0.050 536.665 0.493 CsAddress.py:145(ip_in_subnet)
16 0.000 0.000 364.540 22.784
configure.py:766(processForwardRule)
16 0.001 0.000 364.540 22.784 configure.py:772(forward_vr)
32 5.869 0.183 351.378 10.981 configure.py:747(getNetworkByIp)
68170816 65.435 0.000 342.427 0.000 __init__.py:1682(iter_iprange)
68177344 182.925 0.000 277.051 0.000 __init__.py:248(__init__)
48 3.685 0.077 194.845 4.059 configure.py:741(getDeviceByIp)
16 0.001 0.000 181.689 11.356
configure.py:882(processStaticNatRule)
68170816 54.655 0.000 140.186 0.000 __init__.py:63(__hash__)
68170976 48.577 0.000 69.112 0.000 __init__.py:439(key)
68187121 42.976 0.000 42.976 0.000 {hasattr}
68188576 26.202 0.000 26.205 0.000 {isinstance}
68178432 24.945 0.000 24.945 0.000 __init__.py:34(__init__)
68177504 20.537 0.000 20.537 0.000 __init__.py:232(version)
68170816 16.419 0.000 16.419 0.000 {hash}
1 0.020 0.020 1.522 1.522 CsNetfilter.py:134(compare)
329 0.007 0.000 1.513 0.005 CsHelper.py:182(execute)
329 0.002 0.000 1.060 0.003 subprocess.py:768(communicate)
329 0.004 0.000 1.057 0.003 subprocess.py:1400(_communicate)
329 0.012 0.000 1.046 0.003
subprocess.py:1433(_communicate_with_poll)
2352 1.021 0.000 1.021 0.000 {built-in method poll}
1 0.001 0.001 1.005 1.005 CsAddress.py:99(process)
22 0.001 0.000 0.989 0.045 CsAddress.py:271(configure)
22 0.001 0.000 0.937 0.043 CsAddress.py:285(post_configure)
> 在 2016年8月20日，09:41，ilya <[email protected]> 写道：
>
> Hi Gust
>
> Are you proposing solution "optimized CsAddress.py in VR" or just
> analysis on where time is being spent?
>
> Regards
> ilya
> On 8/18/16 9:34 PM, Gust wrote:
>>
>> Hi,all
>>
>> we constructed a advance network in cloudstack , it work fine early , but
>> when I added some VR rules ,it execute slow more and more.
>>
>> About total 100 rules already exist , I add a port forward rule , it would
>> execute about 3 minutes , that we changed the agent source set more seconds
>> timeout ,else agent will timeout at 120s, and optimized CsAddress.py in VR.
>>
>> So I login to VR vm , and modify the update_config.py with cProfile ,
>> and print out execute result . because add cProfile , python execute more
>> than 8 min.
>>
>> It shows too many netaddr object init invoked.
>>
>> vr hypervisor hardware : E3 1230v2 3.4GHz , vr alloc 3GHz
>>
>> ----------------------------------------------------------------------
>> Optimized CsAddress.py , execute 3 min, else 5 min
>>
>> CsAddress.py (line 145)
>> def ip_in_subnet(self, ip):
>> ipo = IPAddress(ip)
>> net = IPNetwork("%s/%s" % (self.get_ip(), self.get_size()))
>> aset = set(net)
>> return ipo in aset
>>
>> ----------------------------------------------------------------------
>> def mainp():
>> if not (os.path.isfile(jsonCmdConfigPath) and os.access(jsonCmdConfigPath,
>> os.R_OK)):
>> print "[ERROR] update_config.py :: You are telling me to process %s,
>> but i can't access it" % jsonCmdConfigPath
>> sys.exit(1)
>>
>> # If the command line json file is unprocessed process it
>> # This is important or, the control interfaces will get deleted!
>> if os.path.isfile(jsonPath % "cmd_line.json"):
>> qf = QueueFile()
>> qf.setFile("cmd_line.json")
>> qf.load(None)
>>
>> # If the guest network is already configured and have the same IP, do not
>> try to configure it again otherwise it will break
>> if sys.argv[1] == "guest_network.json":
>> if os.path.isfile(currentGuestNetConfig):
>> file = open(currentGuestNetConfig)
>> guestnet_dict = json.load(file)
>>
>> if not is_guestnet_configured(guestnet_dict, ['eth1', 'eth2',
>> 'eth3', 'eth4', 'eth5', 'eth6', 'eth7', 'eth8', 'eth9']):
>> print "[INFO] update_config.py :: Processing Guest Network."
>> process_file()
>> else:
>> print "[INFO] update_config.py :: No need to process Guest
>> Network."
>> finish_config()
>> else:
>> print "[INFO] update_config.py :: No GuestNetwork configured yet.
>> Configuring first one now."
>> process_file()
>> else:
>> print "[INFO] update_config.py :: Processing incoming file => %s" %
>> sys.argv[1]
>> process_file()
>>
>> cProfile.run("mainp()", "/var/log/py_pro.data”)
>>
>> ----------------------------------------------------------------------
>>
>> Fri Aug 19 11:27:50 2016 d:\temp\py_pro.data
>>
>> 614887355 function calls (614884838 primitive calls) in 548.846
>> seconds
>>
>> Ordered by: internal time
>>
>> ncalls tottime percall cumtime percall filename:lineno(function)
>> 68177344 182.925 0.000 277.051 0.000 __init__.py:248(__init__)
>> 68170816 65.435 0.000 342.427 0.000 __init__.py:1682(iter_iprange)
>> 68170816 54.655 0.000 140.186 0.000 __init__.py:63(__hash__)
>> 1088 53.936 0.050 536.665 0.493 CsAddress.py:145(ip_in_subnet)
>> 68170976 48.577 0.000 69.112 0.000 __init__.py:439(key)
>> 68187121 42.976 0.000 42.976 0.000 {hasattr}
>> 68188576 26.202 0.000 26.205 0.000 {isinstance}
>> 68178432 24.945 0.000 24.945 0.000 __init__.py:34(__init__)
>> 68177504 20.537 0.000 20.537 0.000 __init__.py:232(version)
>> 68170816 16.419 0.000 16.419 0.000 {hash}
>> 32 5.869 0.183 351.378 10.981 configure.py:747(getNetworkByIp)
>> 48 3.685 0.077 194.845 4.059 configure.py:741(getDeviceByIp)
>> 2352 1.021 0.000 1.021 0.000 {built-in method poll}
>> 245441 0.352 0.000 0.510 0.000 CsNetfilter.py:296(__eq__)
>> 2149 0.251 0.000 0.251 0.000 {posix.read}
>> 798 0.111 0.000 0.608 0.001 CsNetfilter.py:116(has_rule)
>> 493585 0.098 0.000 0.098 0.000 CsNetfilter.py:258(get_table)
>> 329 0.077 0.000 0.077 0.000 {posix.fork}
>> 2444 0.059 0.000 0.059 0.000 {method 'flush' of 'file'
>> objects}
>> 2444 0.039 0.000 0.074 0.000 __init__.py:243(__init__)
>> 113950 0.030 0.000 0.030 0.000 CsNetfilter.py:270(get_chain)
>> 329 0.028 0.000 0.367 0.001
>> subprocess.py:1195(_execute_child)
>> 2444 0.021 0.000 0.078 0.000 __init__.py:458(format)
>> 2069 0.021 0.000 0.039 0.000
>> CsNetfilter.py:236(__convert_to_dict)
>> 1 0.020 0.020 1.522 1.522 CsNetfilter.py:134(compare)
>> 2444 0.017 0.000 0.024 0.000 __init__.py:1226(findCaller)
>> 2444 0.016 0.000 0.017 0.000 __init__.py:318(getMessage)
>> 41763 0.015 0.000 0.015 0.000 {method 'items' of 'dict'
>> objects}
>> 2444 0.015 0.000 0.015 0.000 {time.localtime}
>> 1088 0.014 0.000 0.028 0.000 __init__.py:737(parse_ip_network)
>> 2444 0.013 0.000 0.036 0.000 __init__.py:411(formatTime)
>> 4889 0.013 0.000 0.018 0.000 threading.py:187(release)
>> 2444 0.013 0.000 0.194 0.000 __init__.py:847(emit)
>> 4889 0.013 0.000 0.018 0.000 threading.py:147(acquire)
>> 329 0.012 0.000 1.046 0.003
>> subprocess.py:1433(_communicate_with_poll)
>> 14709 0.011 0.000 0.011 0.000 {method 'replace' of 'unicode'
>> objects}
>> 47110 0.011 0.000 0.011 0.000 CsNetfilter.py:273(get_rule)
>> 162 0.009 0.000 0.011 0.000 CsNetfilter.py:276(to_str)
>> 2444 0.009 0.000 0.362 0.000 __init__.py:1260(_log)
>> 47397/47389 0.009 0.000 0.009 0.000 {len}
>> 2444 0.008 0.000 0.090 0.000 __init__.py:836(flush)
>> 3458 0.008 0.000 0.008 0.000 {method 'write' of 'file'
>> objects}
>> 2082 0.008 0.000 0.312 0.000 __init__.py:1138(debug)
>> 1088 0.008 0.000 0.031 0.000 __init__.py:648(__iter__)
>> 2444 0.008 0.000 0.243 0.000 __init__.py:1313(callHandlers)
>> 329 0.008 0.000 0.397 0.001 subprocess.py:650(__init__)
>> 2176 0.008 0.000 0.016 0.000 ipv4.py:123(str_to_int)
>> 2444 0.008 0.000 0.008 0.000 {time.strftime}
>> 329 0.007 0.000 1.513 0.005 CsHelper.py:182(execute)
>> 2444 0.007 0.000 0.235 0.000 __init__.py:744(handle)
>> 3221 0.007 0.000 0.007 0.000 {method 'split' of 'unicode'
>> objects}
>> 2082 0.007 0.000 0.319 0.000 __init__.py:1624(debug)
>> 4888 0.007 0.000 0.024 0.000 __init__.py:708(release)
>> 1088 0.007 0.000 0.039 0.000 __init__.py:855(__init__)
>> 3948 0.007 0.000 0.007 0.000 {fcntl.fcntl}
>> 2444 0.007 0.000 0.200 0.000 __init__.py:941(emit)
>> 658 0.007 0.000 0.007 0.000 {posix.fdopen}
>> 2309 0.006 0.000 0.006 0.000 CsAddress.py:167(get_attr)
>> 4888 0.006 0.000 0.024 0.000 __init__.py:701(acquire)
>> 2444 0.006 0.000 0.079 0.000 __init__.py:1247(makeRecord)
>> 2444 0.005 0.000 0.006 0.000 __init__.py:154(getLevelName)
>> 2444 0.005 0.000 0.006 0.000 genericpath.py:85(_splitext)
>> 2444 0.005 0.000 0.249 0.000 __init__.py:1281(handle)
>> 2444 0.004 0.000 0.006 0.000 __init__.py:1353(isEnabledFor)
>> 1088 0.004 0.000 0.004 0.000 {_socket.inet_aton}
>> 14666 0.004 0.000 0.004 0.000 {thread.get_ident}
>> 21 0.004 0.000 0.018 0.001 CsNetfilter.py:212(delete)
>> 329 0.004 0.000 1.057 0.003 subprocess.py:1400(_communicate)
>> 9778 0.004 0.000 0.004 0.000 threading.py:64(_note)
>> 1088 0.003 0.000 0.010 0.000 __init__.py:1003(hostmask)
>> 1316 0.003 0.000 0.003 0.000 {posix.close}
>> 987 0.003 0.000 0.003 0.000 {posix.pipe}
>> 4888 0.003 0.000 0.003 0.000 __init__.py:605(filter)
>> 1 0.003 0.003 0.019 0.019 CsNetfilter.py:89(get_all_rules)
>> 7332 0.003 0.000 0.003 0.000 {method 'rfind' of 'str' objects}
>> 1974 0.003 0.000 0.010 0.000
>> subprocess.py:1156(_set_cloexec_flag)
>> 2444 0.003 0.000 0.081 0.000 __init__.py:721(format)
>> 2444 0.003 0.000 0.009 0.000 posixpath.py:104(splitext)
>> 1 0.003 0.003 0.269 0.269 CsNetfilter.py:125(get_unseen)
>> 329 0.003 0.000 0.003 0.000 {posix.waitpid}
>> 2444 0.003 0.000 0.003 0.000 threading.py:1152(currentThread)
>> 112 0.003 0.000 0.004 0.000 CsAddress.py:37(get_interfaces)
>> 753 0.003 0.000 0.003 0.000 {method 'close' of 'file'
>> objects}
>> 987 0.003 0.000 0.016 0.000 subprocess.py:1169(pipe_cloexec)
>> 2069 0.003 0.000 0.042 0.000 CsNetfilter.py:227(parse)
>> 2444 0.003 0.000 0.004 0.000 posixpath.py:119(basename)
>> 1088 0.003 0.000 0.013 0.000 __init__.py:980(first)
>> 2444 0.003 0.000 0.004 0.000 __init__.py:452(usesTime)
>> 658 0.003 0.000 0.004 0.000
>> subprocess.py:1216(_close_in_parent)
>> 2444 0.002 0.000 0.004 0.000 __init__.py:82(<lambda>)
>> 329 0.002 0.000 0.015 0.000 subprocess.py:1107(_get_handles)
>> 2069 0.002 0.000 0.002 0.000 CsNetfilter.py:220(__init__)
>> 2444 0.002 0.000 0.002 0.000 threading.py:967(name)
>> 329 0.002 0.000 0.007 0.000 subprocess.py:1379(wait)
>> 658 0.002 0.000 0.005 0.000
>> subprocess.py:1444(close_unregister_and_remove)
>> 231 0.002 0.000 0.002 0.000 {open}
>> 6407 0.002 0.000 0.002 0.000 {method 'get' of 'dict' objects}
>> 64 0.002 0.000 0.005 0.000 CsHelper.py:92(updatefile)
>> 6526 0.002 0.000 0.002 0.000 {method 'keys' of 'dict' objects}
>> 1088 0.002 0.000 0.002 0.000 {_socket.inet_pton}
>> 658 0.002 0.000 0.252 0.000
>> subprocess.py:473(_eintr_retry_call)
>> 658 0.002 0.000 0.003 0.000
>> subprocess.py:1440(register_and_append)
>> 329 0.002 0.000 1.060 0.003 subprocess.py:768(communicate)
>> 2010 0.002 0.000 0.007 0.000 re.py:143(search)
>> 2011 0.002 0.000 0.004 0.000 re.py:230(_compile)
>> 2069 0.002 0.000 0.002 0.000 {zip}
>> 361 0.002 0.000 0.068 0.000 __init__.py:1616(info)
>> 2176 0.002 0.000 0.002 0.000 {_struct.unpack}
>> 2444 0.002 0.000 0.002 0.000 {sys._getframe}
>> 7349 0.002 0.000 0.002 0.000 {method 'append' of 'list'
>> objects}
>> 3310/1692 0.002 0.000 0.003 0.000
>> encoder.py:341(_iterencode_dict)
>> 1120 0.002 0.000 0.006 0.000 CsAddress.py:130(get_ip)
>> 2444 0.002 0.000 0.002 0.000
>> __init__.py:1339(getEffectiveLevel)
>> 361 0.002 0.000 0.066 0.000 __init__.py:1150(info)
>> 2506 0.002 0.000 0.002 0.000 {method 'find' of 'str' objects}
>> 840 0.002 0.000 0.002 0.000 CsNetfilter.py:54(has_chain)
>> 824/1 0.001 0.000 0.003 0.003 copy.py:145(deepcopy)
>> 202 0.001 0.000 0.003 0.000 abc.py:128(__instancecheck__)
>> 2445 0.001 0.000 0.001 0.000 {method 'acquire' of
>> 'thread.lock' objects}
>> 1088 0.001 0.000 0.001 0.000 __init__.py:988(last)
>> 42 0.001 0.000 0.005 0.000 CsHelper.py:156(definedinfile)
>> 6 0.001 0.000 0.006 0.001 CsFile.py:119(search)
>> 2445 0.001 0.000 0.001 0.000 {time.time}
>> 840 0.001 0.000 0.007 0.000 CsNetfilter.py:182(add_chain)
>> 2445 0.001 0.000 0.001 0.000 {method 'release' of
>> 'thread.lock' objects}
>> 5977 0.001 0.000 0.001 0.000 {method 'lstrip' of 'str'
>> objects}
>> 21 0.001 0.000 0.002 0.000 CsAddress.py:356(fw_router)
>> 7 0.001 0.000 0.001 0.000 decoder.py:372(raw_decode)
>> 22 0.001 0.000 0.937 0.043 CsAddress.py:285(post_configure)
>> 2033 0.001 0.000 0.001 0.000 {getattr}
>> 4888 0.001 0.000 0.001 0.000 posixpath.py:51(normcase)
>> 1501 0.001 0.000 0.001 0.000 {method 'split' of 'str' objects}
>> 2743 0.001 0.000 0.001 0.000 {method 'replace' of 'str'
>> objects}
>> 21 0.001 0.000 0.065 0.003 CsRule.py:39(findMark)
>> 329 0.001 0.000 0.001 0.000 subprocess.py:754(__del__)
>> 16 0.001 0.000 364.540 22.784 configure.py:772(forward_vr)
>> 1088 0.001 0.000 0.002 0.000 CsAddress.py:154(get_size)
>> 329 0.001 0.000 0.001 0.000 {gc.enable}
>> 389 0.001 0.000 0.001 0.000 _weakrefset.py:70(__contains__)
>> 513 0.001 0.000 0.001 0.000 CsNetfilter.py:40(add_rule)
>> 2444 0.001 0.000 0.001 0.000 {posix.getpid}
>> 1 0.001 0.001 1.005 1.005 CsAddress.py:99(process)
>> 2069 0.001 0.000 0.001 0.000 CsNetfilter.py:253(set_table)
>> 24 0.001 0.000 0.001 0.000 CsAddress.py:226(buildlist)
>> 32 0.001 0.000 0.003 0.000 configure.py:728(getGuestIp)
>> 2485 0.001 0.000 0.001 0.000 CsAddress.py:126(__init__)
>> 2010 0.001 0.000 0.001 0.000 {method 'search' of
>> '_sre.SRE_Pattern' objects}
>> 3161 0.001 0.000 0.001 0.000 {method 'startswith' of 'str'
>> objects}
>> 4774 0.001 0.000 0.001 0.000 {method 'strip' of 'str' objects}
>> 42 0.001 0.000 0.014 0.000 CsRoute.py:32(add_table)
>> 704 0.001 0.000 0.001 0.000 CsAddress.py:186(is_guest)
>> 329 0.001 0.000 0.001 0.000 subprocess.py:458(_cleanup)
>> 329 0.001 0.000 0.001 0.000
>> subprocess.py:1338(_handle_exitstatus)
>> 658 0.001 0.000 0.001 0.000 {built-in method unregister}
>> 21 0.001 0.000 0.001 0.000 CsAddress.py:693(cpus)
>> 668 0.001 0.000 0.001 0.000 {method 'remove' of 'set'
>> objects}
>> 2176 0.001 0.000 0.001 0.000 __init__.py:452(__int__)
>> 1692 0.001 0.000 0.003 0.000 encoder.py:417(_iterencode)
>> 22 0.001 0.000 0.989 0.045 CsAddress.py:271(configure)
>> 33 0.001 0.000 0.005 0.000 configure.py:114(add_rule)
>> 21 0.001 0.000 0.014 0.001 CsAddress.py:668(enable)
>> 329 0.001 0.000 0.001 0.000 {method 'splitlines' of 'str'
>> objects}
>> 16 0.001 0.000 181.689 11.356
>> configure.py:882(processStaticNatRule)
>> 658 0.001 0.000 0.001 0.000 {built-in method register}
>> 1 0.001 0.001 548.837 548.837
>> update_config.py:44(finish_config)
>> 689 0.001 0.000 0.001 0.000 copy.py:267(_keep_alive)
>> 22 0.001 0.000 0.058 0.003
>> CsRoute.py:85(defaultroute_exists)
>> 840 0.001 0.000 0.002 0.000 CsNetfilter.py:113(has_chain)
>> 21 0.001 0.000 0.074 0.004
>> CsAddress.py:516(post_config_change)
>> 1974 0.001 0.000 0.001 0.000 {method 'fileno' of 'file'
>> objects}
>> 510 0.001 0.000 0.001 0.000 CsDatabag.py:55(idata)
>> 658 0.001 0.000 0.001 0.000 {method 'update' of 'set'
>> objects}
>> 71 0.000 0.000 0.000 0.000 {method 'read' of 'file' objects}
>> 695 0.000 0.000 0.000 0.000 CsNetfilter.py:233(mark_seen)
>> 950 0.000 0.000 0.000 0.000 {method 'lstrip' of 'unicode'
>> objects}
>> 660 0.000 0.000 0.000 0.000 {method 'join' of 'str' objects}
>> 34/1 0.000 0.000 0.003 0.003 copy.py:253(_deepcopy_dict)
>> 329 0.000 0.000 0.000 0.000 {method 'count' of 'list'
>> objects}
>> 12/11 0.000 0.000 0.001 0.000 sre_parse.py:388(_parse)
>> 798 0.000 0.000 0.000 0.000 CsNetfilter.py:107(get)
>> 658 0.000 0.000 0.000 0.000 {method 'pop' of 'dict' objects}
>> 24 0.000 0.000 0.002 0.000 CsAddress.py:207(__init__)
>> 179 0.000 0.000 0.001 0.000 CsConfig.py:60(is_vpc)
>> 2 0.000 0.000 0.010 0.005 CsHelper.py:190(save_iptables)
>> 1 0.000 0.000 0.004 0.004 encoder.py:186(encode)
>> 58 0.000 0.000 0.000 0.000 {posix.stat}
>> 21 0.000 0.000 0.050 0.002 CsRoute.py:54(set_route)
>> 329 0.000 0.000 0.000 0.000 {select.poll}
>> 21 0.000 0.000 0.053 0.003 CsRoute.py:45(add_route)
>> 66 0.000 0.000 0.000 0.000 {sorted}
>> 21 0.000 0.000 0.045 0.002
>> CsHelper.py:35(reconfigure_interfaces)
>> 184 0.000 0.000 0.001 0.000 CsDatabag.py:82(get_type)
>> 21 0.000 0.000 0.668 0.032 CsAddress.py:598(arpPing)
>> 47 0.000 0.000 0.001 0.000 genericpath.py:26(isfile)
>> 329 0.000 0.000 0.000 0.000
>> subprocess.py:1352(_internal_poll)
>> 33 0.000 0.000 0.005 0.000 configure.py:86(__init__)
>> 1696 0.000 0.000 0.000 0.000 {id}
>> 21 0.000 0.000 0.000 0.000 CsAddress.py:320(set_mark)
>> 11 0.000 0.000 0.000 0.000 sre_compile.py:433(_compile_info)
>> 252 0.000 0.000 0.000 0.000 encoder.py:288(_iterencode_list)
>> 129 0.000 0.000 0.000 0.000 CsAddress.py:325(get_type)
>> 410 0.000 0.000 0.000 0.000 CsNetfilter.py:104(save)
>> 42 0.000 0.000 0.006 0.000 CsHelper.py:164(addifmissing)
>> 695 0.000 0.000 0.000 0.000 CsNetfilter.py:267(get_count)
>> 21 0.000 0.000 0.005 0.000 CsAddress.py:683(inKernel)
>> 179 0.000 0.000 0.000 0.000 sre_parse.py:191(__next)
>> 123 0.000 0.000 0.000 0.000 {method 'add' of 'set' objects}
>> 329 0.000 0.000 0.000 0.000 {posix.WIFSIGNALED}
>> 1 0.000 0.000 548.836 548.836 configure.py:903(main)
>> 20/11 0.000 0.000 0.000 0.000 sre_compile.py:64(_compile)
>> 2 0.000 0.000 0.010 0.005 configure.py:272(process)
>> 80 0.000 0.000 0.000 0.000 __init__.py:69(__eq__)
>> 329 0.000 0.000 0.000 0.000 {posix.WEXITSTATUS}
>> 61 0.000 0.000 0.000 0.000 CsConfig.py:45(cmdline)
>> 410 0.000 0.000 0.000 0.000 CsNetfilter.py:48(get_count)
>> 10 0.000 0.000 0.004 0.000 merge.py:49(load)
>> 66 0.000 0.000 0.000 0.000 CsAddress.py:589(ip)
>> 64 0.000 0.000 0.000 0.000 configure.py:759(portsToString)
>> 21 0.000 0.000 0.000 0.000 CsRule.py:28(__init__)
>> 1 0.000 0.000 0.019 0.019 CsNetfilter.py:188(del_standard)
>> 537 0.000 0.000 0.000 0.000 {_json.encode_basestring_ascii}
>> 69 0.000 0.000 0.000 0.000 CsAddress.py:158(get_device)
>> 28/19 0.000 0.000 0.000 0.000 sre_parse.py:149(getwidth)
>> 6 0.000 0.000 0.014 0.002 CsAddress.py:255(__init__)
>> 6 0.000 0.000 0.014 0.002 CsAddress.py:555(list)
>> 329 0.000 0.000 0.000 0.000 {gc.isenabled}
>> 1 0.000 0.000 546.228 546.228 configure.py:717(process)
>> 465 0.000 0.000 0.000 0.000 CsNetfilter.py:76(last)
>> 57 0.000 0.000 0.000 0.000 copy.py:226(_deepcopy_list)
>> 9/8 0.000 0.000 0.003 0.000 CsDatabag.py:24(__init__)
>> 1 0.000 0.000 0.000 0.000 CsFile.py:30(load)
>> 410 0.000 0.000 0.000 0.000 CsNetfilter.py:264(set_count)
>> 598 0.000 0.000 0.000 0.000 copy.py:198(_deepcopy_atomic)
>> 410 0.000 0.000 0.000 0.000 CsNetfilter.py:261(set_chain)
>> 21 0.000 0.000 0.067 0.003 CsRule.py:33(addMark)
>> 25 0.000 0.000 0.000 0.000 CsDatabag.py:68(is_redundant)
>> 44 0.000 0.000 0.000 0.000 stat.py:49(S_ISREG)
>> 22 0.000 0.000 0.000 0.000 CsAddress.py:571(configured)
>> 10/5 0.000 0.000 0.000 0.000 abc.py:148(__subclasscheck__)
>> 63 0.000 0.000 0.000 0.000 CsRoute.py:29(get_tablename)
>> 167 0.000 0.000 0.000 0.000 sre_parse.py:210(get)
>> 391 0.000 0.000 0.000 0.000 CsNetfilter.py:230(unseen)
>> 56 0.000 0.000 0.000 0.000 CsNetfilter.py:31(add)
>> 329 0.000 0.000 0.000 0.000 {posix.WIFEXITED}
>> 11 0.000 0.000 0.002 0.000 sre_compile.py:567(compile)
>> 371 0.000 0.000 0.000 0.000 encoder.py:361(<lambda>)
>> 137 0.000 0.000 0.000 0.000 sre_parse.py:147(append)
>> 115 0.000 0.000 0.000 0.000 CsConfig.py:48(address)
>> 22 0.000 0.000 0.058 0.003 CsRoute.py:69(add_defaultroute)
>> 11 0.000 0.000 0.001 0.000 sre_parse.py:686(parse)
>> 21 0.000 0.000 0.018 0.001 CsNetfilter.py:206(del_rule)
>> 1 0.000 0.000 0.009 0.009 merge.py:93(process)
>> 329 0.000 0.000 0.000 0.000 {gc.disable}
>> 44 0.000 0.000 0.000 0.000 CsDatabag.py:147(get_gateway)
>> 19 0.000 0.000 0.000 0.000 _weakrefset.py:58(__iter__)
>> 2 0.000 0.000 0.015 0.007 CsHelper.py:211(service)
>> 50 0.000 0.000 0.000 0.000 sre_parse.py:139(__getitem__)
>> 22 0.000 0.000 0.000 0.000
>> CsAddress.py:343(setup_router_control)
>> 1 0.000 0.000 0.000 0.000 {__import__}
>> 1 0.000 0.000 0.000 0.000 CsFile.py:42(is_changed)
>> 33 0.000 0.000 0.005 0.000 configure.py:110(create)
>> 43 0.000 0.000 0.000 0.000 CsRoute.py:26(__init__)
>> 1 0.000 0.000 0.006 0.006 CsApp.py:43(setup)
>> 16 0.000 0.000 364.540 22.784
>> configure.py:766(processForwardRule)
>> 7 0.000 0.000 0.001 0.000 __init__.py:257(load)
>> 1 0.000 0.000 0.000 0.000 ascii.py:8(<module>)
>> 44 0.000 0.000 0.000 0.000 stat.py:24(S_IFMT)
>> 12/11 0.000 0.000 0.001 0.000 sre_parse.py:310(_parse_sub)
>> 21 0.000 0.000 0.000 0.000 {format}
>> 7 0.000 0.000 0.001 0.000 decoder.py:361(decode)
>> 32 0.000 0.000 0.000 0.000 CsAddress.py:133(get_network)
>> 11 0.000 0.000 0.001 0.000 sre_compile.py:552(_code)
>> 2 0.000 0.000 0.000 0.000 {posix.listdir}
>> 1 0.000 0.000 0.018 0.018 CsRedundant.py:74(_redundant_off)
>> 61 0.000 0.000 0.000 0.000
>> CsConfig.py:39(get_cmdline_instance)
>> 1 0.000 0.000 0.007 0.007 CsProcess.py:61(grep)
>> 14 0.000 0.000 0.000 0.000 {method 'match' of
>> '_sre.SRE_Pattern' objects}
>> 71 0.000 0.000 0.000 0.000 CsConfig.py:51(get_fw)
>> 40 0.000 0.000 0.000 0.000 {min}
>> 1 0.000 0.000 0.007 0.007 CsAddress.py:32(compare)
>> 1 0.000 0.000 0.000 0.000 {posix.rename}
>> 1 0.000 0.000 548.846 548.846 update_config.py:50(process_file)
>> 21 0.000 0.000 0.000 0.000 CsAddress.py:665(__init__)
>> 22 0.000 0.000 0.000 0.000 CsAddress.py:237(waitfordevice)
>> 43 0.000 0.000 0.000 0.000 {hex}
>> 1 0.000 0.000 0.003 0.003 CsHelper.py:55(is_mounted)
>> 125 0.000 0.000 0.000 0.000 {ord}
>> 1 0.000 0.000 0.000 0.000 shutil.py:210(rmtree)
>> 11 0.000 0.000 0.000 0.000 {_sre.compile}
>> 1 0.000 0.000 0.003 0.003 cs_firewallrules.py:22(merge)
>> 7 0.000 0.000 0.001 0.000 __init__.py:293(loads)
>> 3 0.000 0.000 0.000 0.000 CsAddress.py:604(compare)
>> 1 0.000 0.000 0.013 0.013
>> configure.py:266(flushAllowAllEgressRules)
>> 11 0.000 0.000 0.000 0.000 genericpath.py:15(exists)
>> 10 0.000 0.000 0.000 0.000 _weakrefset.py:26(__exit__)
>> 1 0.000 0.000 0.018 0.018 CsRedundant.py:67(set)
>> 1 0.000 0.000 0.000 0.000 posixpath.py:139(islink)
>> 23 0.000 0.000 0.000 0.000 CsAddress.py:592(getDevice)
>> 21 0.000 0.000 0.000 0.000 CsAddress.py:430(fw_vpcrouter)
>> 1 0.000 0.000 548.846 548.846 update_config.py:114(mainp)
>> 22 0.000 0.000 0.000 0.000 sre_compile.py:546(isstring)
>> 1 0.000 0.000 0.004 0.004 __init__.py:193(dumps)
>> 10 0.000 0.000 0.000 0.000 _weakrefset.py:20(__enter__)
>> 1 0.000 0.000 0.000 0.000 encoder.py:212(iterencode)
>> 8 0.000 0.000 0.000 0.000 sre_compile.py:428(_simple)
>> 14/5 0.000 0.000 0.000 0.000 {issubclass}
>> 10 0.000 0.000 0.000 0.000 _weakrefset.py:83(add)
>> 1 0.000 0.000 0.000 0.000 CsRedundant.py:62(__init__)
>> 11 0.000 0.000 0.000 0.000 sre_parse.py:187(__init__)
>> 1 0.000 0.000 0.009 0.009 merge.py:87(__init__)
>> 78 0.000 0.000 0.000 0.000 {method 'iteritems' of 'dict'
>> objects}
>> 1 0.000 0.000 0.000 0.000 configure.py:446(process)
>> 22 0.000 0.000 0.000 0.000 CsAddress.py:265(setAddress)
>> 32 0.000 0.000 0.000 0.000 sre_parse.py:135(__len__)
>> 1 0.000 0.000 0.009 0.009 merge.py:273(load)
>> 23 0.000 0.000 0.000 0.000 sre_parse.py:204(match)
>> 1 0.000 0.000 0.000 0.000 __init__.py:71(search_function)
>> 11 0.000 0.000 0.000 0.000 sre_parse.py:67(__init__)
>> 1 0.000 0.000 0.000 0.000 merge.py:306(__moveFile)
>> 1 0.000 0.000 0.000 0.000
>> sre_compile.py:256(_optimize_charset)
>> 1 0.000 0.000 0.000 0.000 __init__.py:211(_acquireLock)
>> 10 0.000 0.000 0.000 0.000 merge.py:46(__init__)
>> 1 0.000 0.000 0.000 0.000 {method 'split' of
>> '_sre.SRE_Pattern' objects}
>> 18 0.000 0.000 0.000 0.000 {method 'extend' of 'list'
>> objects}
>> 1 0.000 0.000 0.007 0.007 CsApp.py:77(start)
>> 10 0.000 0.000 0.000 0.000 _weakrefset.py:16(__init__)
>> 2 0.000 0.000 0.000 0.000 CsHelper.py:73(rm)
>> 1 0.000 0.000 0.000 0.000 CsApp.py:97(add_firewall_rules)
>> 1 0.000 0.000 0.003 0.003 CsHelper.py:68(umount_tmpfs)
>> 1 0.000 0.000 0.000 0.000 {posix.rmdir}
>> 1 0.000 0.000 0.000 0.000 codecs.py:77(__new__)
>> 1 0.000 0.000 0.004 0.004 merge.py:65(save)
>> 20 0.000 0.000 0.000 0.000 sre_parse.py:90(__init__)
>> 2 0.000 0.000 0.000 0.000 CsConfig.py:78(use_extdns)
>> 1 0.000 0.000 0.000 0.000 {posix.lstat}
>> 1 0.000 0.000 0.019 0.019 CsNetfilter.py:82(__init__)
>> 1 0.000 0.000 0.000 0.000 CsHelper.py:77(rmdir)
>> 9 0.000 0.000 0.000 0.000 {method '__subclasses__' of
>> 'type' objects}
>> 10 0.000 0.000 0.000 0.000 _abcoll.py:98(__subclasshook__)
>> 10 0.000 0.000 0.000 0.000
>> _weakrefset.py:52(_commit_removals)
>> 14 0.000 0.000 0.000 0.000 {method 'end' of
>> '_sre.SRE_Match' objects}
>> 1 0.000 0.000 0.000 0.000 __init__.py:1590(error)
>> 1 0.000 0.000 0.000 0.000 re.py:168(split)
>> 1 0.000 0.000 0.000 0.000 __init__.py:1176(error)
>> 1 0.000 0.000 0.000 0.000 {posix.access}
>> 1 0.000 0.000 0.000 0.000
>> sre_compile.py:228(_compile_charset)
>> 1 0.000 0.000 0.000 0.000 CsAddress.py:219(configure_rp)
>> 10 0.000 0.000 0.000 0.000 merge.py:79(setKey)
>> 2 0.000 0.000 0.000 0.000 CsApp.py:26(__init__)
>> 3 0.000 0.000 0.000 0.000 CsNetfilter.py:68(add)
>> 8 0.000 0.000 0.000 0.000 sre_parse.py:143(__setitem__)
>> 1 0.000 0.000 0.000 0.000 CsConfig.py:72(has_metadata)
>> 1 0.000 0.000 0.000 0.000 ascii.py:41(getregentry)
>> 1 0.000 0.000 548.846 548.846 <string>:1(<module>)
>> 2 0.000 0.000 0.000 0.000 CsConfig.py:69(has_dns)
>> 1 0.000 0.000 0.000 0.000 CsHelper.py:235(copy_if_needed)
>> 1 0.000 0.000 0.000 0.000 {round}
>> 10 0.000 0.000 0.000 0.000 merge.py:76(getDataBag)
>> 2 0.000 0.000 0.000 0.000 CsAddress.py:335(get_ip_address)
>> 4 0.000 0.000 0.000 0.000 {method 'update' of 'dict'
>> objects}
>> 1 0.000 0.000 0.000 0.000 sre_parse.py:83(closegroup)
>> 2 0.000 0.000 0.000 0.000 _weakrefset.py:36(__init__)
>> 1 0.000 0.000 0.000 0.000 {method 'translate' of 'str'
>> objects}
>> 1 0.000 0.000 0.000 0.000 encoder.py:272(_make_iterencode)
>> 1 0.000 0.000 0.000 0.000 configure.py:615(process)
>> 1 0.000 0.000 0.000 0.000 __init__.py:1500(basicConfig)
>> 1 0.000 0.000 0.001 0.001 CsConfig.py:36(set_address)
>> 2 0.000 0.000 0.000 0.000 CsConfig.py:63(is_router)
>> 1 0.000 0.000 0.000 0.000 CsConfig.py:75(get_domain)
>> 1 0.000 0.000 0.000 0.000 __init__.py:220(_releaseLock)
>> 1 0.000 0.000 0.000 0.000
>> __init__.py:49(normalize_encoding)
>> 1 0.000 0.000 0.000 0.000 CsNetfilter.py:64(__init__)
>> 1 0.000 0.000 0.000 0.000 CsLoadBalancer.py:32(process)
>> 1 0.000 0.000 0.000 0.000 {built-in method __new__ of type
>> object at 0x93c580}
>> 3 0.000 0.000 0.000 0.000 {method 'setdefault' of 'dict'
>> objects}
>> 1 0.000 0.000 0.003 0.003
>> merge.py:179(process_firewallrules)
>> 1 0.000 0.000 0.000 0.000 encoder.py:101(__init__)
>> 1 0.000 0.000 0.000 0.000 sre_parse.py:266(_escape)
>> 1 0.000 0.000 0.000 0.000 CsFile.py:26(__init__)
>> 1 0.000 0.000 0.000 0.000 CsAddress.py:249(list)
>> 1 0.000 0.000 0.000 0.000 ascii.py:28(StreamWriter)
>> 1 0.000 0.000 0.000 0.000 CsConfig.py:33(__init__)
>> 1 0.000 0.000 0.000 0.000 CsApp.py:74(__init__)
>> 1 0.000 0.000 0.000 0.000 CsNetfilter.py:26(__init__)
>> 1 0.000 0.000 0.000 0.000 {method 'find' of 'bytearray'
>> objects}
>> 1 0.000 0.000 0.000 0.000 ascii.py:13(Codec)
>> 1 0.000 0.000 0.000 0.000 ascii.py:20(IncrementalEncoder)
>> 1 0.000 0.000 0.000 0.000 CsConfig.py:54(get_logger)
>> 1 0.000 0.000 0.000 0.000 merge.py:294(setFile)
>> 1 0.000 0.000 0.000 0.000 sre_parse.py:72(opengroup)
>> 2 0.000 0.000 0.000 0.000 shutil.py:222(onerror)
>> 1 0.000 0.000 0.000 0.000 CsProcess.py:27(__init__)
>> 1 0.000 0.000 0.000 0.000 {sys.exit}
>> 1 0.000 0.000 0.000 0.000 ascii.py:24(IncrementalDecoder)
>> 1 0.000 0.000 0.000 0.000 CsDatabag.py:88(get_domain)
>> 1 0.000 0.000 0.000 0.000 ascii.py:34(StreamConverter)
>> 1 0.000 0.000 0.000 0.000 {method 'remove' of 'list'
>> objects}
>> 2 0.000 0.000 0.000 0.000 {sys.exc_info}
>> 1 0.000 0.000 0.000 0.000 CsConfig.py:66(is_dhcp)
>> 1 0.000 0.000 0.000 0.000 {any}
>> 1 0.000 0.000 0.000 0.000 CsConfig.py:57(get_level)
>> 1 0.000 0.000 0.000 0.000 {method 'disable' of
>> '_lsprof.Profiler' objects}
>> 1 0.000 0.000 0.000 0.000 ascii.py:31(StreamReader)
>> 1 0.000 0.000 0.000 0.000 CsConfig.py:95(get_format)
>>
>>
>> Fri Aug 19 11:27:50 2016 d:\temp\py_pro.data
>>
>> 614887355 function calls (614884838 primitive calls) in 548.846
>> seconds
>>
>> Ordered by: cumulative time
>> List reduced from 404 to 3 due to restriction <3>
>>
>> ncalls tottime percall cumtime percall filename:lineno(function)
>> 1 0.000 0.000 548.846 548.846 <string>:1(<module>)
>> 1 0.000 0.000 548.846 548.846 update_config.py:114(mainp)
>> 1 0.000 0.000 548.846 548.846 update_config.py:50(process_file)
>>
>>
>>
>>
>>
>>
