Send netdisco-users mailing list submissions to
[email protected]
To subscribe or unsubscribe via the World Wide Web, visit
https://lists.sourceforge.net/lists/listinfo/netdisco-users
or, via email, send a message with subject or body 'help' to
[email protected]
You can reach the person managing the list at
[email protected]
When replying, please edit your Subject line so it is more specific
than "Re: Contents of netdisco-users digest..."
Today's Topics:
1. Re: Performance issue for big queries in My Reports (Andy Ruhl)
2. Re: Performance issue for big queries in My Reports
(Oliver Gorwits)
3. Re: Keep manual details from discovery overwrite (Stefan Klatt)
4. Re: Performance issue for big queries in My Reports
(Markus Drexelius)
--- Begin Message ---
Does the query come back in a reasonable amount of time from the
command line in the database?
Use netdisco-do psql to get a command line.
Also, I have a lot of ports, more than 60k. I'd be interested to see
how the query runs on my system.
Andy
On Mon, Dec 4, 2017 at 11:47 PM, Markus Drexelius <[email protected]> wrote:
> Hello,
>
> we want to implement a user defined report under "My Reports" with a list of
> any LAN ports in our networks in netdisco2.
>
> For that I have created an SQL query: the result set is about 60.000 records
> (ports) to be displayed.
>
> Netdisco seems not to able to display such a high amount of records due to
> performance issues: it needs more than 1 minute to load the report....
>
> Is there any possibility to increase the performance to an user friendly
> amount of time? (e.g. several seconds to load)
>
> Thanks
>
> markus
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Netdisco mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/netdisco-users
>
--- End Message ---
--- Begin Message ---
Hi Markus
Andy already replied with the first question :-). It would be good to
know the psql prompt performance.
Following that I have a bit more information:
User defined reports to work in a sort of inefficient way as the
mechanism is (and has to be) very generic. Every row is retrieved and
they all create Perl object instances and then all data is sent to the
client browser where DataTables must paginate it. A lot of work!
This could be made better by paginating at the database side using query
parameters and a report sidebar. Or writing a plugin rather than a
generic report, and then you could skip the Perl object creation using a
hashref inflator.
Alternatively, there is already a built-in Ports search/report
accessible by entering a search term in the main black titlebar of
Netdisco, clicking the down-arrow, and selecting "Search Ports". So it
would be good to know (as Andy says) what your query is doing, and what
is different to this built in search.
regards,
Oliver.
On 2017-12-05 06:47, Markus Drexelius wrote:
Hello,
we want to implement a user defined report under "My Reports" with a
list of any LAN ports in our networks in netdisco2.
For that I have created an SQL query: the result set is about 60.000
records (ports) to be displayed.
Netdisco seems not to able to display such a high amount of records
due to performance issues: it needs more than 1 minute to load the
report....
Is there any possibility to increase the performance to an user
friendly amount of time? (e.g. several seconds to load)
Thanks
markus
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Netdisco mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/netdisco-users
--- End Message ---
--- Begin Message ---
Hi Oliver,
in every infrastructure you have devices you can't poll or you can't get
all needed information. Such a way to inject data can be very
interesting to complete the view on the network.
Rergards
Stefan
Am 03.12.2017 um 23:27 schrieb Oliver Gorwits:> Hi Stefan,
>
> I would rather not have such static data in Netdisco which lives
> outside of the database. The system should collect data from your live
> network devices by whatever means (SNMP, SSH/CLI, API).
>
> If you want to have data for devices which are not pollable, then you
> probably need a DCIM or other asset inventory system (NetBox?).
>
> regards,
> Oliver.
>
> On 2017-12-03 00:25, Stefan Klatt wrote:
>> Hello Oliver,
>>
>> only my 2 cents...
>> What about a device text/config file with informations to overwrite SNMP
>> information or not retrievable information?
>> This would help additional in situations you have a device without SNMP
>> data but you want see it in netdisco.
>>
>> Regards
>>
>> Stefan
>>
>> Am 02.12.2017 um 22:05 schrieb Oliver Gorwits:
>>> Hi Stefano
>>>
>>> Are the serial numbers available with SNMP from a different OID that
>>> we can retrieve instead?
>>>
>>> Alternatively you could implement a CLI or API based retrieval.
>>>
>>> Oliver.
>>>
>>> On 2017-11-24 10:09, Chiesa, Stefano wrote:
>>>> Hello all.
>>>>
>>>> I have a question on 2.034000 version.
>>>>
>>>> Sometimes Netdisco cannot retrieve some info from devices (i.e.
>>>> Checkpoint Serial Numbers that are not available via SNMP).
>>>>
>>>> I tried to add these info directly in the Netdisco DB fields but,
>>>> obviously, at the first discovery it removed everything.
>>>>
>>>> Is there a way to add details to a device w/o have them deleted by
>>>> next discovery?
>>>>
>>>> Thanks in advance.
>>>>
>>>> STEFANO CHIESA | NTT DATA Italia
>>>>
>>>> Viale Cassala, 14/A - 20143 Milano, Italia | M: +39 337 1534214 |
>>>>
>>>> [email protected] | Learn more at www.nttdata.com/it [1]
>>>>
>>>> ______________________________________________________________________
>>>>
>>>> Disclaimer: This email and any attachments are sent in strictest
>>>> confidence
>>>> for the sole use of the addressee and may contain legally privileged,
>>>> confidential, and proprietary data. If you are not the intended
>>>> recipient,
>>>> please advise the sender by replying promptly to this email and then
>>>> delete
>>>> and destroy this email and any attachments without any further use,
>>>> copying
>>>> or forwarding.
>>>>
>>>>
>>>> Links:
>>>> ------
>>>> [1] http://www.nttdata.com/it
>>>>
>>>>
------------------------------------------------------------------------------
>>>>
>>>>
>>>> Check out the vibrant tech community on one of the world's most
>>>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>>>>
>>>> _______________________________________________
>>>> Netdisco mailing list
>>>> [email protected]
>>>> https://lists.sourceforge.net/lists/listinfo/netdisco-users
>>>
>>>
------------------------------------------------------------------------------
>>>
>>>
>>> Check out the vibrant tech community on one of the world's most
>>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>>> _______________________________________________
>>> Netdisco mailing list
>>> [email protected]
>>> https://lists.sourceforge.net/lists/listinfo/netdisco-users
>>
>> --
>> *CaC, Computer and Communication*
>> Inhaber Stefan Klatt
>> End-2-End Senior Network Consultant
>> Triftstrasse 9
>> 60528 Frankfurt
>> Germany
>> USt-IdNr.: DE260461592
>>
>> Tel.: +49-(0)172-6807809
>> Tel.: +49-(0)69-67808-900
>> Fax: +49-(0)69-67808-837
>> Email: [email protected]
>> Profil: http://www.cac-netzwerk.de/profil
>>
>>
>>
------------------------------------------------------------------------------
>>
>> Check out the vibrant tech community on one of the world's most
>> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
>>
>> _______________________________________________
>> Netdisco mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/netdisco-users
>
>
------------------------------------------------------------------------------
>
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> _______________________________________________
> Netdisco mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/netdisco-users
--
*CaC, Computer and Communication*
Inhaber Stefan Klatt
End-2-End Senior Network Consultant
Triftstrasse 9
60528 Frankfurt
Germany
USt-IdNr.: DE260461592
Tel.: +49-(0)172-6807809
Tel.: +49-(0)69-67808-900
Fax: +49-(0)69-67808-837
Email: [email protected]
Profil: http://www.cac-netzwerk.de/profil
smime.p7s
Description: S/MIME Cryptographic Signature
--- End Message ---
--- Begin Message ---
Hi,
here is the select statement we are using in the moment:
SELECT device.dns, device_port.port, device_port.vlan, device_port.lastchange, device_port.up, device_port.up_admin, device_port.speed, device_port.name FROM device_port LEFT JOIN device ON device_port.ip = device.ip WHERE (((device_port.port) Not Like 'Vlan*') AND ((device_port.type) Like 'ethernetCsmacd') AND ((device_port.is_uplink) Is Null)) ORDER BY device.dns;
On command line / database level the query needs about only 2-3 seconds, so I think the performance issue is in the level above (perl module / jquery on client side) as Oliver already mentioned...
We need a list of all "real" end user ports (not the trunks between switches, not any internal interfaces, ...) and give the user the ability to filter the list for e.g. VLAN-ID, location/dns-name, so the built in reports/functions does not work very good for this, because all the internal uplinks/ports are displayed and not only the enduser ports for example...
Thanks a lot for your help,
best regards
Markus
Does the query come back in a reasonable amount of time from the
command line in the database?
Use netdisco-do psql to get a command line.
Also, I have a lot of ports, more than 60k. I'd be interested to see
how the query runs on my system.
Andy
On Mon, Dec 4, 2017 at 11:47 PM, Markus Drexelius <
[email protected]> wrote:
> Hello,
>
> we want to implement a user defined report under "My Reports" with a list of
> any LAN ports in our networks in netdisco2.
>
> For that I have created an SQL query: the result set is about 60.000 records
> (ports) to be displayed.
>
> Netdisco seems not to able to display such a high amount of records due to
> performance issues: it needs more than 1 minute to load the report....
>
> Is there any possibility to increase the performance to an user friendly
> amount of time? (e.g. several seconds to load)
>
> Thanks
>
> markus
>
> ------------------------------------------------------------------------------
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org!
http://sdm.link/slashdot
> _______________________________________________
> Netdisco mailing list
>
[email protected]
>
https://lists.sourceforge.net/lists/listinfo/netdisco-users
>
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org!
http://sdm.link/slashdot
_______________________________________________
Netdisco mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/netdisco-users
--- End Message ---
------------------------------------------------------------------------------
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
_______________________________________________
Netdisco mailing list - Digest Mode
[email protected]
https://lists.sourceforge.net/lists/listinfo/netdisco-users
