Re: [Wireshark-dev] Menagerie
On Mon, Mar 2, 2015 at 2:16 PM, Evan Huus eapa...@gmail.com wrote: The fastest way to get a decent menagerie right now might be to write a script that scrapes all public bugzilla attachments... That's where the majority of our menagerie comes from anyways. I downloaded samples from wireshark's wiki, and what I'm working on so far. The issue is that the script downloaded some rubbish, too, so I hoped to have a clean, flat, database. ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
Sorry, after Chris's concerns I took it down until we could get a final answer there, just to be safe. Gerald would have to be the one to expose it via anything other than a torrent, I think, since he controls the website. He also probably knows more about the privacy restrictions on those files... The fastest way to get a decent menagerie right now might be to write a script that scrapes all public bugzilla attachments... That's where the majority of our menagerie comes from anyways. Evan On Mar 2, 2015, at 05:42, Dario Lombardo dario.lombardo...@gmail.com wrote: Evan, I'm not still able to download the torrent. Anyone tried and succeded? Can't the daily menagerie be exposed via a more convenient interface like http? I don't think the generated traffic would flood the server, especially if the files are compressed in a tar.bz2 or a zip. ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
Evan, I'm not still able to download the torrent. Anyone tried and succeded? Can't the daily menagerie be exposed via a more convenient interface like http? I don't think the generated traffic would flood the server, especially if the files are compressed in a tar.bz2 or a zip. ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
On Fri, Feb 27, 2015 at 3:36 PM, Evan Huus eapa...@gmail.com wrote: I have rsync set up via ssh to the host server, but I'm pretty sure we can't just give everyone ssh access :) Yes of course :). Maybe a public interface like http (or even rsync should be unautenticated, but I have no personal experience using it). For now, hopefully this torrent file works better. Unfortunately bittorrent is often used for illegal purposes, so in many (enterprise) environments it is forbidden. ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
-Original Message- From: wireshark-dev-boun...@wireshark.org [mailto:wireshark-dev-boun...@wireshark.org] On Behalf Of Evan Huus Sent: den 27 februari 2015 13:56 To: Developer support list for Wireshark Subject: Re: [Wireshark-dev] Menagerie The menagerie consists mostly of files uploaded to bugzilla. Captures attached to bug tickets are automatically added to the menagerie, and most files in the menagerie can be downloaded from a bug report somewhere. I'm not sure if there is a more convenient way to download the entire menagerie available to the general public. Adding files is as easy as filing a dummy bug and attaching files to that. I think you can also add them to the wiki sample captures. Regards Anders On Feb 27, 2015, at 05:41, Dario Lombardo dario.lombardo...@gmail.com wrote: Browsing the buildbot site, I've read somewhere about menagerie. I suppose it is a large set of file that is used as regression test. Is it correct? Is it possible to download it? And to upload new samples to it? Thanks. Dario. ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
The size is not huge. Why not just host it on the wireshark main site? Torrent is amazing, but I think it is needed only when the size is really huge. On Fri, Feb 27, 2015 at 3:17 PM, Evan Huus eapa...@gmail.com wrote: 1.8 GB I think it's a routing problem, not a torrent problem, I probably need to open a hole in my firewall or something. I'm at work now anyways, so I'll look at it again tonight unless somebody beats me to it. Evan On Fri, Feb 27, 2015 at 9:07 AM, Dario Lombardo dario.lombardo...@gmail.com wrote: Should be supported by your torrent client (maybe create torrent or something). Once you succeded, send us the torrent. How large it is? On Fri, Feb 27, 2015 at 2:42 PM, Evan Huus eapa...@gmail.com wrote: Although it seems it's not working for me to download on my laptop - I need to figure out how to properly create/host/seed a torrent I guess... Evan On Fri, Feb 27, 2015 at 8:26 AM, Evan Huus eapa...@gmail.com wrote: I have a local copy that I grabbed by logging into the host server - I've created a torrent of it (attached) which I am currently seeding, so you should be able to grab it from me (and if you do, please seed to others in return!). Gerald hopefully this is OK, as far as I know all of the relevant captures are publicly available on Bugzilla or the wiki anyways. Evan P.S. This is a snapshot of the menagerie as of today, of course. On Fri, Feb 27, 2015 at 8:00 AM, Dario Lombardo dario.lombardo...@gmail.com wrote: On Fri, Feb 27, 2015 at 1:55 PM, Evan Huus eapa...@gmail.com wrote: I'm not sure if there is a more convenient way to download the entire menagerie available to the general public. Who can know that? Gerald maybe? It would be very useful when conducting large scale tests to have access to a local copy of them, just like the buildbot. ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org ?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org ?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
1.8 GB I think it's a routing problem, not a torrent problem, I probably need to open a hole in my firewall or something. I'm at work now anyways, so I'll look at it again tonight unless somebody beats me to it. Evan On Fri, Feb 27, 2015 at 9:07 AM, Dario Lombardo dario.lombardo...@gmail.com wrote: Should be supported by your torrent client (maybe create torrent or something). Once you succeded, send us the torrent. How large it is? On Fri, Feb 27, 2015 at 2:42 PM, Evan Huus eapa...@gmail.com wrote: Although it seems it's not working for me to download on my laptop - I need to figure out how to properly create/host/seed a torrent I guess... Evan On Fri, Feb 27, 2015 at 8:26 AM, Evan Huus eapa...@gmail.com wrote: I have a local copy that I grabbed by logging into the host server - I've created a torrent of it (attached) which I am currently seeding, so you should be able to grab it from me (and if you do, please seed to others in return!). Gerald hopefully this is OK, as far as I know all of the relevant captures are publicly available on Bugzilla or the wiki anyways. Evan P.S. This is a snapshot of the menagerie as of today, of course. On Fri, Feb 27, 2015 at 8:00 AM, Dario Lombardo dario.lombardo...@gmail.com wrote: On Fri, Feb 27, 2015 at 1:55 PM, Evan Huus eapa...@gmail.com wrote: I'm not sure if there is a more convenient way to download the entire menagerie available to the general public. Who can know that? Gerald maybe? It would be very useful when conducting large scale tests to have access to a local copy of them, just like the buildbot. ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
On Fri, Feb 27, 2015 at 1:55 PM, Evan Huus eapa...@gmail.com wrote: I'm not sure if there is a more convenient way to download the entire menagerie available to the general public. Who can know that? Gerald maybe? It would be very useful when conducting large scale tests to have access to a local copy of them, just like the buildbot. ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
Although it seems it's not working for me to download on my laptop - I need to figure out how to properly create/host/seed a torrent I guess... Evan On Fri, Feb 27, 2015 at 8:26 AM, Evan Huus eapa...@gmail.com wrote: I have a local copy that I grabbed by logging into the host server - I've created a torrent of it (attached) which I am currently seeding, so you should be able to grab it from me (and if you do, please seed to others in return!). Gerald hopefully this is OK, as far as I know all of the relevant captures are publicly available on Bugzilla or the wiki anyways. Evan P.S. This is a snapshot of the menagerie as of today, of course. On Fri, Feb 27, 2015 at 8:00 AM, Dario Lombardo dario.lombardo...@gmail.com wrote: On Fri, Feb 27, 2015 at 1:55 PM, Evan Huus eapa...@gmail.com wrote: I'm not sure if there is a more convenient way to download the entire menagerie available to the general public. Who can know that? Gerald maybe? It would be very useful when conducting large scale tests to have access to a local copy of them, just like the buildbot. ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
Should be supported by your torrent client (maybe create torrent or something). Once you succeded, send us the torrent. How large it is? On Fri, Feb 27, 2015 at 2:42 PM, Evan Huus eapa...@gmail.com wrote: Although it seems it's not working for me to download on my laptop - I need to figure out how to properly create/host/seed a torrent I guess... Evan On Fri, Feb 27, 2015 at 8:26 AM, Evan Huus eapa...@gmail.com wrote: I have a local copy that I grabbed by logging into the host server - I've created a torrent of it (attached) which I am currently seeding, so you should be able to grab it from me (and if you do, please seed to others in return!). Gerald hopefully this is OK, as far as I know all of the relevant captures are publicly available on Bugzilla or the wiki anyways. Evan P.S. This is a snapshot of the menagerie as of today, of course. On Fri, Feb 27, 2015 at 8:00 AM, Dario Lombardo dario.lombardo...@gmail.com wrote: On Fri, Feb 27, 2015 at 1:55 PM, Evan Huus eapa...@gmail.com wrote: I'm not sure if there is a more convenient way to download the entire menagerie available to the general public. Who can know that? Gerald maybe? It would be very useful when conducting large scale tests to have access to a local copy of them, just like the buildbot. ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org ?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org ?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
The menagerie consists mostly of files uploaded to bugzilla. Captures attached to bug tickets are automatically added to the menagerie, and most files in the menagerie can be downloaded from a bug report somewhere. I'm not sure if there is a more convenient way to download the entire menagerie available to the general public. Adding files is as easy as filing a dummy bug and attaching files to that. On Feb 27, 2015, at 05:41, Dario Lombardo dario.lombardo...@gmail.com wrote: Browsing the buildbot site, I've read somewhere about menagerie. I suppose it is a large set of file that is used as regression test. Is it correct? Is it possible to download it? And to upload new samples to it? Thanks. Dario. ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
On Fri, Feb 27, 2015 at 3:19 PM, Ed Beroset bero...@mindspring.com wrote: From the originally sent torrent, it seems to be 1.88G. I'm interested in this too and could seed pretty much perpetually once we get it started. I would rather prefer a rsync-compatible interface. The scenario I'm figuring out is that a devel downloads the entire set the first time, then just downloads the new files. Rsync would be perfect for that. ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
Dario Lombardo wrote: Should be supported by your torrent client (maybe create torrent or something). Once you succeded, send us the torrent. How large it is? From the originally sent torrent, it seems to be 1.88G. I'm interested in this too and could seed pretty much perpetually once we get it started. Ed ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
Evan Huus eapache@... writes: I have a local copy that I grabbed by logging into the host server - I've created a torrent of it (attached) which I am currently seeding, so you should be able to grab it from me (and if you do, please seed to others in return!). Gerald hopefully this is OK, as far as I know all of the relevant captures are publicly available on Bugzilla or the wiki anyways. Evan P.S. This is a snapshot of the menagerie as of today, of course. I believe some of the capture files have been marked as private and should not be distributed. At the very least, I would recommend holding off on publishing any torrent until that can be verified. Also, some time ago, the folks at cloudshark offered a cloudshark appliance to the Wireshark project. I would much rather see Wireshark take advantage of something like that than making the menagerie capture files in a way such as this or how Jakub did years ago. - Chris See also: http://goo.gl/oixnSm ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
Re: [Wireshark-dev] Menagerie
On Fri, Feb 27, 2015 at 10:20 AM, Christopher Maynard christopher.mayn...@gtech.com wrote: Evan Huus eapache@... writes: I have a local copy that I grabbed by logging into the host server - I've created a torrent of it (attached) which I am currently seeding, so you should be able to grab it from me (and if you do, please seed to others in return!). Gerald hopefully this is OK, as far as I know all of the relevant captures are publicly available on Bugzilla or the wiki anyways. Evan P.S. This is a snapshot of the menagerie as of today, of course. I believe some of the capture files have been marked as private and should not be distributed. At the very least, I would recommend holding off on publishing any torrent until that can be verified. They are still publicly exposed every time the fuzz-bot finds a bug in our dissection of one of them (unless it knows which ones those are, and files the bugs as core-only)? If they are truly private, they should be moved to a separate part of the menagerie that is not fuzzed regularly. Also, some time ago, the folks at cloudshark offered a cloudshark appliance to the Wireshark project. I would much rather see Wireshark take advantage of something like that than making the menagerie capture files in a way such as this or how Jakub did years ago. That would certainly be more convenient. - Chris See also: http://goo.gl/oixnSm ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe ___ Sent via:Wireshark-dev mailing list wireshark-dev@wireshark.org Archives:http://www.wireshark.org/lists/wireshark-dev Unsubscribe: https://wireshark.org/mailman/options/wireshark-dev mailto:wireshark-dev-requ...@wireshark.org?subject=unsubscribe
