Re: [Wikimedia-l] images deletedfrom WikiCommons
Great move WMIL. This is I think an excellent example of great chapter work. Greetings Ting Am 29.12.2013 06:19, schrieb Michal Lester: Hi, As some of you know, images are been deleted in the past month from WikiCommons due to a change in the ruling of the United States Supreme Court. (The case of Golan v. Holder, confirming the legality of the URAA, has restored copyright status to foreign works that were placed in the public domain after January 1, 1996). Court ruling brought WikiCommons volunteers to delete images that do not meet the new guideline. Consequently, Israeli images were deleted even though the Israeli law releases them into the public domain. We wrote to the legal department of the Foundation to alert about the situation. The department has posted a legal opinionhttps://meta.wikimedia.org/wiki/Wikilegal/Use_of_Foreign_Works_Restored_under_the_URAA_on_Commons on the subject following our inquiry. WMIL is going to turn to the Minister of Justice and seek for written statement that confirm that images released by the State of Israel to the public domain may be used freely around the world. We hope that WikiCommons operators rely on the letter and will not delete more images. It will be great if other chapters will update if they encountered the problem and what you intend to do. All the best Michal ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
[Wikimedia-l] Dells are backdored
Can we please stop paying the Microsoft and NSA taxes and start buying datacenter equipment which costs a lot less? Cubieboard/Cubietrucks for instance? Ref.: http://www.spiegel.de/international/world/catalog-reveals-nsa-has-back-doors-for-numerous-devices-a-940994.html Best regards, James ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
On 29 December 2013 12:55, James Salsman jsals...@gmail.com wrote: Can we please stop paying the Microsoft and NSA taxes The WMF doesn't. and start buying datacenter equipment which costs a lot less? Cubieboard/Cubietrucks for instance? Ref.: http://www.spiegel.de/international/world/catalog-reveals-nsa-has-back-doors-for-numerous-devices-a-940994.html Best regards, James Using non standard data center equipment is a great way to add costs. As for security given the limited resources the WMF has whenever GCHQ, FSB and MSS have wanted to get in they have and there is nothing we can do about this. ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
On Sun, Dec 29, 2013 at 5:17 AM, geni geni...@gmail.com wrote: On 29 December 2013 12:55, James Salsman jsals...@gmail.com wrote: Can we please stop paying the Microsoft and NSA taxes The WMF doesn't. and start buying datacenter equipment which costs a lot less? Cubieboard/Cubietrucks for instance? Ref.: http://www.spiegel.de/international/world/catalog-reveals-nsa-has-back-doors-for-numerous-devices-a-940994.html Best regards, James Using non standard data center equipment is a great way to add costs. Naw, it's a great idea. Let's switch to building our own ARM-based servers (by the way, which have already been a flop commercially), using only unproven, low-volume available motherboards and having to buy and assemble all of the rest of the components. And then of course, we need to design our own cases... and since these have such a low performance, we'll need to have a lot more rack and datacenter space, of course which comes with a cost... and we'll have to figure out how to run our caching layers which require large amounts of memory... and our storage layers which require large amounts of disk space. At that point we'll probably need to redesign those boards which are incapable of doing these things, so we'll need a team of hardware engineers, plus a deal with a manufacturing plant. So... I think with about a 100 million dollar per year research budget we can do this. Who's ponying up? ;) As for security given the limited resources the WMF has whenever GCHQ, FSB and MSS have wanted to get in they have and there is nothing we can do about this. ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe -- Leslie Carr Wikimedia Foundation AS 14907, 43821 http://as14907.peeringdb.com/ ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
On Sun, Dec 29, 2013 at 4:55 AM, James Salsman jsals...@gmail.com wrote: Can we please stop paying the Microsoft and NSA taxes and start buying datacenter equipment which costs a lot less? Cubieboard/Cubietrucks for instance? Ref.: http://www.spiegel.de/international/world/catalog-reveals-nsa-has-back-doors-for-numerous-devices-a-940994.html Cubie are not credible enterprise-grade hardware; having made the suggestion indicates you don't understand what large server farm design and operations are all about. One can see signs of a movement towards enterprise-grade lower power CPU systems such as Atom, ARM, and Via chip mini-servers. It's not there yet. Both hardware and OS issues with the ARMs, and hardware with the others. -- -george william herbert george.herb...@gmail.com ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
2013/12/29 Leslie Carr lc...@wikimedia.org On Sun, Dec 29, 2013 at 5:17 AM, geni geni...@gmail.com wrote: On 29 December 2013 12:55, James Salsman jsals...@gmail.com wrote: Can we please stop paying the Microsoft and NSA taxes The WMF doesn't. and start buying datacenter equipment which costs a lot less? Cubieboard/Cubietrucks for instance? Ref.: http://www.spiegel.de/international/world/catalog-reveals-nsa-has-back-doors-for-numerous-devices-a-940994.html Best regards, James Using non standard data center equipment is a great way to add costs. Naw, it's a great idea. Let's switch to building our own ARM-based servers (by the way, which have already been a flop commercially), using only unproven, low-volume available motherboards and having to buy and assemble all of the rest of the components. And then of course, we need to design our own cases... and since these have such a low performance, we'll need to have a lot more rack and datacenter space, of course which comes with a cost... and we'll have to figure out how to run our caching layers which require large amounts of memory... and our storage layers which require large amounts of disk space. At that point we'll probably need to redesign those boards which are incapable of doing these things, so we'll need a team of hardware engineers, plus a deal with a manufacturing plant. So... I think with about a 100 million dollar per year research budget we can do this. Who's ponying up? ;) Funny huh? If we use free software, I don't see why we can't move to open-source hardware ASAP. As for security given the limited resources the WMF has whenever GCHQ, FSB and MSS have wanted to get in they have and there is nothing we can do about this. ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe -- Leslie Carr Wikimedia Foundation AS 14907, 43821 http://as14907.peeringdb.com/ ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
On Sun, Dec 29, 2013 at 2:25 PM, Emilio J. Rodríguez-Posada emi...@gmail.com wrote: Naw, it's a great idea. Let's switch to building our own ARM-based servers (by the way, which have already been a flop commercially), using only unproven, low-volume available motherboards and having to buy and assemble all of the rest of the components. And then of course, we need to design our own cases... and since these have such a low performance, we'll need to have a lot more rack and datacenter space, of course which comes with a cost... and we'll have to figure out how to run our caching layers which require large amounts of memory... and our storage layers which require large amounts of disk space. At that point we'll probably need to redesign those boards which are incapable of doing these things, so we'll need a team of hardware engineers, plus a deal with a manufacturing plant. So... I think with about a 100 million dollar per year research budget we can do this. Who's ponying up? ;) Funny huh? If we use free software, I don't see why we can't move to open-source hardware ASAP. Well, I think Leslie just listed a few, but I'll recap: - low-availability - Requires in house assembly - Requires in house design capacity - Substantially more rack and datacenter space required - Insufficient for caching and storage layers - Cost of manufacturing. pb ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Copyright URAA trolls on Wikimedia Commons
On 29 Dec 2013 22:43, Klaus Graf klausg...@googlemail.com wrote: Can nobody stop the URAA Copyright trolls mass deleting perfect fine files on Commons? I think it would be the best if _all_ URAA affected files would be kept until a DMCA take down notice. Your proposal would be more useful made with the Commons community rather than this email list. Fae ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Copyright URAA trolls on Wikimedia Commons
On Sun, Dec 29, 2013 at 2:43 PM, Klaus Graf klausg...@googlemail.comwrote: But in the case of in the country of origin PD works which are foreign government works it is needed that the WMF clearly speaks out https://meta.wikimedia.org/wiki/Wikilegal/Use_of_Foreign_Works_Restored_under_the_URAA_on_Commons --- like that? pb *Philippe Beaudette * \\ Director, Community Advocacy \\ Wikimedia Foundation, Inc. T: 1-415-839-6885 x6643 | phili...@wikimedia.org | : @Philippewikihttps://twitter.com/Philippewiki ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
On 29/12/2013 22:41, Philippe Beaudette wrote: On Sun, Dec 29, 2013 at 2:25 PM, Emilio J. Rodríguez-Posada emi...@gmail.com wrote: Naw, it's a great idea. Let's switch to building our own ARM-based servers (by the way, which have already been a flop commercially), using only unproven, low-volume available motherboards and having to buy and assemble all of the rest of the components. And then of course, we need to design our own cases... and since these have such a low performance, we'll need to have a lot more rack and datacenter space, of course which comes with a cost... and we'll have to figure out how to run our caching layers which require large amounts of memory... and our storage layers which require large amounts of disk space. At that point we'll probably need to redesign those boards which are incapable of doing these things, so we'll need a team of hardware engineers, plus a deal with a manufacturing plant. So... I think with about a 100 million dollar per year research budget we can do this. Who's ponying up? ;) Funny huh? If we use free software, I don't see why we can't move to open-source hardware ASAP. Well, I think Leslie just listed a few, but I'll recap: - low-availability - Requires in house assembly - Requires in house design capacity - Substantially more rack and datacenter space required - Insufficient for caching and storage layers - Cost of manufacturing. Add to the list people that know what they are doing. ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Copyright URAA trolls on Wikimedia Commons
On Dec 29, 2013 5:51 PM, Fæ faewik+comm...@gmail.com wrote: On 29 Dec 2013 22:43, Klaus Graf klausg...@googlemail.com wrote: I think it would be the best if _all_ URAA affected files would be kept until a DMCA take down notice. Your proposal would be more useful made with the Commons community Both excellent suggestions. Sam. ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
On 29/12/13 23:55, James Salsman wrote: Can we please stop paying the Microsoft and NSA taxes and start buying datacenter equipment which costs a lot less? Cubieboard/Cubietrucks for instance? Ref.: http://www.spiegel.de/international/world/catalog-reveals-nsa-has-back-doors-for-numerous-devices-a-940994.html That article doesn't say Dell equipment has a back door, it just says that there is surveillance software or hardware designed to work with Dell equipment. It doesn't even say that Dell equipment is especially vulnerable. There is no information in the documents seen by SPIEGEL to suggest that the companies whose products are mentioned in the catalog provided any support to the NSA or even had any knowledge of the intelligence solutions. -- Tim Starling ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Copyright URAA trolls on Wikimedia Commons
I'm sorry about your problem Klaus, however I think that you won't get anywhere by calling people trolls. 2013/12/30 Samuel Klein meta...@gmail.com On Dec 29, 2013 5:51 PM, Fæ faewik+comm...@gmail.com wrote: On 29 Dec 2013 22:43, Klaus Graf klausg...@googlemail.com wrote: I think it would be the best if _all_ URAA affected files would be kept until a DMCA take down notice. Your proposal would be more useful made with the Commons community Both excellent suggestions. Sam. ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe -- Pierre-Selim ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
The WMF's servers have nothing to do with Microsoft. There do exist alternative processor architectures, not even just ARM (Itanium (probably too expensive), Tilera (massively parallel)), but I don't think migrating our software (particularly Labs' virtualization-related software) to them is trivial. One should also ask whether the NSA is snooping on our transit links and our peering IXPs (Google is encrypting their own fiber, as well as their transit links, for that reason). On Sun, Dec 29, 2013 at 4:55 AM, James Salsman jsals...@gmail.com wrote: Can we please stop paying the Microsoft and NSA taxes and start buying datacenter equipment which costs a lot less? Cubieboard/Cubietrucks for instance? Ref.: http://www.spiegel.de/international/world/catalog-reveals-nsa-has-back-doors-for-numerous-devices-a-940994.html Best regards, James ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
When this came up last time, it turned out that there was some kind of a deal in place, and certainly many if not most published pictures of the Wikimedia data center feature rows of shiny Dell logos. But Dell does support Microsoft and the NSA, obviously, and also supports some very creative accounting methods to avoid paying taxes with tax havens. Dell's corporate structure adventures are not the sort of corporate behavior concordant with a mission to empower anyone other than Dell stockholders. If you don't like Cubietrucks, then how about RADXA? At least with http://dl.radxa.com/rock/docs/hw/RADXA_ROCK_schematic_20130903.pdf you know exactly what you're getting and it doesn't cost a huge power bill. We still failover when machines go out of service, and sure the caches would have different RAM configurations, but the fact is it doesn't cost more money to switch to ARM, and you jettison a bunch of legacy x86 crap that nobody uses but take millions of transistors which need to be powered. Why ask our donors to keep all those useless transistors warm? And as much as I personally appreciate Wikimedia staff, I am inclined to agree with the sentiment that perhaps we should hire more staff until we get some who believe that it wouldn't cost $100,000 to transition to less expensive hardware. And maybe some people who know how to order chassis? Best regards, James ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
*And as much as I personally appreciate Wikimedia staff, I am inclined* *to agree with the sentiment that perhaps we should hire more staff until we get some who believe that it wouldn't cost $100,000 totransition to less expensive hardware. And maybe some people who know how to order chassis?* What makes you think they don't? Dan Rosenthal On Sun, Dec 29, 2013 at 10:55 PM, James Salsman jsals...@gmail.com wrote: When this came up last time, it turned out that there was some kind of a deal in place, and certainly many if not most published pictures of the Wikimedia data center feature rows of shiny Dell logos. But Dell does support Microsoft and the NSA, obviously, and also supports some very creative accounting methods to avoid paying taxes with tax havens. Dell's corporate structure adventures are not the sort of corporate behavior concordant with a mission to empower anyone other than Dell stockholders. If you don't like Cubietrucks, then how about RADXA? At least with http://dl.radxa.com/rock/docs/hw/RADXA_ROCK_schematic_20130903.pdf you know exactly what you're getting and it doesn't cost a huge power bill. We still failover when machines go out of service, and sure the caches would have different RAM configurations, but the fact is it doesn't cost more money to switch to ARM, and you jettison a bunch of legacy x86 crap that nobody uses but take millions of transistors which need to be powered. Why ask our donors to keep all those useless transistors warm? And as much as I personally appreciate Wikimedia staff, I am inclined to agree with the sentiment that perhaps we should hire more staff until we get some who believe that it wouldn't cost $100,000 to transition to less expensive hardware. And maybe some people who know how to order chassis? Best regards, James ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
but the fact is it doesn't cost more money to switch to ARM, and you jettison a bunch of legacy x86 crap that nobody uses but take millions of transistors which need to be powered. ARM is not compatible with a lot of our software, and besides if we really wanted power efficiency we could instead buy Intel's 14nm chips. Virtualization also helps. New servers always cost a lot, and it's not trivial to switch over hundreds of boxes. That's because you're not going to make ARM CPUs work as drop-in replacements. On Sun, Dec 29, 2013 at 7:55 PM, James Salsman jsals...@gmail.com wrote: When this came up last time, it turned out that there was some kind of a deal in place, and certainly many if not most published pictures of the Wikimedia data center feature rows of shiny Dell logos. But Dell does support Microsoft and the NSA, obviously, and also supports some very creative accounting methods to avoid paying taxes with tax havens. Dell's corporate structure adventures are not the sort of corporate behavior concordant with a mission to empower anyone other than Dell stockholders. If you don't like Cubietrucks, then how about RADXA? At least with http://dl.radxa.com/rock/docs/hw/RADXA_ROCK_schematic_20130903.pdf you know exactly what you're getting and it doesn't cost a huge power bill. We still failover when machines go out of service, and sure the caches would have different RAM configurations, but the fact is it doesn't cost more money to switch to ARM, and you jettison a bunch of legacy x86 crap that nobody uses but take millions of transistors which need to be powered. Why ask our donors to keep all those useless transistors warm? And as much as I personally appreciate Wikimedia staff, I am inclined to agree with the sentiment that perhaps we should hire more staff until we get some who believe that it wouldn't cost $100,000 to transition to less expensive hardware. And maybe some people who know how to order chassis? Best regards, James ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
On 30/12/13 14:55, James Salsman wrote: If you don't like Cubietrucks, then how about RADXA? At least with http://dl.radxa.com/rock/docs/hw/RADXA_ROCK_schematic_20130903.pdf you know exactly what you're getting and it doesn't cost a huge power bill. Maximum 100 Mbps ethernet connection. Also, it doesn't exist yet. We still failover when machines go out of service, and sure the caches would have different RAM configurations, but the fact is it doesn't cost more money to switch to ARM, and you jettison a bunch of legacy x86 crap that nobody uses but take millions of transistors which need to be powered. Why ask our donors to keep all those useless transistors warm? Are there some benchmarks which support this idea? I read http://armservers.com/2012/06/18/apache-benchmarks-for-calxedas-5-watt-web-server/ But it was full of distortions, like comparing the actual power usage of the ARM system with the TDP of the Intel system, and then using a workload which saturated the network link of the Intel system versus the CPU of the ARM system. Maybe this sort of fluff is part of the reason why Calxeda went bust. Marketing materials on Calxeda's website indicated that the system was priced such that it would be more expensive than Intel on a per-MIPS basis, but that you'd win in the long run through reduced power bills. It didn't sound like a cheap solution to me. I read this: http://www.theregister.co.uk/2013/12/13/facebook_arm_chips/ But it was clear that it was only at a prototype stage -- the benchmarks are not in yet because the development work needs to be done first. I read this: http://www.theregister.co.uk/2013/12/16/google_intel_arm_analysis/ which speculated that Xeon may still be better for CPU-intensive tasks, and ARM chips may be useful for storage control. But a Cubieboard or Radxa can't be used for storage, since they lack the necessary high-bandwidth connections. Leslie Carr wrote: At that point we'll probably need to redesign those boards which are incapable of doing these things, so we'll need a team of hardware engineers, plus a deal with a manufacturing plant. Google and Facebook are apparently taking that route. Maybe some day, this technology will be available for anyone to buy. -- Tim Starling ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
On Dec 29, 2013, at 9:11 PM, Tim Starling tstarl...@wikimedia.org wrote: Leslie Carr wrote: At that point we'll probably need to redesign those boards which are incapable of doing these things, so we'll need a team of hardware engineers, plus a deal with a manufacturing plant. Google and Facebook are apparently taking that route. Maybe some day, this technology will be available for anyone to buy. -- Tim Starling One hears rumors of enterprise grade hardware manufacturers floating product ideas to customers (cough) but rumors persist that paying customers actually calculate bandwidth issues for their applications and generally say no. The ones who say yes tend to be academics in strange corners of the money / compute cluster CPU vs IO trade space, and are ok with building their own. -george william herbert george.herb...@gmail.com Sent from Kangphone ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
It's not like we have anything special (or x86-specific, Jasper!) other than very high bandwidth. Wikimedia Labs uses x86 hardware virtualization (just one example). We already have transit linkages that include fiber, and new fiber is far from cheap. You persist in ignoring the costs of buying equipment. In terms of orders of magnitude, ~500 servers * $200 per server = $100,000 already. That is a conservative $200/server estimate that also doesn't take into account labor and other costs. To the level we'd want it, it's at least one more order of magnitude more expensive (no, we're not going to recover the costs by selling our existing servers). On Sun, Dec 29, 2013 at 10:10 PM, James Salsman jsals...@gmail.com wrote: Maximum 100 Mbps ethernet connection We should be using fiber, which also costs less power and is orders of magnitude faster. If the words enterprise-class actually mean something more than much larger markup than purchasing components then go with something like http://www.marvell.com/company/news/pressDetail.do?releaseID=3576 For example, maybe the http://www.mitac.com/business/gfx_servers.html people have benchmarks representative of our DB/cache usage patterns. It's not like we have anything special (or x86-specific, Jasper!) other than very high bandwidth. At least put out an RFP, please. ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
... Wikimedia Labs uses x86 hardware virtualization (just one example) How does that tie us to x86? http://www.eweek.com/servers/arm-server-chips-get-xen-virtualization-support/ ... a conservative $200/server estimate I have been recommending hardware which costs closer to $70 per server depending on storage and cache architecture options. ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
How does that tie us to x86? We don't use Xen, nor is that guaranteed to give us acceptable performance. closer to $70 Please justify that claim (that would be the cost of the CPU or hard disk alone). You haven't even given us a compelling reason to spend any money at all on this. On Sun, Dec 29, 2013 at 10:25 PM, James Salsman jsals...@gmail.com wrote: ... Wikimedia Labs uses x86 hardware virtualization (just one example) How does that tie us to x86? http://www.eweek.com/servers/arm-server-chips-get-xen-virtualization-support/ ... a conservative $200/server estimate I have been recommending hardware which costs closer to $70 per server depending on storage and cache architecture options. ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
[Wikimedia-l] Data privacy, encrypted links and recent change captures
We know NSA wants Wikipedia data, as Wikipedia is listed in one of the NSA slides: https://commons.wikimedia.org/wiki/File:KS8-001.jpg That slide is about HTTP, and the tech staff are moving the user/reader base to HTTPS. As we learn more about the NSA programs, we need to consider vectors other than HTTP for the NSA to obtain the data they want. And the userbase needs to be aware of the current risks. One question from the Dells are backdored[sic] thread that is worth separate consideration is: Are the Wikimedia transit links encrypted, especially for database replication? MySQL has replication over SSL, so I assume the answer is Yes. If not, is this necessary or useful, and feasible ? However we also need to consider that SSL and other encryption may be useless against NSA/etc, which means replicating non-public data should be avoided wherever possible, as it becomes a single point of failure. Given how public our system is, we don't have a lot of non-public data, so we might be able to design the architecture so that information isnt replicated, and also ensure it isnt accessed over insecure links. I think the only parts of the dataset that are private valuable are * passwords/login cookies, * checkuser info - IPs and useragents, * WMF analytics, which includes readers iirc, and * hidden/deleted edits * private wikis and mailing lists Have I missed any? Are passwords and/or checkuser info replicated? Is there a data policy on WMF analytics data which prevents it flowing over insecure links, and limits what is collected and ensures destruction of the data within reasonable timeframes? i.e. how about not using cookies to track analytics of readers who are on HTTP instead of HTTPS? The private wikis can be restricted to https, depending on the value of the data on those wikis in the wrong hands. The private mailing lists will be harder to secure, and at least the English Wikipedia arbcom list contain a lot of valuable data about contributors. Regarding hidden/deleted edits, the replication isnt the only source of this data. All edits are also exposed via Recent Changes (https/api/etc) as they occur, and the value of these edits is determined by the fact they are hidden afterwards (e.g. don't appear in dumps). Is there any way to control who is effectively capturing all edits via Recent Changes? -- John Vandenberg ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Data privacy, encrypted links and recent change captures
SSL makes it more difficult; some private wikis are already restricted to SSL. We also have to consider that irc.wikimedia.org has a recent changes feed. At minimum, the transit links should be encrypted if feasible. A good reason not to encrypt is that it's extra performance overhead. On Sun, Dec 29, 2013 at 11:10 PM, John Vandenberg jay...@gmail.com wrote: We know NSA wants Wikipedia data, as Wikipedia is listed in one of the NSA slides: https://commons.wikimedia.org/wiki/File:KS8-001.jpg That slide is about HTTP, and the tech staff are moving the user/reader base to HTTPS. As we learn more about the NSA programs, we need to consider vectors other than HTTP for the NSA to obtain the data they want. And the userbase needs to be aware of the current risks. One question from the Dells are backdored[sic] thread that is worth separate consideration is: Are the Wikimedia transit links encrypted, especially for database replication? MySQL has replication over SSL, so I assume the answer is Yes. If not, is this necessary or useful, and feasible ? However we also need to consider that SSL and other encryption may be useless against NSA/etc, which means replicating non-public data should be avoided wherever possible, as it becomes a single point of failure. Given how public our system is, we don't have a lot of non-public data, so we might be able to design the architecture so that information isnt replicated, and also ensure it isnt accessed over insecure links. I think the only parts of the dataset that are private valuable are * passwords/login cookies, * checkuser info - IPs and useragents, * WMF analytics, which includes readers iirc, and * hidden/deleted edits * private wikis and mailing lists Have I missed any? Are passwords and/or checkuser info replicated? Is there a data policy on WMF analytics data which prevents it flowing over insecure links, and limits what is collected and ensures destruction of the data within reasonable timeframes? i.e. how about not using cookies to track analytics of readers who are on HTTP instead of HTTPS? The private wikis can be restricted to https, depending on the value of the data on those wikis in the wrong hands. The private mailing lists will be harder to secure, and at least the English Wikipedia arbcom list contain a lot of valuable data about contributors. Regarding hidden/deleted edits, the replication isnt the only source of this data. All edits are also exposed via Recent Changes (https/api/etc) as they occur, and the value of these edits is determined by the fact they are hidden afterwards (e.g. don't appear in dumps). Is there any way to control who is effectively capturing all edits via Recent Changes? -- John Vandenberg ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdored
Putting aside the 'tax' aspect, whether or not there is a backdoor in the shipped product is not the point of the article you linked to James. NSA is intercepting hardware deliveries and adding backdoors while it is enroute from supplier to customer. Buying new equipment gives NSA a new opportunity to inject backdoors unless WMF has staff watching the entire manufacturing and delivery process. The latest revelations give details of only a few of NSAs capabilities. Eliminating the now known threats, and all the other possible vectors is not feasible. A more sensible strategy is to put perimeters around sets of private data, and watch your own equipment for unusual activity, with more focus on outbound than was previously thought necessary by most organisations. The extreme end is using trusted operating systems, tagging all data and network interfaces software preventing unapproved data transits. WMF already has serious network traffic analytics and monitoring. Maybe some more rules and alerts are needed, but everyone is reviewing how suspicious they should be of their 'own' internal equipment now. On Dec 29, 2013 7:56 PM, James Salsman jsals...@gmail.com wrote: Can we please stop paying the Microsoft and NSA taxes and start buying datacenter equipment which costs a lot less? Cubieboard/Cubietrucks for instance? Ref.: http://www.spiegel.de/international/world/catalog-reveals-nsa-has-back-doors-for-numerous-devices-a-940994.html Best regards, James ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
Re: [Wikimedia-l] Dells are backdoored
Jasper, if you can't write an email or pick up the phone asking for a hardware quote without supporting the status quo of the Foundation datacenter being a monument to the poster boy of corporate tax abuses, Microsoft OEM bundling abuses, and NSA collaboration, I really can't help you. If you're interested in what the long term savings can look like, see: http://www.cnx-software.com/2010/11/16/arm-based-embedded-servers-marvell-armada-xp/ ___ Wikimedia-l mailing list Wikimedia-l@lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, mailto:wikimedia-l-requ...@lists.wikimedia.org?subject=unsubscribe
