Re: Liran Zvibel of WekaIO on using D to Create the World’s Fastest File System
On 06/12/2018 12:35 PM, aliak wrote: On Wednesday, 5 December 2018 at 23:18:12 UTC, rikki cattermole wrote: On 06/12/2018 10:18 AM, aliak wrote: "Weka is a name of a Machine learning product from New Zealand. Weka is the company that produced Lord of the Rings here in NZ. *Weta. Bless them :D Weka is a set of ML tools from waikato uni => https://www.cs.waikato.ac.nz/ml/weka/ Woops I should know better even after an all nighter. After all, I've known people that worked there! Kinda like with that Jade/Diet fiasco a while back.
Re: Liran Zvibel of WekaIO on using D to Create the World’s Fastest File System
On Wednesday, 5 December 2018 at 23:18:12 UTC, rikki cattermole wrote: On 06/12/2018 10:18 AM, aliak wrote: "Weka is a name of a Machine learning product from New Zealand. Weka is the company that produced Lord of the Rings here in NZ. *Weta. Bless them :D Weka is a set of ML tools from waikato uni => https://www.cs.waikato.ac.nz/ml/weka/
Re: Liran Zvibel of WekaIO on using D to Create the World’s Fastest File System
On 06/12/2018 10:18 AM, aliak wrote: "Weka is a name of a Machine learning product from New Zealand. Weka is the company that produced Lord of the Rings here in NZ. It is also a bird! (which makes WekaIO's name a bit weird). http://nzbirdsonline.org.nz/species/weka
Re: Interview with Liran Zvibel of WekaIO
On Wednesday, 5 December 2018 at 13:30:21 UTC, Joakim wrote: On Wednesday, 5 December 2018 at 08:02:21 UTC, M.M. wrote: [...] All three compilers listed on the official download page use the same frontend, written in D: [...] This explains pretty much everything I wanted to know but was afraid to ask. Happy to hear about the backporting to LDC as well...
Re: Liran Zvibel of WekaIO on using D to Create the World’s Fastest File System
On Wednesday, 5 December 2018 at 19:59:46 UTC, Joakim wrote: On Wednesday, 5 December 2018 at 09:04:49 UTC, Walter Bright wrote: #4 on HackerNews front page! https://news.ycombinator.com/ 33 points at the moment! Now one of the top-voted links on the front page of HN. I'd just like to point out that Andrei put Liran and I together to do this interview in summer '17- though I had emailed Liran about doing one in '15 and never got a response- and he finally got some time to respond this summer. Now I just need Andrei to finally do an interview, which he's been putting off for even longer. :) Awesome work! Question about one of the comments, because I don't understand the hardware aspect of things. this one: https://news.ycombinator.com/item?id=18607297 Pasted here: "Weka is a name of a Machine learning product from New Zealand. The IBM system had 24xHGST N200 SSD, 830 000 random read, 200 000 random write. that is 24 * 200 000 IOPS=4.8Million random writes. The Matrix system had 64x1.2TB Micron 9100 SSDs. 750 000 random read, 300 random writes. 64 * 300 000=19.2 Million IOPS Ok so you have benchmarked hardware with 4.8 Million write ops vs 19.2 Million write ops." Anyone know if that last line is correct?
Re: Liran Zvibel of WekaIO on using D to Create the World’s Fastest File System
On Wednesday, 5 December 2018 at 09:04:49 UTC, Walter Bright wrote: #4 on HackerNews front page! https://news.ycombinator.com/ 33 points at the moment! Now one of the top-voted links on the front page of HN. I'd just like to point out that Andrei put Liran and I together to do this interview in summer '17- though I had emailed Liran about doing one in '15 and never got a response- and he finally got some time to respond this summer. Now I just need Andrei to finally do an interview, which he's been putting off for even longer. :)
D is in GCC 9 proggit thread
For those who missed it: https://www.reddit.com/r/programming/comments/a30hg9/gcc_9_adds_frontend_support_for_the_d_programming/
Re: Interview with Liran Zvibel of WekaIO
On Wednesday, 5 December 2018 at 13:30:21 UTC, Joakim wrote: On Wednesday, 5 December 2018 at 08:02:21 UTC, M.M. wrote: On Tuesday, 4 December 2018 at 14:21:02 UTC, Mike Parker wrote: [...] Interesting read. I am new to dlang, and after reading the post, I asked myself: the company liked the language, but tweaked the compiler. Could the company now switch to one of the official compilers? If not, why? All three compilers listed on the official download page use the same frontend, written in D: https://dlang.org/download The LDC and GDC teams take that DMD frontend and attach it to the LLVM and GCC code-generation backends. As for Weka's tweaks, github shows these different commits from their last 1.11 release to the official tag: https://github.com/ldc-developers/ldc/compare/v1.11.0...weka-io:weka-2.071 Sorry, I compared the wrong Weka branch. Here's the right tag, shows fewer commits different: https://github.com/ldc-developers/ldc/compare/v1.11.0...weka-io:weka-v1.11
Re: Interview with Liran Zvibel of WekaIO
On Wednesday, 5 December 2018 at 08:02:21 UTC, M.M. wrote: On Tuesday, 4 December 2018 at 14:21:02 UTC, Mike Parker wrote: Joakim interviewed Liran for the D Blog about their file system, Matrix, and their use of D. Thanks to Joakim for putting it together, and to Liran for taking the time to participate! Blog: https://dlang.org/blog/2018/12/04/interview-liran-zvibel-of-wekaio/ Reddit: https://www.reddit.com/r/programming/comments/a3106x/interview_liran_zvibel_of_wekaio/ Interesting read. I am new to dlang, and after reading the post, I asked myself: the company liked the language, but tweaked the compiler. Could the company now switch to one of the official compilers? If not, why? All three compilers listed on the official download page use the same frontend, written in D: https://dlang.org/download The LDC and GDC teams take that DMD frontend and attach it to the LLVM and GCC code-generation backends. As for Weka's tweaks, github shows these different commits from their last 1.11 release to the official tag: https://github.com/ldc-developers/ldc/compare/v1.11.0...weka-io:weka-2.071 I get the sense that's mostly patches backported from newer LDC releases, as they understandably go slower than official LDC for stability, and some git cruft from maintaining their own branch. Their tweaks don't appear to be substantial on a skim, which makes sense since Johan is a committer on the LDC team. Since LDC is an OSS project, they're free to tweak it for their own use and use it as they like. Johan has done much work for them which they've contributed back upstream to LDC. See Johan's blog posts for more info: http://johanengelen.github.io
Re: Liran Zvibel of WekaIO on using D to Create the World’s Fastest File System
On Wednesday, 5 December 2018 at 09:04:49 UTC, Walter Bright wrote: #4 on HackerNews front page! https://news.ycombinator.com/ 33 points at the moment! It's on lobste.rs now too: https://lobste.rs/t/d Thanks, Atila!
Re: Liran Zvibel of WekaIO on using D to Create the World’s Fastest File System
On Wednesday, 5 December 2018 at 09:04:49 UTC, Walter Bright wrote: #4 on HackerNews front page! https://news.ycombinator.com/ 33 points at the moment! Fantastic, I want to get more commercial uses like this highlighted on the blog- started another interview now with a financial/ML firm using D- so nobody can say D isn't being used. BTW, the top HN comment asks for more detail: tell him to click on the DConf links in the post for Liran's slides and videos. There's a surfeit of tech detail there, this is just an overview to get people started on learning more.
Liran Zvibel of WekaIO on using D to Create the World’s Fastest File System
#4 on HackerNews front page! https://news.ycombinator.com/ 33 points at the moment!
Re: Interview with Liran Zvibel of WekaIO
On Wednesday, 5 December 2018 at 08:02:21 UTC, M.M. wrote: On Tuesday, 4 December 2018 at 14:21:02 UTC, Mike Parker wrote: Joakim interviewed Liran for the D Blog about their file system, Matrix, and their use of D. Thanks to Joakim for putting it together, and to Liran for taking the time to participate! Blog: https://dlang.org/blog/2018/12/04/interview-liran-zvibel-of-wekaio/ Reddit: https://www.reddit.com/r/programming/comments/a3106x/interview_liran_zvibel_of_wekaio/ Interesting read. I am new to dlang, and after reading the post, I asked myself: the company liked the language, but tweaked the compiler. Could the company now switch to one of the official compilers? If not, why? LDC _is_ an official compiler, they just use a slightly modified version of LDC (with LTO & PGO'd against their codebase). I
Re: Interview with Liran Zvibel of WekaIO
On Tuesday, 4 December 2018 at 14:21:02 UTC, Mike Parker wrote: Joakim interviewed Liran for the D Blog about their file system, Matrix, and their use of D. Thanks to Joakim for putting it together, and to Liran for taking the time to participate! Blog: https://dlang.org/blog/2018/12/04/interview-liran-zvibel-of-wekaio/ Reddit: https://www.reddit.com/r/programming/comments/a3106x/interview_liran_zvibel_of_wekaio/ Interesting read. I am new to dlang, and after reading the post, I asked myself: the company liked the language, but tweaked the compiler. Could the company now switch to one of the official compilers? If not, why?
