[julia-users] DataFrames' readtable very slow compared to R's read.csv when loading ~7.6M csv rows

2015-05-31 Thread veryluckyxyz
Facebook's Kaggle competition has a dataset with ~7.6e6 rows with 9 columns (mostly strings). https://www.kaggle.com/c/facebook-recruiting-iv-human-or-bot/data Loading the dataset in R using read.csv takes 5 minutes and the resulting dataframe takes 0.6GB (RStudio takes a total of 1.6GB memory

Re: [julia-users] julia on arm - some more progress

2015-05-31 Thread Seth
Adding the export failed with the same error. error during bootstrap: LoadError(at sysimg.jl line 278: LoadError(at constants.jl line 94: Base.AssertionError(msg=Float64(π) == Float64(big(π) On Saturday, May 30, 2015 at 8:59:32 PM UTC-7, Seth wrote: Nope: error during bootstrap:

Re: [julia-users] I'm lost (again)

2015-05-31 Thread Yichao Yu
On Sun, May 31, 2015 at 7:12 AM, Andreas Lobinger lobing...@gmail.com wrote: Hello colleague, On Sunday, May 31, 2015 at 1:00:54 PM UTC+2, Jameson wrote: The dlopen API in base changed last week and I have not had time to update Gtk.jl accordingly. I should be able to get back to soon

[julia-users] Did round() change in 0.4 in the last 5 days?

2015-05-31 Thread Seth
I can't figure this out, and I don't see any smoking gun. I have a test: @test round(y[1:3],4) == round([122.10760591498584, 159.0072453120582, 176.39547945994505], 4) that is working fine on my 5-day-old master (and on 0.3.9), but is failing on travis-nightly with ERROR: LoadError:

[julia-users] Re: Did round() change in 0.4 in the last 5 days?

2015-05-31 Thread Seth
Looking at this some more, it appears that #11356 https://github.com/JuliaLang/julia/issues/11356 may be the culprit. On Sunday, May 31, 2015 at 1:22:55 PM UTC-7, Seth wrote: I can't figure this out, and I don't see any smoking gun. I have a test: @test round(y[1:3],4) ==

Re: [julia-users] I'm lost (again)

2015-05-31 Thread Andreas Lobinger
On Sunday, May 31, 2015 at 5:41:29 PM UTC+2, Tim Holy wrote: https://github.com/JuliaLang/julia/issues/1334 Ah. Which could/should be raised in this v0.3/0.4/0.5 discussion. I see so many new features started, but basic error reporting should be rock-steady first. Before trying to give

Re: [julia-users] DataFrames' readtable very slow compared to R's read.csv when loading ~7.6M csv rows

2015-05-31 Thread Tim Holy
If you're using julia 0.3, you might want to try current master and/or possibly the ob/gctune branch. https://github.com/JuliaLang/julia/issues/10428 Best, --Tim On Sunday, May 31, 2015 09:50:03 AM verylucky...@gmail.com wrote: Facebook's Kaggle competition has a dataset with ~7.6e6 rows with

Re: [julia-users] Macros generating Functions

2015-05-31 Thread Yichao Yu
On Sun, May 31, 2015 at 8:48 AM, Tom Lee m...@tomlee.id.au wrote: No, in that example you create an anonymous function. I'm not certain on the semantics, but n effectively points to this nameless function. Anonymous functions are not as fast as generic ones (at least in 0.3, at least

Re: [julia-users] I'm lost (again)

2015-05-31 Thread Tim Holy
https://github.com/JuliaLang/julia/issues/1334 --Tim On Sunday, May 31, 2015 11:32:04 AM Yichao Yu wrote: On Sun, May 31, 2015 at 7:12 AM, Andreas Lobinger lobing...@gmail.com wrote: Hello colleague, On Sunday, May 31, 2015 at 1:00:54 PM UTC+2, Jameson wrote: The dlopen API in base

[julia-users] Re: I'm lost (again)

2015-05-31 Thread Andreas Lobinger
Hello colleague, On Sunday, May 31, 2015 at 2:37:14 PM UTC+2, Tobias Knopp wrote: Andreas, unfortunately the Gtk/Winston/Cairo thing got a little unstable during the last months. I tried two days a Winston/Gtk example and ran into the Graphics issue. in my native language we have an

Re: [julia-users] Re: example for ccall use and fortran

2015-05-31 Thread Eduardo Lenz
Hi I am using the dsplp subroutine (Linear Programming) from LINPACK. It is also in FORTRAN and I made a simple interface to use it in Julia. Although the data format used internally by the dsplp subroutine is diferent, I made the following function in julia to emulate the linpro package from

Re: [julia-users] DataFrames' readtable very slow compared to R's read.csv when loading ~7.6M csv rows

2015-05-31 Thread Jiahao Chen
Not ideal, but for now you can try turning off the garbage collection while reading in the DataFrame. gc_disable() df = DataFrames.readtable(bids.csv) gc_enable() Thanks, Jiahao Chen Research Scientist MIT CSAIL On Mon, Jun 1, 2015 at 1:36 AM, Tim Holy tim.h...@gmail.com wrote: If you're

[julia-users] Re: Ann: new parser library

2015-05-31 Thread David P. Sanders
El domingo, 31 de mayo de 2015, 19:52:34 (UTC+2), andrew cooke escribió: And we already have a rename. Now known as https://github.com/andrewcooke/ParComb.jl How about ParserCombinator.jl? On Sunday, 31 May 2015 11:16:43 UTC-3, andrew cooke wrote: There's a new parser library

[julia-users] Simple Conjugate Gradients coded in Julia is much faster than cholfact

2015-05-31 Thread Eduardo Lenz
Hi. One of my students is solving some large sparse systems (more than 20K equations). The coeficient matrix is symmetric and positive definite, with large sparsivity (1% of non zero elements in some cases). After playing around a little bit with cholfact we decided to compare the time with

[julia-users] Re: Did round() change in 0.4 in the last 5 days?

2015-05-31 Thread mequersat
The problem might lie in the round function, as evident with julia-0.4.0-bfa86480b8 (linux64) like so: round([1], 1) ERROR: TypeError: non-boolean (Array{Bool,1}) used in boolean context in round at floatfuncs.jl:143 in round at floatfuncs.jl:139 The following also doesn't work: julia

[julia-users] Re: Teaching Julia to an 8 year old (and a 12 year old)

2015-05-31 Thread Keith Campbell
Hey Scott, Just bumped across an old IJulia Notebook my 9-year old and I did last year. He was getting '24' problems (use +,-,*,/ with 4 numbers to make 24) and got one he swore couldn't be solved. We put together a little brute-force solver to test that out -- he was right.

[julia-users] Re: Did round() change in 0.4 in the last 5 days?

2015-05-31 Thread Seth
The problem appears to be in the recently introduced check to isfinite (line 143), which turns an array of things into an array of bool. On Sunday, May 31, 2015 at 2:53:48 PM UTC-7, MeQuerSat wrote: The problem might lie in the round function, as evident with julia-0.4.0-bfa86480b8 (linux64)

Re: [julia-users] Macros generating Functions

2015-05-31 Thread Tom Lee
I'll concede that if you know the function name at runtime, Mauro's solution may be a little cleaner, especially if it will be called a lot. There are plenty of examples in Base of @eval being used to define functions, such as lines 11-18 here:

[julia-users] Re: Ann: new parser library

2015-05-31 Thread andrew cooke
yeah, that might be better. i need to make dinner, but if i can't think of a reason not to by the time i have some more time, i guess i'll move again. thanks, andrew On Sunday, 31 May 2015 19:03:29 UTC-3, David P. Sanders wrote: El domingo, 31 de mayo de 2015, 19:52:34 (UTC+2), andrew

[julia-users] Re: Did round() change in 0.4 in the last 5 days?

2015-05-31 Thread Seth
The problem appears to be in the recently introduced check to isinf (line 143), which turns an array of things into an array of bool. On Sunday, May 31, 2015 at 2:53:48 PM UTC-7, MeQuerSat wrote: The problem might lie in the round function, as evident with julia-0.4.0-bfa86480b8 (linux64)

[julia-users] Re: Ann: new parser library

2015-05-31 Thread andrew cooke
OK https://github.com/andrewcooke/ParserCombinator.jl On Sunday, 31 May 2015 19:03:29 UTC-3, David P. Sanders wrote: El domingo, 31 de mayo de 2015, 19:52:34 (UTC+2), andrew cooke escribió: And we already have a rename. Now known as https://github.com/andrewcooke/ParComb.jl How

[julia-users] ANN: modifyField! routine

2015-05-31 Thread vavasis
Following up on an earlier discussion that I started in this newsgroup, I have written a small package that provides a routine to modify a field of an immutable object in the case that the object is inside a container. Please refer to: https://github.com/StephenVavasis/Modifyfield.jl

[julia-users] Re: request for feature: modify field in immutable object in a container

2015-05-31 Thread vavasis
I have now implemented a solution that follows Mauro's basic outline. The difference is that the heavy lifting in my code is done at compile-time instead of run-time so that modifyField! will have good performance even in an inner loop. Please see my announcement soon to be posted on

[julia-users] Re: Teaching Julia to an 8 year old (and a 12 year old)

2015-05-31 Thread Scott Jones
Great, when I get back to the States I'll show that to my son Alex... BTW, his science project when very well... I'll have to put up a gist with what he wrote... totally trivial, he just learned string interpolation, julia for loop syntax, print/println, using vectors, and using things like sum

Re: [julia-users] Re: request for feature: modify field in immutable object in a container

2015-05-31 Thread Scott Jones
On Tuesday, February 10, 2015 at 3:10:33 AM UTC+1, Jameson wrote: On Mon Feb 09 2015 at 7:59:20 PM ele...@gmail.com javascript: wrote: On Tuesday, February 10, 2015 at 1:25:15 AM UTC+11, Simon Danisch wrote: Someone else has to answer this. I suppose it's not that bad. The immutables

[julia-users] Re: Ann: new parser library

2015-05-31 Thread andrew cooke
And we already have a rename. Now known as https://github.com/andrewcooke/ParComb.jl On Sunday, 31 May 2015 11:16:43 UTC-3, andrew cooke wrote: There's a new parser library for Julia 0.3 and 0.4 - https://github.com/andrewcooke/SimpleParser.jl It's got some rough edges that I hope to

Re: [julia-users] Adding vectors in place using BLAS?

2015-05-31 Thread Gabriel Goh
sub! Just what I was looking for! it works like a charm On Saturday, May 30, 2015 at 3:35:50 PM UTC-7, Tim Holy wrote: Not tested, but xsub = sub(x, 10:20) Base.LinAlg.axpy!(a, y, xsub) should work just fine. --Tim On Saturday, May 30, 2015 02:35:01 PM Gabriel Goh wrote: Hey

Re: [julia-users] Multiple lines statement?

2015-05-31 Thread elextr
On Sunday, May 31, 2015 at 3:13:47 PM UTC+10, Alex Ames wrote: I lost multiple days attempting to pin down this behavior. I had something along the lines of x = a + b + c It's not clear to me why the second line is a valid expression. At the very least, it would be nice for lint to

Re: [julia-users] Multiple lines statement?

2015-05-31 Thread Scott Jones
On Sunday, May 31, 2015 at 7:13:47 AM UTC+2, Alex Ames wrote: I lost multiple days attempting to pin down this behavior. I had something along the lines of x = a + b + c It's not clear to me why the second line is a valid expression. At the very least, it would be nice for lint to

Re: [julia-users] a simple visualization of all the described color strings in Color packge

2015-05-31 Thread Jiahao Chen
Thanks. A similar color palette is available at https://github.com/JuliaLang/Color.jl/issues/92 Thanks, Jiahao Chen Research Scientist MIT CSAIL On Sun, May 31, 2015 at 11:53 AM, Li Zhang fff...@gmail.com wrote: hi folks, i run into a lot of color usage lately, and always wanted to have a

Re: [julia-users] I'm lost (again)

2015-05-31 Thread Milan Bouchet-Valat
Le dimanche 31 mai 2015 à 02:30 -0700, Andreas Lobinger a écrit : Hello colleagues, i'd like to do some GUI related things with julia and thought hey, i'm doing quite nice things with pygtk, so let's try here also and looked into Gtk.jl. Gtk.jl which is (seems to be) part of the official

[julia-users] Julia bounding box code

2015-05-31 Thread fshussaini
Hi, I have an image https://lh3.googleusercontent.com/-9pDJ9d88xQE/VWrYIj8DHrI/AAY/BOicf_WwYhs/s1600/SampleStain.jpg This is the matlab code for plotting the bounding. [y,x] = ind2sub(size(msk), find(msk)); coord = [x, y]; mc = min(coord)-0.5 Mc = max(coord)+0.5 rect=[mc Mc-mc]

Re: [julia-users] I'm lost (again)

2015-05-31 Thread Andreas Lobinger
Hello colleague, On Sunday, May 31, 2015 at 12:24:21 PM UTC+2, Milan Bouchet-Valat wrote: Le dimanche 31 mai 2015 à 02:30 -0700, Andreas Lobinger a écrit : I've forked a Gtk.jl to my githup presence and git cloned this to my local copy, where i use a branch. The LibDL_problem (dirty)

Re: [julia-users] I'm lost (again)

2015-05-31 Thread Jameson Nash
The dlopen API in base changed last week and I have not had time to update Gtk.jl accordingly. I should be able to get back to soon however. On Sun, May 31, 2015 at 12:24 PM Milan Bouchet-Valat nalimi...@club.fr wrote: Le dimanche 31 mai 2015 à 02:30 -0700, Andreas Lobinger a écrit : Hello

Re: [julia-users] I'm lost (again)

2015-05-31 Thread Andreas Lobinger
Hello colleague, On Sunday, May 31, 2015 at 1:00:54 PM UTC+2, Jameson wrote: The dlopen API in base changed last week and I have not had time to update Gtk.jl accordingly. I should be able to get back to soon however. this was also my first guess, and that you work on your package is

Re: [julia-users] Multiple lines statement?

2015-05-31 Thread Scott Jones
I'd disagree strongly with the recommendation to break expressions after... it makes you have to look at the end of the line above to see if a line is part of another expression. I think it is much better to simply get used to wrapping things with ( ), and editors show you nicely where the

[julia-users] I'm lost (again)

2015-05-31 Thread Andreas Lobinger
Hello colleagues, i'd like to do some GUI related things with julia and thought hey, i'm doing quite nice things with pygtk, so let's try here also and looked into Gtk.jl. Gtk.jl which is (seems to be) part of the official julialang repository on githup. So my expectation is: This is working.

Re: [julia-users] julia on arm - some more progress

2015-05-31 Thread Daan Huybrechs
There must be a solution :-) I tried a similar build yesterday, but ran out of disk space over night on a 16Gb sdcard. Has anyone managed to do cross-compilation? It could be worth it to try configure options similar to what is mentioned here (probably with cortex-a7 instead):

Re: [julia-users] julia on arm - some more progress

2015-05-31 Thread Jameson Nash
It would seem that they must be forcing on codegen with -mattrs=+vfp, but I didn't think you could do that at compile time. On Sun, May 31, 2015 at 6:14 AM Viral Shah vi...@mayin.org wrote: :-( I wonder what’s the magic incantation those LLVM binaries use. -viral On 31-May-2015, at 9:29

[julia-users] Proposal for JSoC'15 by Rohit Kashyap - Invitation to comment

2015-05-31 Thread Rohit Kashyap (via Google Docs)
I've shared an item with you: Proposal for JSoC'15 by Rohit Kashyap https://docs.google.com/document/d/1SrNgmK-GUsxLzxwKwjHWzPzB9Vj53vsIqSH41MRBe34/edit?usp=sharing It's not an attachment – it's stored online. To open this item, just click the link above. Hi, Greetings to all mentors, I

Re: [julia-users] Re: Julia Summer of Code

2015-05-31 Thread Rohit Kashyap
Hi, Greetings to all mentors, I request you to go through this Proposal draft and submit your feedback/suggestions for improvements before submission deadline. https://docs.google.com/document/d/1SrNgmK-GUsxLzxwKwjHWzPzB9Vj53vsIqSH41MRBe34/edit?usp=sharing

Re: [julia-users] I'm lost (again)

2015-05-31 Thread Milan Bouchet-Valat
Le dimanche 31 mai 2015 à 04:12 -0700, Andreas Lobinger a écrit : Hello colleague, On Sunday, May 31, 2015 at 1:00:54 PM UTC+2, Jameson wrote: The dlopen API in base changed last week and I have not had time to update Gtk.jl accordingly. I should be able to get back

Re: [julia-users] Julia bounding box code

2015-05-31 Thread Tim Holy
Since you don't provide msk nor display the value of rect, it's hard to say. BTW, in julia you can say mc = minimum(coord, 1) --Tim On Sunday, May 31, 2015 02:45:53 AM fshussa...@gmail.com wrote: Hi, I have an image

[julia-users] Re: I'm lost (again)

2015-05-31 Thread Tobias Knopp
Andreas, unfortunately the Gtk/Winston/Cairo thing got a little unstable during the last months. I tried two days a Winston/Gtk example and ran into the Graphics issue. I think this shows that (unfortunately) the user base of Gtk is still low. It would IMHO help to Winston rely on Gtk (i.e.

[julia-users] Re: Proposal for JSoC'15 by Rohit Kashyap - Invitation to comment

2015-05-31 Thread Andreas Lobinger
A document that is accessible without google log-in would raise the probability for comments...

Re: [julia-users] Macros generating Functions

2015-05-31 Thread Kevin Squire
Actually, it's name is n: julia function getfn() return function(); 1; end end getfn (generic function with 1 method) julia const n = getfn() (anonymous function) julia n() 1 On Sat, May 30, 2015 at 5:09 PM, David P. Sanders dpsand...@gmail.com wrote: El domingo, 31 de mayo

Re: [julia-users] Macros generating Functions

2015-05-31 Thread Tom Lee
No, in that example you create an anonymous function. I'm not certain on the semantics, but n effectively points to this nameless function. Anonymous functions are not as fast as generic ones (at least in 0.3, at least sometimes) and you cannot add new methods to them for multiple dispatch (as

Re: [julia-users] JuliaCon registrations open

2015-05-31 Thread Miles Lubin
We now have a sheet to help JuliaCon attendees arrange for room sharing: https://docs.google.com/spreadsheets/d/1361VHhtFM5Cnu-S_cSUKFeUhrH33FepOKLCc0YLtosg/edit?usp=sharing On Friday, May 29, 2015 at 5:34:52 PM UTC+2, Matt Bauman wrote: Is anyone interested in splitting a room with two

[julia-users] Ann: new parser library

2015-05-31 Thread andrew cooke
There's a new parser library for Julia 0.3 and 0.4 - https://github.com/andrewcooke/SimpleParser.jl It's got some rough edges that I hope to clean up in the next week or so, with a first release probably next weekend. Bug reports welcome. It's parser combinator style, but uses trampolining