[julia-users] Re: Plotting lots of data

2016-09-21 Thread Igor
Hello! did you managed to plot big data sets? You can try to use my small package for this ( https://github.com/ig-or/qwtwplot.jl ) - it's very interesting for me how it can handle big data sets. Best regards, Igor четверг, 16 июня 2016 г., 0:08:42 UTC+3 пользователь CrocoDuck O'Ducks

[julia-users] Re: How to write a binary data file? (Matlab to Julia translation)

2016-09-21 Thread Dennis Eckmeier
Hi, thanks for the help! Coming from Matlab data types and binary files had never been a concern... it was about time I learned how to do this! I was able to complete the Julia wrapper for Barnes Huts t-sne, and I will put it on github :) Next up: plotting the results ;) cheers, Dennis On

[julia-users] Re: Any way of recovering a corrupted .julia?

2016-09-21 Thread Jānis Erdmanis
I would suggest to start over, but keep REQUIRE file. Then do Pkg.init(), put REQUIRE file back and Pkg.update(). On Tuesday, September 20, 2016 at 10:07:36 PM UTC+3, J Luis wrote: > > Hi, > > So I did it again. While trying to install ImageMagick and at same time > attempting to convince

Re: [julia-users] Does Julia 0.5 leak memory?

2016-09-21 Thread Yaakov Borstein
For what it's worth, I have a production system that was developed on 0.4.6, and started running it today on the 0.5 release. It retrieves data from dozens of API's as JSON, processes and converts them to DataFrames, reconverts to JSON, caches the results in Redis. Sizes range from several

[julia-users] Re: How to write a binary data file? (Matlab to Julia translation)

2016-09-21 Thread Steven G. Johnson
On Wednesday, September 21, 2016 at 5:23:24 AM UTC-4, Dennis Eckmeier wrote: > > thanks for the help! Coming from Matlab data types and binary files had > never been a concern... > You had to explicitly pass 'integer*4' in Matlab, so they were a concern there too, it is just that you express

Re: [julia-users] Help creating an IDL wrapper using Clang.jl

2016-09-21 Thread Luke Stagner
Are you still planning on releasing your IDL wrapper? I would still very much like to use it. -Luke On Friday, August 5, 2016 at 10:19:16 AM UTC-7, Bob Nnamtrop wrote: > > I have written a (pretty) complete wrapper for IDL (years ago actually), > but have not uploaded to github. I'll try to do

[julia-users] Re: Adding publications easier

2016-09-21 Thread Magnus Röding
I realize I was very vague. I don't have a concrete suggestion, but github/pull request/jekyll/pandoc plus the fact that I'm not well acquainted with any of the steps was just too much. If I remember correctly I got as far as producing an error message in Jekyll and eventually giving up the

[julia-users] Re: Is FMA/Muladd Working Here?

2016-09-21 Thread Páll Haraldsson
On Wednesday, September 21, 2016 at 5:56:45 AM UTC, Chris Rackauckas wrote: > Julia Version 0.5.0-rc4+0 > I'm not saying it matters here, but is this version know to be identical to the released 0.5? Unless you know, in general, bugs should be reported on latest version. -- Palli.

Re: [julia-users] Understanding Nullable as immutable

2016-09-21 Thread Yichao Yu
On Sep 21, 2016 9:42 AM, "Randy Zwitch" wrote: > > I frequently have a design pattern of Union{Title, Void}. I was thinking that I could redefine this as title::Nullable{Title}. However, once I try to modify fields inside the Title type using setfield!(ec.title, k,

[julia-users] Re: Problem with 0.4.7 mac os distribution

2016-09-21 Thread Páll Haraldsson
On Tuesday, September 20, 2016 at 7:16:41 PM UTC, Tony Kelman wrote: > > try removing the copy of 0.4.7 you downloaded and replacing it with a > fresh copy. Maybe even try out 0.5 anyway, since it is out. [Not sure what you mean by "distro appears to download OK", "Julia + Juno IDE bundles

[julia-users] Re: Does Julia 0.5 leak memory?

2016-09-21 Thread Páll Haraldsson
On Sunday, September 18, 2016 at 12:53:19 PM UTC, K leo wrote: > Any thoughts on what might be the culprit? > > | | |_| | | | (_| | | Version 0.5.0-rc4+0 (2016-09-09 01:43 UTC) > _/ |\__'_|_|_|\__'_| | Official http://julialang.org/ release > You say 0.5 in the title (when 0.5 wasn't

[julia-users] Understanding Nullable as immutable

2016-09-21 Thread Randy Zwitch
I frequently have a design pattern of Union{Title, Void}. I was thinking that I could redefine this as title::Nullable{Title}. However, once I try to modify fields inside the Title type using setfield!(ec.title, k, v), I get this error message: LoadError: type Nullable is immutable while

[julia-users] Re: Maps in Julia?

2016-09-21 Thread Yeesian Ng
It is based on slow work-in-progress, but I have slides (and notebook ) for a talk I'm giving later today on geospatial processing in julia. They give some

[julia-users] Re: Maps in Julia?

2016-09-21 Thread 'Philippe Roy' via julia-users
@Yeesian Ng : Thanks! Looks like my typical work day :) @cdm : Subscribed to julia-geo. Will be useful! @others : Thanks! We have lots of useful information for anyone reading this thread. :) Le mercredi 21 septembre 2016 08:37:27 UTC-4, Yeesian Ng a écrit : > > It is based on slow

Re: [julia-users] Is FMA/Muladd Working Here?

2016-09-21 Thread Erik Schnetter
On Wed, Sep 21, 2016 at 1:56 AM, Chris Rackauckas wrote: > Hi, > First of all, does LLVM essentially fma or muladd expressions like > `a1*x1 + a2*x2 + a3*x3 + a4*x4`? Or is it required that one explicitly use > `muladd` and `fma` on these types of instructions (is there a

Re: [julia-users] Understanding Nullable as immutable

2016-09-21 Thread Fengyang Wang
There is no need to modify a copy; only the Nullable is immutable and not its underlying value. Just instead of modifying ec.title, modify get(ec.title). Like setfield!(get(ec.title), k, v). In short scripts, I often define getindex(x::Nullable) = get(x) so that I can write ec.title[] instead

[julia-users] http://pkg.julialang.org/ needs updating.. I guess 0.5 is now recommended (and specific packages?)

2016-09-21 Thread Páll Haraldsson
At: http://pkg.julialang.org/ http://pkg.julialang.org/pulse.html I see: "*v0.4.6 (current release)* — v0.5-pre (unstable)" former is no longer true, and I guess not the latter. Isn't "unstable" meant to refer to Julia itself? Or packages..? Both? This is just a reminder to update..

[julia-users] Re: Is FMA/Muladd Working Here?

2016-09-21 Thread Simon Byrne
On Wednesday, 21 September 2016 06:56:45 UTC+1, Chris Rackauckas wrote: > > Hi, > First of all, does LLVM essentially fma or muladd expressions like > `a1*x1 + a2*x2 + a3*x3 + a4*x4`? Or is it required that one explicitly use > `muladd` and `fma` on these types of instructions (is there a

Re: [julia-users] Understanding Nullable as immutable

2016-09-21 Thread Randy Zwitch
So get() to check if a value is there, and if there is modify a copy then overwrite? If that's the case, it might be worth the mental overhead to use Nullable types when mentally I'm viewing everything as a consistently mutating object until the desired result is achieved. On Wednesday,

[julia-users] reading 4-level nested child nodes using lightxml

2016-09-21 Thread varun7rs
i have a rather long xml file which i need to parse and i'm not able to proceed at a certain point. the code throws up errors when i try to access the child nodes of a certain element.

[julia-users] Re: Is FMA/Muladd Working Here?

2016-09-21 Thread Chris Rackauckas
The Windows one is using the pre-built binary. The Linux one uses the COPR nightly (I assume that should build with all the goodies?) On Wednesday, September 21, 2016 at 9:00:02 AM UTC-7, Simon Byrne wrote: > > On Wednesday, 21 September 2016 06:56:45 UTC+1, Chris Rackauckas wrote: >> >> Hi, >>

[julia-users] Re: Plotting lots of data

2016-09-21 Thread Chris Rackauckas
I've managed to plot quite a few large datasets. GR through Plots.jl works very well for this. I tend to still prefer the defaults of PyPlot, but GR is just so much faster that I switch the backend whenever the amount of data gets unruly (larger than like 5-10GB, and it's worked to save a

Re: [julia-users] RE: [julia-news] ANN: Julia v0.5.0 released!

2016-09-21 Thread 'Tobias Knopp' via julia-users
I also want to thank you Tony for the excellent release management! 0.5 is an awesome release and in our research group the switch was absolutely smoothly. Thanks, Tobi Am Dienstag, 20. September 2016 21:28:04 UTC+2 schrieb Jeff Bezanson: > > Thanks Tony for your very hard work seeing this

Re: [julia-users] Understanding Nullable as immutable

2016-09-21 Thread Randy Zwitch
OH! That makes a big difference in usability. :) On Wednesday, September 21, 2016 at 12:50:26 PM UTC-4, Fengyang Wang wrote: > > There is no need to modify a copy; only the Nullable is immutable and not > its underlying value. Just instead of modifying ec.title, modify > get(ec.title). Like

[julia-users] Re: Help: Printing method in julia

2016-09-21 Thread Steven G. Johnson
On Wednesday, September 21, 2016 at 2:54:15 PM UTC-4, Weicheng Zhu wrote: > > Hi all, > > I have a few simple questions to ask. > > 1) What function is invoked when I type x in the following example? > display(x), which calls show(STDOUT, MIME("text/plain"), x) [or writemime in Julia ≤ 0.4]

Re: [julia-users] Re: Is FMA/Muladd Working Here?

2016-09-21 Thread Milan Bouchet-Valat
Le mercredi 21 septembre 2016 à 11:36 -0700, Chris Rackauckas a écrit : > The Windows one is using the pre-built binary. The Linux one uses the > COPR nightly (I assume that should build with all the goodies?) The Copr RPMs are subject to the same constraint as official binaries: we need them to

Re: [julia-users] Re: Is FMA/Muladd Working Here?

2016-09-21 Thread Chris Rackauckas
I see. So what I am getting is that, in my codes, 1. I will need to add @fastmath anywhere I want these optimizations to show up. That should be easy since I can just add it at the beginnings of loops where I have @inbounds which already covers every major inner loop I have. Easy find/replace

[julia-users] Help: Printing method in julia

2016-09-21 Thread Weicheng Zhu
Hi all, I have a few simple questions to ask. 1) What function is invoked when I type x in the following example? I tried print(x) and show(x), both don't seem to print x in this way. julia> x = rand(5,2); julia> x 5×2 Array{Float64,2}: 0.923288 0.0157897 0.439387 0.50823

[julia-users] Re: Plotting lots of data

2016-09-21 Thread Andreas Lobinger
Hello colleague, On Wednesday, September 21, 2016 at 8:34:21 PM UTC+2, Chris Rackauckas wrote: > > I've managed to plot quite a few large datasets. GR through Plots.jl works > very well for this. I tend to still prefer the defaults of PyPlot, but GR > is just so much faster that I switch the

[julia-users] Re: Plotting lots of data

2016-09-21 Thread Chris Rackauckas
Usually I'm plotting the run from really long differential equations solution. The one I am mentioning is from a really long stochastic differential equation solution (publication coming soon). 19 lines with likely millions of dots, thrown together into one figure or spanning multiple. I can't

Re: [julia-users] Re: Is FMA/Muladd Working Here?

2016-09-21 Thread Milan Bouchet-Valat
Le mercredi 21 septembre 2016 à 12:15 -0700, Chris Rackauckas a écrit : > I see. So what I am getting is that, in my codes,  > > 1. I will need to add @fastmath anywhere I want these optimizations > to show up. That should be easy since I can just add it at the > beginnings of loops where I have

[julia-users] Re: Does Julia 0.5 leak memory?

2016-09-21 Thread Luke Stagner
I just tried my code again using the 0.5 release and the memory is still not releasing. I thought maybe it was caused by using HDF5 but even if i commented out that bit of the code it still doesn't free up the memory. -Luke On Wednesday, September 21, 2016 at 6:53:07 AM UTC-7, Páll Haraldsson

[julia-users] Re: Help: Printing method in julia

2016-09-21 Thread Weicheng Zhu
Hi Dr. Johnson, Thank you very much for your help! Not I understand how it works. This problem has confused me a long time since I started learning julia. So if I want a `mytype` object to be printed in the pretty-printed lines by default, I have to define the display method, right? I guess my

Re: [julia-users] Understanding Nullable as immutable

2016-09-21 Thread Páll Haraldsson
On Wednesday, September 21, 2016 at 4:50:26 PM UTC, Fengyang Wang wrote: > > but type piracy is bad practice. This method should really be in Base. > As always, if something, should be in Base or Julia, then I think a PR is welcome. [Maybe I do not fully understand this (yes, type piracy I

Re: [julia-users] Does Julia 0.5 leak memory?

2016-09-21 Thread Yichao Yu
On Mon, Sep 19, 2016 at 9:14 PM, Luke Stagner wrote: > I actually ran into this issue too. I have a routine that calculates fast > ion orbits that uses a lot of memory (90%). Here is the code (sorry its not > very clean). I tried to run the function `make_distribution_file`

Re: [julia-users] Does Julia 0.5 leak memory?

2016-09-21 Thread Yaakov Borstein
:)

Re: [julia-users] Help creating an IDL wrapper using Clang.jl

2016-09-21 Thread Bob Nnamtrop
Yes, sorry for the delay, I have uploaded some code to github. See: https://github.com/BobPortmann/IDLCall.jl.git. I have added some notes there to get you started. No doubt they are too short and you may have to look into the code to get things working. I do want to polish this up, so please

Re: [julia-users] Is FMA/Muladd Working Here?

2016-09-21 Thread Chris Rackauckas
Still no FMA? julia> k(x) = @fastmath 2.4x + 3.0 WARNING: Method definition k(Any) in module Main at REPL[14]:1 overwritten at REPL[23]:1. k (generic function with 1 method) julia> @code_llvm k(4.0) ; Function Attrs: uwtable define double @julia_k_66737(double) #0 { top: %1 = fmul fast

Re: [julia-users] Is FMA/Muladd Working Here?

2016-09-21 Thread Erik Schnetter
I confirm that I can't get Julia to synthesize a `vfmadd` instruction either... Sorry for sending you on a wild goose chase. -erik On Wed, Sep 21, 2016 at 9:33 PM, Yichao Yu wrote: > On Wed, Sep 21, 2016 at 9:29 PM, Erik Schnetter > wrote: > > On Wed,

Re: [julia-users] Does Julia 0.5 leak memory?

2016-09-21 Thread Luke Stagner
In trying to create a reduced test case I figured out the source of my memory leak. It wasn't caused by Julia but by an external library I was calling (Sundials.jl). Pulling the dev version of Sundials.jl fixed the issue for me. K Leo, if you are using any external library, that may be the

Re: [julia-users] Is FMA/Muladd Working Here?

2016-09-21 Thread Erik Schnetter
On Wed, Sep 21, 2016 at 9:22 PM, Chris Rackauckas wrote: > I'm not seeing `@fastmath` apply fma/muladd. I rebuilt the sysimg and now > I get results where g and h apply muladd/fma in the native code, but a new > function k which is `@fastmath` inside of f does not apply

[julia-users] Int Matrix multiplication versus Float Matrix multiplication

2016-09-21 Thread Lutfullah Tomak
Float matrix multiplication uses heavily optimized openblas but integer matrix multiplication is a generic one from julia and there is not much you can do to improve it a lot because not all cpus have simd multiplication and addition for integers.

[julia-users] Re: Help: Printing method in julia

2016-09-21 Thread Steven G. Johnson
On Wednesday, September 21, 2016 at 4:24:10 PM UTC-4, Weicheng Zhu wrote: > > Hi Dr. Johnson, > Thank you very much for your help! Not I understand how it works. > This problem has confused me a long time since I started learning julia. > > So if I want a `mytype` object to be printed in the

Re: [julia-users] Re: Does Julia 0.5 leak memory?

2016-09-21 Thread Yichao Yu
On Wed, Sep 21, 2016 at 7:44 PM, K leo wrote: > I am running the 0.5 release now and it behaves in the same way - not > releasing memory. I can't say if this only has to do with 0.5 but not 0.4. > Probably it happened in the same way with 0.4 but I just didn't pay > attention

Re: [julia-users] Does Julia 0.5 leak memory?

2016-09-21 Thread Yichao Yu
On Wed, Sep 21, 2016 at 10:04 PM, Luke Stagner wrote: > In trying to create a reduced test case I figured out the source of my > memory leak. It wasn't caused by Julia but by an external library I was Good to know. > calling (Sundials.jl). Pulling the dev version of

Re: [julia-users] Is FMA/Muladd Working Here?

2016-09-21 Thread Yichao Yu
On Wed, Sep 21, 2016 at 9:49 PM, Erik Schnetter wrote: > I confirm that I can't get Julia to synthesize a `vfmadd` instruction > either... Sorry for sending you on a wild goose chase. -march=haswell does the trick for C (both clang and gcc) the necessary bit for the machine

[julia-users] Re: Int Matrix multiplication versus Float Matrix multiplication

2016-09-21 Thread Joaquim Masset Lacombe Dias Garcia
Thanks again! I just found this: http://stackoverflow.com/questions/2550281/floating-point-vs-integer-calculations-on-modern-hardware According to the information presented there, generic multiplication is slower for ints than for floats. Em quarta-feira, 21 de setembro de 2016 20:14:34

Re: [julia-users] Does Julia 0.5 leak memory?

2016-09-21 Thread K leo
I ran some more tests with both my original code and some test codes, now with the 0.5 release version. I would conclude that memory is not leaking. The memory usage as reported by top is the actual memory used or having been just used. Although the usage number does not drop after the code

Re: [julia-users] Int Matrix multiplication versus Float Matrix multiplication

2016-09-21 Thread Erik Schnetter
As matrix multiplication has a cost of O(N^3) while using only O(N^2) elements, and since many integers (those smaller than 2^52 or so) can be represented exactly as Float64 values, one approach could be to convert the matrices to Float64, multiply them, and then convert back. For 64-bit integers

Re: [julia-users] Understanding Nullable as immutable

2016-09-21 Thread Fengyang Wang
Yes, I've been meaning to submit a PR. The last one contained several other changes which were substantially more controversial. My plan was to split the PR up into smaller changes. On Wednesday, September 21, 2016 at 4:48:21 PM UTC-4, Páll Haraldsson wrote: > > On Wednesday, September 21, 2016

[julia-users] Re: Int Matrix multiplication versus Float Matrix multiplication

2016-09-21 Thread Steven G. Johnson
Floating-point matrix multiplication uses a highly optimized BLAS library (OpenBLAS), while integer matrix multiplication uses generic code.

Re: [julia-users] Is FMA/Muladd Working Here?

2016-09-21 Thread Yichao Yu
On Wed, Sep 21, 2016 at 9:33 PM, Yichao Yu wrote: > On Wed, Sep 21, 2016 at 9:29 PM, Erik Schnetter wrote: >> On Wed, Sep 21, 2016 at 9:22 PM, Chris Rackauckas >> wrote: >>> >>> I'm not seeing `@fastmath` apply fma/muladd. I rebuilt

[julia-users] Re: Help: Printing method in julia

2016-09-21 Thread Weicheng Zhu
OK, I see. Thank you! On Wednesday, September 21, 2016 at 6:17:30 PM UTC-5, Steven G. Johnson wrote: > > > > On Wednesday, September 21, 2016 at 4:24:10 PM UTC-4, Weicheng Zhu wrote: >> >> Hi Dr. Johnson, >> Thank you very much for your help! Not I understand how it works. >> This problem has

Re: [julia-users] Is FMA/Muladd Working Here?

2016-09-21 Thread Yichao Yu
On Wed, Sep 21, 2016 at 9:29 PM, Erik Schnetter wrote: > On Wed, Sep 21, 2016 at 9:22 PM, Chris Rackauckas > wrote: >> >> I'm not seeing `@fastmath` apply fma/muladd. I rebuilt the sysimg and now >> I get results where g and h apply muladd/fma in the

Re: [julia-users] Re: Introducing Knet8: beginning deep learning with 100 lines of Julia!

2016-09-21 Thread Deniz Yuret
Can you try Pkg.update() first? Your METADATA could be out of date. On Wed, Sep 21, 2016 at 8:22 AM Jon Norberg wrote: > I get "LoadError: unknown package Knet" when using Pkg.add("Knet"). I am > on 0.5. > > Very interested in this julia native ML library, thanks for

Re: [julia-users] Re: Introducing Knet8: beginning deep learning with 100 lines of Julia!

2016-09-21 Thread Jon Norberg
Ah yes of course, sorry :-) and thanks

Re: [julia-users] Re: Introducing Knet8: beginning deep learning with 100 lines of Julia!

2016-09-21 Thread Deniz Yuret
No problem. Let me know if I can help you get started. On Wed, Sep 21, 2016 at 10:35 AM Jon Norberg wrote: > Ah yes of course, sorry :-) and thanks

[julia-users] Re: Does Julia 0.5 leak memory?

2016-09-21 Thread K leo
I am running the 0.5 release now and it behaves in the same way - not releasing memory. I can't say if this only has to do with 0.5 but not 0.4. Probably it happened in the same way with 0.4 but I just didn't pay attention then. Since there is no mechanism in Julia like in C/C++ for the

Re: [julia-users] Does Julia 0.5 leak memory?

2016-09-21 Thread Yichao Yu
On Wed, Sep 21, 2016 at 8:50 PM, Yichao Yu wrote: > On Mon, Sep 19, 2016 at 9:14 PM, Luke Stagner wrote: >> I actually ran into this issue too. I have a routine that calculates fast >> ion orbits that uses a lot of memory (90%). Here is the code (sorry

[julia-users] Int Matrix multiplication versus Float Matrix multiplication

2016-09-21 Thread Joaquim Masset Lacombe Dias Garcia
Does anyone knows why the float matrix multiplication is much faster in the following code: function foo() n = 2000 a = rand(1:10, n, n) b = rand(n, n) @time a*a @time b*b nothing end I get: julia> test() 6.715335 seconds (9 allocations: 30.518 MB, 0.00% gc time) 0.120801

[julia-users] Re: ijulia with multiple versions

2016-09-21 Thread Roger Whitney
Thanks. That worked. On Tuesday, September 20, 2016 at 6:55:34 PM UTC-7, Cedric St-Jean wrote: > > I have multiple julia versions installed (merely through never deleting > them). At every new version I've called `Pkg.build("IJulia")` from the > command line. This adds the new kernel to the

Re: [julia-users] Help creating an IDL wrapper using Clang.jl

2016-09-21 Thread Luke Stagner
You have no idea how happy this make me. I was able to get it running fairly quickly on linux. This is what I did ``` shell> export JL_IDL_TYPE=CALLABLE julia> push!(Libdl.DL_LOAD_PATH, "/path/to/idl/idl84/bin/bin.linux.x86_64") 1-element Array{String,1}:

[julia-users] Re: Help: Printing method in julia

2016-09-21 Thread Weicheng Zhu
OK, I see. It seems that if I define the two show method directly in the REPL, it doesn't work. But it works when I wrap them into a module:) On Wednesday, September 21, 2016 at 3:24:10 PM UTC-5, Weicheng Zhu wrote: > > Hi Dr. Johnson, > Thank you very much for your help! Not I understand how

[julia-users] Visualizing a Julia AST (abstract syntax tree) as a tree

2016-09-21 Thread David P. Sanders
Hi, In case it's useful for anybody, the following notebook shows how to use the LightGraphs and TikzGraphs packages to visualize a Julia abstract syntax tree (Expression object) as an actual tree: https://gist.github.com/dpsanders/5cc1acff2471d27bc583916e00d43387 Currently it requires the