transpose on bigger datasets?

2014-10-29 Thread Berntsson, Martin
Dear all, I work with (relatively) large data tables and appreciate gnumeric for its stability and speed. I need some advice concerning the use of gnumeric and the function transpose. I have used transpose successfully on small datasets. Problem : I have a matrix size ca 12345678x9 (ca 10^8

Re: transpose on bigger datasets?

2014-10-29 Thread Morten Welinder
You would need a spreadsheet with 12345678 columns to store that. That's a no-go. We max out at 16384. While you could change that in the source code and recompile, you will hit this and related problems: if (GNM_MAX_COLS 364238) { /* Oh, yeah? */ g_warning (_(This is a

Re: transpose on bigger datasets?

2014-10-29 Thread Marc Dunord
save as text, transpose from the linux command line, re-import to your spreadsheet. This way you exploit best your machine's hardware. use the attached transpose code if you wish cat text | tr '\011' ' ' | ./transpose ' ' text.trans (to transpose tab-delimited text file ) runs right away;

SV: transpose on bigger datasets?

2014-10-29 Thread Berntsson, Martin
Dear Morten and all, Thanks for the file and the advice. Thoughts about Gnumeric : Why are there different max rows and max column? Why a max at all? And not limited by machine mem? I need a lot of both, and seen from a technical perspective, today there are numerous applications that produce

Re: transpose on bigger datasets?

2014-10-29 Thread Morten Welinder
Why a max at all? There are issues with the language used for expressions. When the column number gets high enough, there will be ambiguities such as whether TRUE is a column name or a constant; LOG2 might be a function or it might be a cell name; etc. I am not sure all of these are well