Re: [galaxy-dev] Large files in blend4j

2013-09-10 Thread Eric Kuyt
Hi John,

Some news on the debugging yet?

I managed to deploy blend4j in my local maven installation, so now I
can test the client.setChunkedEncodingSize(CHUNKED_ENCODING_SIZE);
line on my setting.

Unfortunately with ChunkedEncoding enabled, it seems that the file is
not (recognized by || sent to) galaxy.

this is the errormessage:

galaxy.web.framework ERROR 2013-09-10 16:06:15,688 Uncaught exception
in exposed API method:
Traceback (most recent call last):
  File "/opt/galaxy_testing/lib/galaxy/web/framework/__init__.py",
line 189, in decorator
rval = func( self, trans, *args, **kwargs)
TypeError: create() takes exactly 3 arguments (2 given)
10.79.24.114 - - [10/Sep/2013:16:06:15 +0200] "POST
/galaxy_testing/api/tools?key=1234567890abcdef1234567890abcdef1
HTTP/1.1" 500 - "-" "Java/1.7.0_25"

Do you know this problem, or could there also be something wrong with my config?

Thanks for the fast reply!

On 9 September 2013 19:51, John Chilton  wrote:
> Glad to hear blend4j is working well, annoyed to here it is not
> streaming files out by default.
>
> Based on your ideas I started some work here, but it is not right. I
> spent the last half an hour looking around Galaxy trying to figure out
> why history creation via the API was broken, not realizing it was
> because I called setChunkedEncodingSize on the client.
>
> https://github.com/jmchilton/blend4j/commit/22608de210f805fc192c86a836ea55c7ae1efccf
>
> I have created an issue in github for this:
>
> https://github.com/jmchilton/blend4j/issues/5
>
> Feel free to try to hack on this some more, it might actually take
> some non-trivial refactoring to get
> client.setChunkedEncodingSize(CHUNKED_ENCODING_SIZE); to be set
> conditionally somehow. Right now all requests are sharing the same
> underlying client object.
>
> I will try to work on this more as I have time.
>
> -John
>
> On Mon, Sep 9, 2013 at 10:58 AM, Eric Kuyt  wrote:
>> Hi all,
>>
>> I'm using blend4j for some time now and I'm quite happy about it, but
>> now I run into some OutOfMemory issues.
>> When I try to upload large files to galaxy (I know http might be not
>> the best option) some byte array is getting to large. A possible
>> solution would be file chunking in jersey, is this possible in blend4j
>> and how could I implement this feature?
>>
>> Thanks,
>>
>> Eric
>>
>
>



-- 
Central Veterinary Institute of Wageningen UR (CVI)
Department of Infection Biology
PO box 65, 8200 AB Lelystad, NL
Visiting address: ASG, Edelhertweg 15, 8219 PH Lelystad

Tel:  +31-(0)320-293391
Fax: +31-(0)320-238153
E-mail: eric.ku...@wur.nl
Web: http://www.cvi.wur.nl

___
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/


Re: [galaxy-dev] Large files in blend4j

2013-09-09 Thread John Chilton
Glad to hear blend4j is working well, annoyed to here it is not
streaming files out by default.

Based on your ideas I started some work here, but it is not right. I
spent the last half an hour looking around Galaxy trying to figure out
why history creation via the API was broken, not realizing it was
because I called setChunkedEncodingSize on the client.

https://github.com/jmchilton/blend4j/commit/22608de210f805fc192c86a836ea55c7ae1efccf

I have created an issue in github for this:

https://github.com/jmchilton/blend4j/issues/5

Feel free to try to hack on this some more, it might actually take
some non-trivial refactoring to get
client.setChunkedEncodingSize(CHUNKED_ENCODING_SIZE); to be set
conditionally somehow. Right now all requests are sharing the same
underlying client object.

I will try to work on this more as I have time.

-John

On Mon, Sep 9, 2013 at 10:58 AM, Eric Kuyt  wrote:
> Hi all,
>
> I'm using blend4j for some time now and I'm quite happy about it, but
> now I run into some OutOfMemory issues.
> When I try to upload large files to galaxy (I know http might be not
> the best option) some byte array is getting to large. A possible
> solution would be file chunking in jersey, is this possible in blend4j
> and how could I implement this feature?
>
> Thanks,
>
> Eric
>
___
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/


[galaxy-dev] Large files in blend4j

2013-09-09 Thread Eric Kuyt
Hi all,

I'm using blend4j for some time now and I'm quite happy about it, but
now I run into some OutOfMemory issues.
When I try to upload large files to galaxy (I know http might be not
the best option) some byte array is getting to large. A possible
solution would be file chunking in jersey, is this possible in blend4j
and how could I implement this feature?

Thanks,

Eric

___
Please keep all replies on the list by using "reply all"
in your mail client.  To manage your subscriptions to this
and other Galaxy lists, please use the interface at:
  http://lists.bx.psu.edu/

To search Galaxy mailing lists use the unified search at:
  http://galaxyproject.org/search/mailinglists/