[Pharo-users] What about a Pharo day in May-June?
Hi guys I think that it would be great to organize a gathering/talks/show me your stuff/networking day before spring. What do you think that this idea? We could host it at Lille. Stef
Re: [Pharo-users] [Pharo-dev] What about a Pharo day in May-June?
There is already a Pharo sprint just after the MOOSEDAY organized in Paris in June. Envoyé de mon iPhone Le 9 avr. 2014 à 08:25, Pharo4Stef pharo4s...@free.fr a écrit : Hi guys I think that it would be great to organize a gathering/talks/show me your stuff/networking day before spring. What do you think that this idea? We could host it at Lille. Stef
Re: [Pharo-users] What about a Pharo day in May-June?
On 09 Apr 2014, at 08:25, Pharo4Stef pharo4s...@free.fr wrote: Hi guys I think that it would be great to organize a gathering/talks/show me your stuff/networking day before spring. What do you think that this idea? We could host it at Lille. The question is if not just doing it at ESUG… people can not travel twice. Marcus
Re: [Pharo-users] [ANN] WIP iStoa
Ok I got it, well I hope so. Debian Wheezy's GNU C lib is version 2.13. So it looks like the VM I used was compiled against GNU C Lib version 2.15 (stock Pharo VM from a few months ago), but more recent stock Pharo VM are compiled with older GNU lib C dependcies. And this is nice. If I am wrong, I will be happy to read clarification. Thanks Hilaire Le 07/04/2014 10:01, Bernat Romagosa a écrit : Just FYI, I had to replace the shipped vm and plugins by the latest ones to get it to work on my Debian Wheezy machine. -- Dr. Geo http://drgeo.eu
[Pharo-users] open file in append mode
How can I open a file in append mode in order to start writing at the end of the file? thanks, Norbert
Re: [Pharo-users] [ANN] WIP iStoa
Where did you get your VM, because the one in Pharo web site does not have the same libc version dependencies? Thanks Hilaire Le 08/04/2014 10:48, Bernat Romagosa a écrit : And this is the output of ldd -v on the vm I used to run iStoa: -- Dr. Geo http://drgeo.eu
Re: [Pharo-users] [ANN] WIP iStoa
Sorry Hilaire, I just got to work and was about to check it. Nice to see you've already found the cause though :) 2014-04-09 9:25 GMT+02:00 Hilaire Fernandes hilaire.fernan...@gmail.com: Ok I got it, well I hope so. Debian Wheezy's GNU C lib is version 2.13. So it looks like the VM I used was compiled against GNU C Lib version 2.15 (stock Pharo VM from a few months ago), but more recent stock Pharo VM are compiled with older GNU lib C dependcies. And this is nice. If I am wrong, I will be happy to read clarification. Thanks Hilaire Le 07/04/2014 10:01, Bernat Romagosa a écrit : Just FYI, I had to replace the shipped vm and plugins by the latest ones to get it to work on my Debian Wheezy machine. -- Dr. Geo http://drgeo.eu -- Bernat Romagosa.
Re: [Pharo-users] open file in append mode
Norbert, Just use #setToEnd once you opened the file stream. HTH, Sven On 09 Apr 2014, at 10:08, Norbert Hartl norb...@hartl.name wrote: How can I open a file in append mode in order to start writing at the end of the file? thanks, Norbert
Re: [Pharo-users] open file in append mode
Hi ! I use #setToEnd. Cheers 2014-04-09 10:08 GMT+02:00 Norbert Hartl norb...@hartl.name: How can I open a file in append mode in order to start writing at the end of the file? thanks, Norbert
[Pharo-users] Pharo Consortium: New Gold Member Lam Research
The Pharo Consortium is very happy to announce that Lam Research has joined the Consortium as a Gold Industrial Member. More about - Lam Research: http://lamrc.com - Pharo Consortium: http://consortium.pharo.org The goal of the Pharo Consortium is to allow companies to support the ongoing development and future of Pharo. Individuals can support Pharo via the Pharo Association: http://association.pharo.org
Re: [Pharo-users] Error: No factory specified
Ok, there is a bug in The ConfigurationOfDBXDriver, the baseline has a versionString entry. That should be removed After removing that (and renaming Cache) it loads. Glorp loads already after renaming Cache. I’m not sure the isKindOf: on ProtoObject is safe. There is a renaming issue after loading Glorp (13188) Stephan
Re: [Pharo-users] [ANN] BabyMock 2
I think you can have your mock send an exception by using #answers:aBlock and signal the exception in the block 2014-04-08 15:58 GMT+02:00 Christophe Demarey christophe.dema...@inria.fr: Hello, Thanks. Very nice library! I have a question: is it possible to expect a method to throw an Exception? I would like something like: protocol describe once: mock recv: #aMethod ; signal: anError. I did not find anything in the documentation. I don't want to test that the mock signals an error but I want to test a code that needs to take into account an exception. Best regards, Christophe. Le 11 mars 2014 à 12:30, Attila Magyar a écrit : I'm pleased to announce the 2.0 version of BabyMock. BabyMock is a visual mock object library that supports test-driven development. This version has a new syntax which is incompatible with the old version. Therefore it has a new repository http://smalltalkhub.com/#!/~zeroflag/BabyMock2 (BabyMock 1 is still available at its old location, but in the future I'd to focus on the development of BabyMock2, so don't expect too many changes regarding the old version). Changes in 2.0 - A new, extensible DSL (no more should/can) - Improved error messages, history of messages, detailed information about argument mismatches - An improved, Spec based GUI - Clicking on a mock opens an inspector on the expectations - Clicking on a message opens an inspector on the message - Object methods can be mocked by defaults - Blocks can be executed after receiving a message by the mock. The block has access to the arguments of the incoming message. - Any argument matcher - Cleanups and simplifications in the code I hope you don't mind the changes regarding the syntax. Personally I think it has lot more pros than cons. More information http://smalltalkhub.com/#!/~zeroflag/BabyMock2 p.s. It needs Pharo3.0. Attila -- View this message in context: http://forum.world.st/ANN-BabyMock-2-tp4748530.html Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. -- *Guillaume Larcheveque*
Re: [Pharo-users] Error: No factory specified
Thanks, Stephan. I will have a look and try to load/use Glorp myself towards the end of the week. On 09 Apr 2014, at 11:08, Stephan Eggermont step...@stack.nl wrote: Ok, there is a bug in The ConfigurationOfDBXDriver, the baseline has a versionString entry. That should be removed After removing that (and renaming Cache) it loads. Glorp loads already after renaming Cache. I’m not sure the isKindOf: on ProtoObject is safe. There is a renaming issue after loading Glorp (13188) Stephan
[Pharo-users] Memory profiling: usage per class - instance in old memory
Hi, My app is a parser/filter for binary files, that produces a bunch of ascii files. At the begining of the parsing, the filtering step involves the storage of the positions of 32 objects, each second for a whole day. So that's 32 Arrays with 86400 elements each. During this step, the memory used by my image grows from 50Mb to ~500Mb. I find it far too large since I'm pretty sure my arrays are the largest objects I create and only weight something like 300kb. The profiling of the app shows that hte footprint of the old memory went up by 350Mb. Which I'm pretty sure is super bad. Maybe as a consequence, after the parsing is finished, the memory footprint of the image stays at ~500Mb What are the tools I have to find where precisely the memory usage explodes ? For example, is it possible to browse the old memory objects to see which one fails to get GC'ed ? Thanks in advance, Thomas.
Re: [Pharo-users] Memory profiling: usage per class - instance in old memory
Your calculation seem to be off. 32 * 86400 objects = 2.8 million objects. A shortint = 4 bytes, making 10.6 MB Everything else (except value objects) is larger. Stephan
Re: [Pharo-users] [ANN] WIP iStoa
2014-04-09 8:25 GMT+01:00 Hilaire Fernandes hilaire.fernan...@gmail.com: So it looks like the VM I used was compiled against GNU C Lib version 2.15 (stock Pharo VM from a few months ago), but more recent stock Pharo VM are compiled with older GNU lib C dependcies. And this is nice. +10 for the person who made it compile against an older glibc. There´s life beyond Ubuntu! Cheers, Sergi
Re: [Pharo-users] Error: No factory specified
On 09.04.2014 00:51, Stephan Eggermont wrote: That would be nice but creates problems. There is existing third party code we want to use. We can be much more precise in naming, and should not use generic names for specific implementations. When #totalWeight is no longer below #maximumWeight, the least recently used item of the cache is evicted (removed) to make room. „ is not part of the Cache behavior, but of LRUCache. Sorry for the noise, but cnr: “There are only two hard problems in computer science: cache invalidation and naming things.” -- Phil Karlton
Re: [Pharo-users] [ANN] WIP iStoa
Ouch! I think it was myself who compiled it... I'll check again tomorrow! 2014-04-09 14:00 GMT+02:00 Sergi Reyner sergi.rey...@gmail.com: 2014-04-09 8:25 GMT+01:00 Hilaire Fernandes hilaire.fernan...@gmail.com: So it looks like the VM I used was compiled against GNU C Lib version 2.15 (stock Pharo VM from a few months ago), but more recent stock Pharo VM are compiled with older GNU lib C dependcies. And this is nice. +10 for the person who made it compile against an older glibc. There´s life beyond Ubuntu! Cheers, Sergi -- Bernat Romagosa.
Re: [Pharo-users] Memory profiling: usage per class - instance in old memory
I meant a single array weight something like 300Kb with the 32 of them weighting arround 10Mb. I tried to look closely at the way the memory (with VirtualMachine#memoryEnd) was incrementing and it follows this pattern: - The memory costly function is defenitly the one storing my position arrays: #setPositionECEFOn: - Throughout the computation of the 32 daily positions, the memory used by the VM goes from 52Mb to 363Mb. Is this a normal behaviour ? On a side note, the computation of a single epoch (which is done 32*24*3600 times) uses 19 local variables. Not sure it is relevant. 2014-04-09 13:10 GMT+02:00 Stephan Eggermont step...@stack.nl: Your calculation seem to be off. 32 * 86400 objects = 2.8 million objects. A shortint = 4 bytes, making 10.6 MB Everything else (except value objects) is larger. Stephan
Re: [Pharo-users] Memory profiling: usage per class - instance in old memory
Hi Thomas, Fixing memory consumption problems is hard, but important: memory efficient code is automatically faster in the long run as well. Your issue sounds serious. However, I would start by trying to figure out what is happening at your coding level: somehow you (or something you use) must be holding on too much memory. Questioning low level memory management functionality should be the last resort, not the first. There is SpaceTally that you could use before and after running part of your code. Once something unexpected survives GC, there is the PointerFinder functionality (Inspector Explore Pointers) to find what holds onto objects. But no matter what, it is hard. If you have some public code that you could share to demonstrate your problem, then we could try to help. Sven On 09 Apr 2014, at 12:54, Thomas Bany mun.sys...@gmail.com wrote: Hi, My app is a parser/filter for binary files, that produces a bunch of ascii files. At the begining of the parsing, the filtering step involves the storage of the positions of 32 objects, each second for a whole day. So that's 32 Arrays with 86400 elements each. During this step, the memory used by my image grows from 50Mb to ~500Mb. I find it far too large since I'm pretty sure my arrays are the largest objects I create and only weight something like 300kb. The profiling of the app shows that hte footprint of the old memory went up by 350Mb. Which I'm pretty sure is super bad. Maybe as a consequence, after the parsing is finished, the memory footprint of the image stays at ~500Mb What are the tools I have to find where precisely the memory usage explodes ? For example, is it possible to browse the old memory objects to see which one fails to get GC'ed ? Thanks in advance, Thomas.
Re: [Pharo-users] [ANN] BabyMock 2
Thanks Guillaume. It works well. With BabyMock2, the syntax is = aBlock Le 9 avr. 2014 à 11:13, Guillaume Larcheveque a écrit : I think you can have your mock send an exception by using #answers:aBlock and signal the exception in the block 2014-04-08 15:58 GMT+02:00 Christophe Demarey christophe.dema...@inria.fr: Hello, Thanks. Very nice library! I have a question: is it possible to expect a method to throw an Exception? I would like something like: protocol describe once: mock recv: #aMethod ; signal: anError. I did not find anything in the documentation. I don't want to test that the mock signals an error but I want to test a code that needs to take into account an exception. Best regards, Christophe. Le 11 mars 2014 à 12:30, Attila Magyar a écrit : I'm pleased to announce the 2.0 version of BabyMock. BabyMock is a visual mock object library that supports test-driven development. This version has a new syntax which is incompatible with the old version. Therefore it has a new repository http://smalltalkhub.com/#!/~zeroflag/BabyMock2 (BabyMock 1 is still available at its old location, but in the future I'd to focus on the development of BabyMock2, so don't expect too many changes regarding the old version). Changes in 2.0 - A new, extensible DSL (no more should/can) - Improved error messages, history of messages, detailed information about argument mismatches - An improved, Spec based GUI - Clicking on a mock opens an inspector on the expectations - Clicking on a message opens an inspector on the message - Object methods can be mocked by defaults - Blocks can be executed after receiving a message by the mock. The block has access to the arguments of the incoming message. - Any argument matcher - Cleanups and simplifications in the code I hope you don't mind the changes regarding the syntax. Personally I think it has lot more pros than cons. More information http://smalltalkhub.com/#!/~zeroflag/BabyMock2 p.s. It needs Pharo3.0. Attila -- View this message in context: http://forum.world.st/ANN-BabyMock-2-tp4748530.html Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com. -- Guillaume Larcheveque smime.p7s Description: S/MIME cryptographic signature
[Pharo-users] Socket Handles to C
How do Socket handles map to C socket IDs? I'm wrapping libssh2 via Native Boost and I'd much rather create sockets via Smalltalk than C, but I'm not sure how to pass the handle to a C function expecting a C socket ID. Maybe I'm missing something really simple? Thanks. - Cheers, Sean -- View this message in context: http://forum.world.st/Socket-Handles-to-C-tp4753619.html Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.
Re: [Pharo-users] Zinc HTTP server seems to convert always ...
Am 09.04.2014 15:29, schrieb Sven Van Caekenberghe: Hi Marten, I will need (much) more detail, what are you trying to do that is not working according to you ? As far as I know Zinc HTTP Components does the right thing and can be used (configured) to do almost anything you want. It mostly depends on your mime types and their charset options. The browser sends UTF8 data and in my application code I get instances of ZnStringEntity and the contained string is converted to (?) ISO8859-1 (?) or CP-1252 (?). This seems to be due to the fact, that the entity instance always has a ZnUTF8Encoder to do the conversion. I would like to have UTF8 everywhere ... without all these conversions ... Marten -- Marten Feldtmann
Re: [Pharo-users] [ANN] WIP iStoa
LOL. So you have no choice but to prepare for me an archive with your compiled VM, so I will use it ;-) (my system use glibc 2.15 anyway) Hilaire Le 09/04/2014 14:29, Bernat Romagosa a écrit : Ouch! I think it was myself who compiled it... I'll check again tomorrow! -- Dr. Geo http://drgeo.eu
Re: [Pharo-users] Zinc HTTP server seems to convert always ...
Am 09.04.2014 um 17:29 schrieb itli...@schrievkrom.de: Am 09.04.2014 15:29, schrieb Sven Van Caekenberghe: Hi Marten, I will need (much) more detail, what are you trying to do that is not working according to you ? As far as I know Zinc HTTP Components does the right thing and can be used (configured) to do almost anything you want. It mostly depends on your mime types and their charset options. The browser sends UTF8 data and in my application code I get instances of ZnStringEntity and the contained string is converted to (?) ISO8859-1 (?) or CP-1252 (?). This seems to be due to the fact, that the entity instance always has a ZnUTF8Encoder to do the conversion. I would like to have UTF8 everywhere ... without all these conversions … There are no automatic conversions in Zinc. So Zinc is one of the pieces of software I know that do not assume stupid defaults :) Did you specify a proper Content-Type header including the charset information? Otherwise Zinc has no chance of knowing what to use and the default NullEncoder will make your string as wrong as your example above. Norbert
Re: [Pharo-users] Memory profiling: usage per class - instance in old memory
Thanks ! That's exactly what I was looking for. There is a compare method I dont quite understand but I think I found what is going on. I failed to grasp that an Array reply to #sizeInMemory with it's own size, without the sizes of its references. A single position object weight 96 bytes, which make the whole Array weight arround 8Mb, and the 32 objects arround 250 Mb. I'm not sure I can get arround that aspect since the computation is costly and I need its output multiple times. I will make further testing to see why the memory is not released at the end of the execution. Thanks again ! 2014-04-09 15:19 GMT+02:00 Sven Van Caekenberghe s...@stfx.eu: Hi Thomas, Fixing memory consumption problems is hard, but important: memory efficient code is automatically faster in the long run as well. Your issue sounds serious. However, I would start by trying to figure out what is happening at your coding level: somehow you (or something you use) must be holding on too much memory. Questioning low level memory management functionality should be the last resort, not the first. There is SpaceTally that you could use before and after running part of your code. Once something unexpected survives GC, there is the PointerFinder functionality (Inspector Explore Pointers) to find what holds onto objects. But no matter what, it is hard. If you have some public code that you could share to demonstrate your problem, then we could try to help. Sven On 09 Apr 2014, at 12:54, Thomas Bany mun.sys...@gmail.com wrote: Hi, My app is a parser/filter for binary files, that produces a bunch of ascii files. At the begining of the parsing, the filtering step involves the storage of the positions of 32 objects, each second for a whole day. So that's 32 Arrays with 86400 elements each. During this step, the memory used by my image grows from 50Mb to ~500Mb. I find it far too large since I'm pretty sure my arrays are the largest objects I create and only weight something like 300kb. The profiling of the app shows that hte footprint of the old memory went up by 350Mb. Which I'm pretty sure is super bad. Maybe as a consequence, after the parsing is finished, the memory footprint of the image stays at ~500Mb What are the tools I have to find where precisely the memory usage explodes ? For example, is it possible to browse the old memory objects to see which one fails to get GC'ed ? Thanks in advance, Thomas.
Re: [Pharo-users] Zinc HTTP server seems to convert always ...
On 09 Apr 2014, at 17:29, itli...@schrievkrom.de wrote: The browser sends UTF8 data and in my application code I get instances of ZnStringEntity and the contained string is converted to (?) ISO8859-1 (?) or CP-1252 (?). This seems to be due to the fact, that the entity instance always has a ZnUTF8Encoder to do the conversion. I still don't understand the problem, but consider this: ZnServer startDefaultOn: 1701. ZnClient new url: 'http://localhost:1701/echo'; entity: (ZnEntity with: 'An der schönen blauen Donau'); post. ZnClient new url: 'http://localhost:1701/echo'; entity: (ZnEntity with: 'An der schönen blauen Donau' type: (ZnMimeType textPlain charSet: #'iso-8859-1'; yourself)); post; yourself. In the first case, a UTF-8 encoded string is POST-ed and correctly returned (in a UTF-8 encoded response). In the second case, an ISO-8859-1 encoded string is POST-ed and correctly returned (in a UTF-8 encoded response). In both cases the decoding was done correctly, using the specified charset (if that is missing, the ZnNullEncoder is used). Now, ö is not a perfect test example because its encoding value in Unicode, 246 decimal, U+00F6 hex, still fits in 1 byte and hence survives null encoding/decoding. That is why the following still works, although it is wrong to drop the charset. ZnClient new url: 'http://localhost:1701/echo'; entity: (ZnEntity with: 'An der schönen blauen Donau' type: (ZnMimeType textPlain clearCharSet; yourself)); post; yourself. HTH, Sven -- Sven Van Caekenberghe http://stfx.eu Smalltalk is the Red Pill
Re: [Pharo-users] Memory profiling: usage per class - instance in old memory
On 09 Apr 2014, at 18:01, Thomas Bany mun.sys...@gmail.com wrote: Thanks ! That's exactly what I was looking for. There is a compare method I dont quite understand but I think I found what is going on. I failed to grasp that an Array reply to #sizeInMemory with it's own size, without the sizes of its references. A single position object weight 96 bytes, which make the whole Array weight arround 8Mb, and the 32 objects arround 250 Mb. Yes, #sizeInMemory is confusing, a recursive version would be nice, but also dangerous as it could get in a loop. Here is something related: http://www.humane-assessment.com/blog/traversal-enabled-pharo-objects/ If you want to use a huge data structure, you have to think carefully about your representations. There are tricks you can use to conserve memory: use more primitive types (SmallIntegers, bit flags, Symbols), use shared instances, use alternatives like ZTimestamp which is half the size of DateAndTime, or use your own integer time, sparse data structures, and so on - and you can hide these optimisations behind your standard API. I'm not sure I can get arround that aspect since the computation is costly and I need its output multiple times. I will make further testing to see why the memory is not released at the end of the execution. Good luck. Thanks again ! 2014-04-09 15:19 GMT+02:00 Sven Van Caekenberghe s...@stfx.eu: Hi Thomas, Fixing memory consumption problems is hard, but important: memory efficient code is automatically faster in the long run as well. Your issue sounds serious. However, I would start by trying to figure out what is happening at your coding level: somehow you (or something you use) must be holding on too much memory. Questioning low level memory management functionality should be the last resort, not the first. There is SpaceTally that you could use before and after running part of your code. Once something unexpected survives GC, there is the PointerFinder functionality (Inspector Explore Pointers) to find what holds onto objects. But no matter what, it is hard. If you have some public code that you could share to demonstrate your problem, then we could try to help. Sven On 09 Apr 2014, at 12:54, Thomas Bany mun.sys...@gmail.com wrote: Hi, My app is a parser/filter for binary files, that produces a bunch of ascii files. At the begining of the parsing, the filtering step involves the storage of the positions of 32 objects, each second for a whole day. So that's 32 Arrays with 86400 elements each. During this step, the memory used by my image grows from 50Mb to ~500Mb. I find it far too large since I'm pretty sure my arrays are the largest objects I create and only weight something like 300kb. The profiling of the app shows that hte footprint of the old memory went up by 350Mb. Which I'm pretty sure is super bad. Maybe as a consequence, after the parsing is finished, the memory footprint of the image stays at ~500Mb What are the tools I have to find where precisely the memory usage explodes ? For example, is it possible to browse the old memory objects to see which one fails to get GC'ed ? Thanks in advance, Thomas. -- Sven Van Caekenberghe Proudly supporting Pharo http://pharo.org http://association.pharo.org http://consortium.pharo.org
Re: [Pharo-users] Zinc HTTP server seems to convert always ...
Ok, if the browser sends POST/PUT request with a JSON structure it also sends charset = utf8 (in my case). That's ok, because for JSON this is more or less the default charset. Zinc now seems to notice, that UTF8 charset is needed and creates a ZnStringEntity with an UTF8Encoder. Now when my application tries to get the JSON string of that ZnStringEntity and builds the structure out of that string - and the strings are NOT UTF8, but converted to (?) ISO8859 ? Marten -- Marten Feldtmann
Re: [Pharo-users] Zinc HTTP server seems to convert always ...
Marten,
On 09 Apr 2014, at 18:25, itli...@schrievkrom.de wrote:
Ok, if the browser sends POST/PUT request with a JSON structure it also
sends charset = utf8 (in my case). That's ok, because for JSON this is
more or less the default charset.
Zinc now seems to notice, that UTF8 charset is needed and creates a
ZnStringEntity with an UTF8Encoder.
Now when my application tries to get the JSON string of that
ZnStringEntity and builds the structure out of that string - and the
strings are NOT UTF8, but converted to (?) ISO8859 ?
(NeoJSONReader fromString:
(ZnEntity with: (NeoJSONWriter toString: { #message - 'An der schönen blauen
Donau' } asDictionary)))
at: #message.
You must be doing something possibly wrong when you get the JSON string of
that ZnStringEntity and builds the structure out of that string (how do you
do that, BTW), so please write some code that demonstrates what is not right
according to you.
Sven
[Pharo-users] NeoJSON Parsing Nested Objects
I'm wrapping the Digital Ocean API. This particular response has a status,
and an array of droplet sizes.
For example:
'{status:OK,sizes:[{id:66,name:512MB,slug:512mb,memory:512,cpu:1,disk:20,cost_per_hour:0.00744,cost_per_month:5.0},{id:63,name:1GB,slug:1gb,memory:1024,cpu:1,disk:30,cost_per_hour:0.01488,cost_per_month:10.0}]}'
As a start, I did:
reader := NeoJSONReader on: jsonString readStream.
reader for: DoResponse customDo: [ :m | m decoder: [ :dict |
DoResponse new
status: (dict at: 'status');
contents: (dict at: 'sizes') ] ].
response := reader nextAs: DoResponse.
response isOk ifFalse: [ self error: 'Query failed!' ].
^ response contents.
However, the size objects are still plain dictionaries. I'd like to convert
them to DropletSize objects. And I'd rather leverage NeoJSON than implement
a custom DropletSize fromDictionary: if possible.
What's the best way to handle this?
Thanks.
-
Cheers,
Sean
--
View this message in context:
http://forum.world.st/NeoJSON-Parsing-Nested-Objects-tp4753695.html
Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.
Re: [Pharo-users] NeoJSON Parsing Nested Objects
Sean P. DeNigris wrote I'd like to convert them to DropletSize objects Duh :-P reader for: DoResponse do: [ :m | m mapInstVar: #status. (m mapInstVar: #contents to: #sizes) valueSchema: #ArrayOfDropletSizes ]. - Cheers, Sean -- View this message in context: http://forum.world.st/NeoJSON-Parsing-Nested-Objects-tp4753695p4753696.html Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.
Re: [Pharo-users] Zinc HTTP server seems to convert always ...
Ok, forget the JSON stuff - it has nothing to do with the problem.
Other way round:
My whole database and internal processing is done in UTF8. This is the
most important point here to mention.
Now the request comes into Zinc as mentioned below (the content of the
request is a JSON string only):
HTML-Request (charset=UTF-8) =(sends)= ZINC HTTP
Now Zinc sees the content of the body, knows that it is coded in UTF8
and creates a ZnStringEntity with UTF8Encoder.
Zinc HTTP =(builds)= ZnStringEntity (with UTF8Encoder)
The instance of ZnRequest and its entity value is an instance of
ZnStringEntity (with its encoder attribute is set to an instance to
ZnUTF8Encoder).
I checked the content of the string attribute of the ZnStringEntity and
this string is NOT encoded in UTF8 any more, but in either ISO8859-?
or WIN1252.
I think, that this is ok for almost all people, because they work with
some CodePages - but my internal processing assumes UTF8.
I just fixed this for me by changing ZnStringEntityinitializeEncoder
to ALWAYS set the encoder attribute to ZnNullEncoder and now everthing
is ok again. This means of course, that all apllication running with
that source code work in UTF 8 only ...
Marten
Am 09.04.2014 18:42, schrieb Sven Van Caekenberghe:
Marten,
On 09 Apr 2014, at 18:25, itli...@schrievkrom.de wrote:
Ok, if the browser sends POST/PUT request with a JSON structure it also
sends charset = utf8 (in my case). That's ok, because for JSON this is
more or less the default charset.
Zinc now seems to notice, that UTF8 charset is needed and creates a
ZnStringEntity with an UTF8Encoder.
Now when my application tries to get the JSON string of that
ZnStringEntity and builds the structure out of that string - and the
strings are NOT UTF8, but converted to (?) ISO8859 ?
(NeoJSONReader fromString:
(ZnEntity with: (NeoJSONWriter toString: { #message - 'An der schönen
blauen Donau' } asDictionary)))
at: #message.
You must be doing something possibly wrong when you get the JSON string of
that ZnStringEntity and builds the structure out of that string (how do you
do that, BTW), so please write some code that demonstrates what is not right
according to you.
Sven
--
Marten Feldtmann
Re: [Pharo-users] Socket Handles to C
On 9 April 2014 16:59, Sean P. DeNigris s...@clipperadams.com wrote:
How do Socket handles map to C socket IDs? I'm wrapping libssh2 via Native
Boost and I'd much rather create sockets via Smalltalk than C, but I'm not
sure how to pass the handle to a C function expecting a C socket ID. Maybe
I'm missing something really simple? Thanks.
socket plugin using own data structure for socket handles,
it includes different kind of internal information, including OS-specific
socket handle.
typedef struct
{
int sessionID;
int socketType; /* 0 = TCP, 1 = UDP */
void *privateSocketPtr;
} SQSocket, *SocketPtr;
extracting the OS-specific handle could be problematic, since it is in
that opaque void *privateSocketPtr; field.
Then:
sqUnixSocket.c
typedef struct privateSocketStruct
{
int s;/* Unix socket */
int connSema;/* connection io notification semaphore */
int readSema;/* read io notification semaphore */
int writeSema;/* write io notification semaphore */
int sockState;/* connection + data state */
int sockError;/* errno after socket error */
union sockaddr_any peer;/* default send/recv address for UDP */
socklen_t peerSize;/* dynamic sizeof(peer) */
union sockaddr_any sender;/* sender address for last UDP receive */
socklen_t senderSize;/* dynamic sizeof(sender) */
int multiListen;/* whether to listen for multiple connections */
int acceptedSock;/* a connection that has been accepted */
} privateSocketStruct;
so, to extract OS-level socked handle *on unix*, you have to
handle = ( (privateSocketStruct*) sqsocket.privateSocketPtr) - s.
where sqsocket is SQSocket.
there's even macros for that:
/*** Accessors for private socket members from a Squeak socket pointer ***/
#define _PSP(S)(((S)-privateSocketPtr))
#define PSP(S)((privateSocketStruct *)((S)-privateSocketPtr))
#define SOCKET(S)(PSP(S)-s)
#define SOCKETSTATE(S)(PSP(S)-sockState)
#define SOCKETERROR(S)(PSP(S)-sockError)
#define SOCKETPEER(S)(PSP(S)-peer)
#define SOCKETPEERSIZE(S)(PSP(S)-peerSize)
-
Cheers,
Sean
--
View this message in context:
http://forum.world.st/Socket-Handles-to-C-tp4753619.html
Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.
--
Best regards,
Igor Stasenko.
Re: [Pharo-users] Error: No factory specified
Renaming Cache to AbstractCache (or whatever else, it has no global references) I was able to load Glorp and have it running with the NativePostgresDriver. However there are a mix of things that are innecesary interdependant. For instance: * Running the tests the default glorp login doesn't have any encoding strategy, but it is required by the Glorp Session. So many tests fail. * The Encoders are in the DBXTalk packages :) I'm willing to help here, but what approach should we take here? I look forward for advice and guidance to accomplish this. Regards, Esteban A. Maringolo 2014-04-09 6:22 GMT-03:00 Sven Van Caekenberghe s...@stfx.eu: Thanks, Stephan. I will have a look and try to load/use Glorp myself towards the end of the week. On 09 Apr 2014, at 11:08, Stephan Eggermont step...@stack.nl wrote: Ok, there is a bug in The ConfigurationOfDBXDriver, the baseline has a versionString entry. That should be removed After removing that (and renaming Cache) it loads. Glorp loads already after renaming Cache. I'm not sure the isKindOf: on ProtoObject is safe. There is a renaming issue after loading Glorp (13188) Stephan
Re: [Pharo-users] NeoJSON Parsing Nested Objects
On 09 Apr 2014, at 19:18, Sean P. DeNigris s...@clipperadams.com wrote: I'm wrapping the Digital Ocean API. Cool !
Re: [Pharo-users] NeoJSON Parsing Nested Objects
2014-04-09 14:56 GMT-03:00 Sven Van Caekenberghe s...@stfx.eu: On 09 Apr 2014, at 19:18, Sean P. DeNigris s...@clipperadams.com wrote: I'm wrapping the Digital Ocean API. Cool ! +1 I use it for my Pharo hosting too (plus a JIRA instance on other droplet). Anybody using Supervisord or anything similar tool to manage pharo instances? Regards!
Re: [Pharo-users] Zinc HTTP server seems to convert always ...
On 09 Apr 2014, at 19:35, itli...@schrievkrom.de wrote:
Ok, forget the JSON stuff - it has nothing to do with the problem.
Other way round:
My whole database and internal processing is done in UTF8. This is the
most important point here to mention.
Why ? This means you forgo almost all String functionality, since UTF8 is a
variable length encoding not really suitable to character by character
processing.
Now the request comes into Zinc as mentioned below (the content of the
request is a JSON string only):
HTML-Request (charset=UTF-8) =(sends)= ZINC HTTP
Now Zinc sees the content of the body, knows that it is coded in UTF8
and creates a ZnStringEntity with UTF8Encoder.
Zinc HTTP =(builds)= ZnStringEntity (with UTF8Encoder)
The instance of ZnRequest and its entity value is an instance of
ZnStringEntity (with its encoder attribute is set to an instance to
ZnUTF8Encoder).
Yes, of course, UTF-8 (a variable length binary encoding) is converted into
native Pharo Strings (possibly WideStrings) containing Characters, each of
which is encoded using a Unicode code point value.
I checked the content of the string attribute of the ZnStringEntity and
this string is NOT encoded in UTF8 any more, but in either ISO8859-?
or WIN1252.
Here you lose me (again) ;-)
I think, that this is ok for almost all people, because they work with
some CodePages - but my internal processing assumes UTF8.
No, nobody works with code pages or any encoding, just native [Wide]Strings in
pure Unicode.
I just fixed this for me by changing ZnStringEntityinitializeEncoder
to ALWAYS set the encoder attribute to ZnNullEncoder and now everthing
is ok again. This means of course, that all apllication running with
that source code work in UTF 8 only ...
OK, I think I understand, you want UTF-8 to remain UTF-8. What you did is one
solution, but I think it is wrong to use a String to represent bytes.
This case is actually already implemented server side for Seaside:
ZnZincServerAdaptor#configureServerForBinaryReading
Seaside wants to do its own text conversions
server reader: [ :stream | ZnRequest readBinaryFrom: stream ]
The #reader: option is used here to read everything binary, without decoding to
Strings. You will get ZnZnByteArrayEntity objects back, containing the original
binary representation.
BTW, I think this is an interesting discussion.
Regards,
Sven
Marten
Am 09.04.2014 18:42, schrieb Sven Van Caekenberghe:
Marten,
On 09 Apr 2014, at 18:25, itli...@schrievkrom.de wrote:
Ok, if the browser sends POST/PUT request with a JSON structure it also
sends charset = utf8 (in my case). That's ok, because for JSON this is
more or less the default charset.
Zinc now seems to notice, that UTF8 charset is needed and creates a
ZnStringEntity with an UTF8Encoder.
Now when my application tries to get the JSON string of that
ZnStringEntity and builds the structure out of that string - and the
strings are NOT UTF8, but converted to (?) ISO8859 ?
(NeoJSONReader fromString:
(ZnEntity with: (NeoJSONWriter toString: { #message - 'An der schönen
blauen Donau' } asDictionary)))
at: #message.
You must be doing something possibly wrong when you get the JSON string of
that ZnStringEntity and builds the structure out of that string (how do
you do that, BTW), so please write some code that demonstrates what is not
right according to you.
Sven
--
Marten Feldtmann
Re: [Pharo-users] NeoJSON Parsing Nested Objects
On 09 Apr 2014, at 19:28, Sean P. DeNigris s...@clipperadams.com wrote: Sean P. DeNigris wrote I'd like to convert them to DropletSize objects Duh :-P reader for: DoResponse do: [ :m | m mapInstVar: #status. (m mapInstVar: #contents to: #sizes) valueSchema: #ArrayOfDropletSizes ]. BTW, I did some recent enhancements to NeoJSON mapping that could be interesting. http://www.smalltalkhub.com/#!/~SvenVanCaekenberghe/Neo/commits like #nextPut:as:
Re: [Pharo-users] Zinc HTTP server seems to convert always ...
And now the additional information: I'm working under Gemstone and I noticed quite some differences between Pharo and its Gemstone port of Zinc in this area ... I have to take a closer look here. Marten -- Marten Feldtmann
Re: [Pharo-users] Zinc HTTP server seems to convert always ...
On 09 Apr 2014, at 20:54, itli...@schrievkrom.de wrote: And now the additional information: I'm working under Gemstone and I noticed quite some differences between Pharo and its Gemstone port of Zinc in this area ... I have to take a closer look here. Marten I already expected that much. Yes, Zinc on Gemstone is seriously behind the original. Furthermore, I have never seen or worked with it. And although I have some sympathy for other Smalltalk implementations out there, I find it difficult to give free support for an expensive, closed source, commercial product. Sven
Re: [Pharo-users] NeoJSON Parsing Nested Objects
Esteban A. Maringolo wrote I'm wrapping the Digital Ocean API. Cool ! +1 The embryo is alive. See documentation at http://smalltalkhub.com/#!/~SeanDeNigris/DigitalOcean A few supported operations: DoDroplet allActive. DoDroplet allActive detect: [ :e | e name = 'mycooldomain.org' ]. DoDropletSize all. DoDropletSize named: '512MB' - Cheers, Sean -- View this message in context: http://forum.world.st/NeoJSON-Parsing-Nested-Objects-tp4753695p4753749.html Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.
Re: [Pharo-users] Zinc HTTP server seems to convert always ...
+1 to Sven's comment and Marten - you should post this on the GemStone list as one of their guys will be able to help you with the encoding issues. Paul Sven Van Caekenberghe-2 wrote On 09 Apr 2014, at 20:54, itlists@ wrote: And now the additional information: I'm working under Gemstone and I noticed quite some differences between Pharo and its Gemstone port of Zinc in this area ... I have to take a closer look here. Marten I already expected that much. Yes, Zinc on Gemstone is seriously behind the original. Furthermore, I have never seen or worked with it. And although I have some sympathy for other Smalltalk implementations out there, I find it difficult to give free support for an expensive, closed source, commercial product. Sven -- View this message in context: http://forum.world.st/Zinc-HTTP-server-seems-to-convert-always-tp4753613p4753780.html Sent from the Pharo Smalltalk Users mailing list archive at Nabble.com.
Re: [Pharo-users] [Pharo-dev] Pharo Consortium: New Gold Member Lam Research
Great! Doru -- www.tudorgirba.com Every thing has its own flow. On 09.04.2014, at 11:38, Marcus Denker marcus.den...@inria.fr wrote: The Pharo Consortium is very happy to announce that Lam Research has joined the Consortium as a Gold Industrial Member. More about - Lam Research: http://lamrc.com - Pharo Consortium: http://consortium.pharo.org The goal of the Pharo Consortium is to allow companies to support the ongoing development and future of Pharo. Individuals can support Pharo via the Pharo Association: http://association.pharo.org
