Re: [U2] Why Pick U2?
I've used them in development, but not in Production. I am just about to post an article that includes usage; I just haven't had time to finish proof-reading it. For windows, check it this question: http://superuser.com/questions/34388/whats-the-best-ramdisk-for-windows Regards, Dan -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of DavidJMurray (mvdbs.com) Sent: Thursday, August 25, 2011 9:19 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Why Pick U2? Is anyone using a RAMDisk with U2 files? I have noticed that there are two types of ram disks within Linux - tmpfs and /dev/ram1 which can be used to create a small file system. Does anyone have any practical experience on these options? Is there an effective option for MS-Windows? Cheers, djm Daniel McGrath wrote: 6) Not only can you use U2 in a relational manner, complete with SQL access, but since its core data structure are hash tables, if you want to use it just as a key-value store look no further. If you want to run it is a key-value store in memory (aka Memcache), mount a RAMDisk and place the file there. Voila. No need to configure separate systems, as flexible as you want it to be. You can even replicate from it to multiple other servers if you want. Want it encrypted too? Done! - Learn and Do Excel and Share http://mvdbs.com http://mvdbs.com -- View this message in context: http://old.nabble.com/Why-Pick-U2--tp32061959p32335234.html Sent from the U2 - Users mailing list archive at Nabble.com. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Why Pick U2?
Well I guess I should rephrase... It is seen as another block device to the OS, Windows, Linux or what have you. So, in Windows it would be a drive letter. In Linux it would be a block device that you could partition and format. I have not personally used it, but, there are folks out there using it in the relational database world. The cheaper route to go would be to create a ramdisk in Linux, in the RAM itself... I have not done that in a long time. I have never created a RAMDISK in windows... not since the DOS days anyway at least. On Thu, Aug 25, 2011 at 11:28 AM, John Thompson jthompson...@gmail.comwrote: Its expensive... and it seems fairly safe as IBM, HP, and Dell are all selling it now... Take a look at this: http://www.fusionio.com/ http://www-304.ibm.com/shop/americas/content/home/store_IBMPublicUSA/en_US/ibmfusionio.html It basically acts just like a disk from what I understand, except that you can't boot from it. On Thu, Aug 25, 2011 at 11:19 AM, DavidJMurray (mvdbs.com) nab...@mvdbs.com wrote: Is anyone using a RAMDisk with U2 files? I have noticed that there are two types of ram disks within Linux - tmpfs and /dev/ram1 which can be used to create a small file system. Does anyone have any practical experience on these options? Is there an effective option for MS-Windows? Cheers, djm Daniel McGrath wrote: 6) Not only can you use U2 in a relational manner, complete with SQL access, but since its core data structure are hash tables, if you want to use it just as a key-value store look no further. If you want to run it is a key-value store in memory (aka Memcache), mount a RAMDisk and place the file there. Voila. No need to configure separate systems, as flexible as you want it to be. You can even replicate from it to multiple other servers if you want. Want it encrypted too? Done! - Learn and Do Excel and Share http://mvdbs.com http://mvdbs.com -- View this message in context: http://old.nabble.com/Why-Pick-U2--tp32061959p32335234.html Sent from the U2 - Users mailing list archive at Nabble.com. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users -- John Thompson -- John Thompson ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Why Pick U2?
I mean using the existing RAM within the system to create and mount a small file system which a temporary U2 file can be created and used; rather than a complete SSD device. John Thompson-15 wrote: Its expensive... and it seems fairly safe as IBM, HP, and Dell are all selling it now... - Learn and Do Excel and Share http://mvdbs.com http://mvdbs.com -- View this message in context: http://old.nabble.com/Why-Pick-U2--tp32061959p32335366.html Sent from the U2 - Users mailing list archive at Nabble.com. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Why Pick U2?
Yes, but, old school ramdisks (i.e. creating disks in existing RAM), aren't exactly reliable if something goes wrong (i.e. power anomalies, bad memory block, etc.). So whatever you would be storing would have to be temporary (which I guess you have already said), AND, you would have to NOT care if you lost it in a production environment. At least from what I remember of them... but like I said its been a while for me. I'm sure someone has tried it before :) On Thu, Aug 25, 2011 at 11:35 AM, DavidJMurray (mvdbs.com) nab...@mvdbs.com wrote: I mean using the existing RAM within the system to create and mount a small file system which a temporary U2 file can be created and used; rather than a complete SSD device. John Thompson-15 wrote: Its expensive... and it seems fairly safe as IBM, HP, and Dell are all selling it now... - Learn and Do Excel and Share http://mvdbs.com http://mvdbs.com -- View this message in context: http://old.nabble.com/Why-Pick-U2--tp32061959p32335366.html Sent from the U2 - Users mailing list archive at Nabble.com. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users -- John Thompson ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Why Pick U2?
I use the following scripts with our Linux system [george@alpha mbin]$ cat mount-temp /bin/mount -t tmpfs -o size=1G,nr_inodes=5k tmpfs /usr/tmpfs (cd /usr ; /bin/tar xvf /usr/drive1/tempfsbackup .) [george@alpha mbin]$ cat unmount-temp (cd /usr ; /bin/tar cvf /usr/drive1/tempfsbackup ./tmpfs) /bin/umount /usr/tmpfs First I created the /usr/tmpfs manually (by executing the first line of mount-temp) Second, I cd'd into the directory, then UV to create a UV account Third, I went into the UV login account, and linked it as a valid account (So I could reference Q pointers) I run the unmount script to tar up the account first and save the tar file, then release the tempfs I run the mount script to create the tempfs, then untar the account I forget what the max size of the /tmpfs can be (I just set mine up with 1G) George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of DavidJMurray (mvdbs.com) Sent: Thursday, August 25, 2011 11:35 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Why Pick U2? I mean using the existing RAM within the system to create and mount a small file system which a temporary U2 file can be created and used; rather than a complete SSD device. John Thompson-15 wrote: Its expensive... and it seems fairly safe as IBM, HP, and Dell are all selling it now... - Learn and Do Excel and Share http://mvdbs.com http://mvdbs.com -- View this message in context: http://old.nabble.com/Why-Pick-U2-- tp32061959p32335366.html Sent from the U2 - Users mailing list archive at Nabble.com. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Why Pick U2?
keep in mind: SSD drives have a limited number of writes (much better today than before) tempfs do not (or at least I don't think so) SSD drives however usually can store a LOT more than a tempfs file, which depends on your physical memory - You couldn't create a 100GB tempfs if you wanted to SSD drives don't forget when you reboot -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of DavidJMurray (mvdbs.com) Sent: Thursday, August 25, 2011 11:35 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Why Pick U2? I mean using the existing RAM within the system to create and mount a small file system which a temporary U2 file can be created and used; rather than a complete SSD device. John Thompson-15 wrote: Its expensive... and it seems fairly safe as IBM, HP, and Dell are all selling it now... - Learn and Do Excel and Share http://mvdbs.com http://mvdbs.com -- View this message in context: http://old.nabble.com/Why-Pick-U2-- tp32061959p32335366.html Sent from the U2 - Users mailing list archive at Nabble.com. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Why Pick U2?
It looks like you could do it in Windows 2000 Server natively... http://social.technet.microsoft.com/Search/en-US?query=ramdiskac=8 Not sure what they did with it in 2003/2008 Server. They may call it a RAMDrive On Thu, Aug 25, 2011 at 11:43 AM, George Gallen ggal...@wyanokegroup.comwrote: I use the following scripts with our Linux system [george@alpha mbin]$ cat mount-temp /bin/mount -t tmpfs -o size=1G,nr_inodes=5k tmpfs /usr/tmpfs (cd /usr ; /bin/tar xvf /usr/drive1/tempfsbackup .) [george@alpha mbin]$ cat unmount-temp (cd /usr ; /bin/tar cvf /usr/drive1/tempfsbackup ./tmpfs) /bin/umount /usr/tmpfs First I created the /usr/tmpfs manually (by executing the first line of mount-temp) Second, I cd'd into the directory, then UV to create a UV account Third, I went into the UV login account, and linked it as a valid account (So I could reference Q pointers) I run the unmount script to tar up the account first and save the tar file, then release the tempfs I run the mount script to create the tempfs, then untar the account I forget what the max size of the /tmpfs can be (I just set mine up with 1G) George -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of DavidJMurray (mvdbs.com) Sent: Thursday, August 25, 2011 11:35 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Why Pick U2? I mean using the existing RAM within the system to create and mount a small file system which a temporary U2 file can be created and used; rather than a complete SSD device. John Thompson-15 wrote: Its expensive... and it seems fairly safe as IBM, HP, and Dell are all selling it now... - Learn and Do Excel and Share http://mvdbs.com http://mvdbs.com -- View this message in context: http://old.nabble.com/Why-Pick-U2-- tp32061959p32335366.html Sent from the U2 - Users mailing list archive at Nabble.com. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users -- John Thompson ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Why Pick U2?
as for windows - I used to use a program called clone drive or something like that It would create a virtual drive from memory http://virtual-clonedrive.en.softonic.com/ -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] On Behalf Of DavidJMurray (mvdbs.com) Sent: Thursday, August 25, 2011 11:19 AM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Why Pick U2? Is anyone using a RAMDisk with U2 files? I have noticed that there are two types of ram disks within Linux - tmpfs and /dev/ram1 which can be used to create a small file system. Does anyone have any practical experience on these options? Is there an effective option for MS-Windows? Cheers, djm Daniel McGrath wrote: 6) Not only can you use U2 in a relational manner, complete with SQL access, but since its core data structure are hash tables, if you want to use it just as a key-value store look no further. If you want to run it is a key-value store in memory (aka Memcache), mount a RAMDisk and place the file there. Voila. No need to configure separate systems, as flexible as you want it to be. You can even replicate from it to multiple other servers if you want. Want it encrypted too? Done! - Learn and Do Excel and Share http://mvdbs.com http://mvdbs.com -- View this message in context: http://old.nabble.com/Why-Pick-U2-- tp32061959p32335234.html Sent from the U2 - Users mailing list archive at Nabble.com. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Why Pick U2?
I was looking at writing a similar article/blog post as I am reading on coalesced hashing at the moment. I'll wait until yours appears. Daniel McGrath wrote: I am just about to post an article that includes usage; I just haven't had time to finish proof-reading it. - Learn and Do Excel and Share http://mvdbs.com http://mvdbs.com -- View this message in context: http://old.nabble.com/Why-Pick-U2--tp32061959p32335579.html Sent from the U2 - Users mailing list archive at Nabble.com. ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] callHTTP creating Header (Karl-Heinz Winter)
I found the solution by myself! The problem could be, that the functions 'setRequestHeader' und addRequestParameter' are formatting the data in any way, that the webserver doesn`t understand the request. When I logged the outgoing traffic to port 80, I have seen valuemarks in the header information. On Pickwiki there is a good example of calling a web service: http://www.pickwiki.com/cgi-bin/wiki.pl?CallHTTP. The second example shows how to do a request with OPENSOCKET, WRITESOCKET and READSOCKET. These classes are posting the data without any change. I tried it and the webserver response ist OK! Karl-Heinz old message was: Message: 1 Date: Tue, 23 Aug 2011 21:03:31 +0200 From: Karl-Heinz Winter karl-heinz.win...@freenet.de To: u2-users@listserver.u2ug.org Subject: [U2] callHTTP creating Header Message-ID: 4e53f983.10...@freenet.de Content-Type: text/plain; charset=ISO-8859-15; format=flowed in a header with post-data I have to create the header-information like this: Content-type: text/xml;charset=UTF-8 Accept: text/xml, multipart/related, text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2 When creating it with setRequestHeader or with addRequestParamete I will receive the error 415 (Unsupported media type) from the server. How can I create the correct header? Thanks in advance Karl-Heinz ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] callHTTP creating Header (Karl-Heinz Winter)
Karl - your original request said: How can I create the correct header? My mental response was stop bothering with CallHTTP and use cURL. I refrained from posting that because of the inevitable retribution from people who prefer to bang their heads against flaky software rather than just looking outside of the box for a real solution. ( oh he is sooo asking for it...) But now that you've moved from CallHTTP to sockets. Mein Gott, Mann! Nein Nein! Tun Sie nicht das! Sockets are much lower-level than what you need to do HTTP calls. If you have a good solution to your problem, OK, sockets are great for doing many things. And it's nice if you found free code that does exactly what you need. But if you don't actually need complex software at that level, then for maintainability later, you should consider a higher-level solution. Well, that's my opinion anyway - use the right tools for the job, and all that... Viel Erfolg! T From: Karl-Heinz Winter The second example shows how to do a request with OPENSOCKET, WRITESOCKET and READSOCKET. These classes are posting the data without any change. I tried it and the webserver response ist OK! When creating it with setRequestHeader or with addRequestParamete I will receive the error 415 (Unsupported media type) from the server. How can I create the correct header? ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Why Pick U2?
On 25/08/11 16:47, George Gallen wrote: keep in mind: SSD drives have a limited number of writes (much better today than before) tempfs do not (or at least I don't think so) SSD drives however usually can store a LOT more than a tempfs file, which depends on your physical memory - You couldn't create a 100GB tempfs if you wanted to Completely wrong ... :-) My /tmp dir happens to be 8Gb in size - on a system with 8Gb of ram. I *also* have a 20Gb /var/tmp/portage. Both of these are tmpfs systems, so I have 28Gb of tmpfs on a system with only 8Gb of ram :-) That said, you must have sufficient total memory - I've got something in excess of 40Gb of total address space. I'm not sure how big my swap partitions are, but there's more than 32Gb (my rule is at least twice the mobo's max ram capacity, and with 1.5Tb of disk space, that's peanuts :-) But ram disks do default to half available ram, and that burnt me when I first hit it... SSD drives don't forget when you reboot But that's the whole point of ram disks :-) Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Why Pick U2?
On 25/08/11 16:19, DavidJMurray (mvdbs.com) wrote: Is anyone using a RAMDisk with U2 files? I have noticed that there are two types of ram disks within Linux - tmpfs and /dev/ram1 which can be used to create a small file system. Does anyone have any practical experience on these options? tmpfs on linux is pretty reliable. From my other post you can see I use it by default :-) Not sure what you're trying to do, but you might want to combine it with union mounting. If you want to create temporary workspace, you might be better creating it on disk and throwing it away when you're finished, but if you really want to use ramdisk then ... Create a set of empty files pointed to from your VOC (or VOCLIB) elsewhere. Union mount a tmpfs over the directory containing your empty files, and then you don't need to worry about whether they're there after a reboot or anything like that. When the system comes up, it will see the empty files on the hard disk. As the files are updated, they'll be stored on ramdisk. When the system reboots, the updated files will be lost and the system will once again see the empty files on disk ... usw usw usw. Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] callHTTP creating Header
Karl, I have used both setrequestheader and addrequestparameter without issues. Add 3 parameters using AddRequestParameter: sub httpPostXML h = '';rh = '';rd = '';rs = '';sh = ''; pd = ''; sch = '';cf='' URL = 'http://myuri' boundary = '--':system(99) z = createRequest(URL,'POST:multipart/form-data; boundary=':boundary,h) z = addRequestParameter(h,'user_id','999','Content-Disposition: form-data; name=user_id') z = addRequestParameter(h,'pwd','*pa55*','Content-Disposition: form-data; name=pwd') ct = 'Content-Disposition: form-data; name=invoice_xml; filename=test.xml':@am:'Content-Type: text/xml' cv = '?xml version=1.0 encoding=UTF-8?!DOCTYPE cXML SYSTEM http://xml.cXML.org/schemas/cXML/1.2.009/InvoiceDetail.dtd;cXML etc' if not(addRequestParameter(h,'invoice_xml',cv,ct)) then crt 'status :': submitRequest(h,25000,pd,rh,rd,rs) crt 'headers:':rh crt 'data :':rd crt 'httpstatus :':rs end Add a request header (content is compressed) using SetRequestHeader: hn = 'Content-Encoding' hv = 'gzip' z = setRequestHeader(httpHandle,hn,hv) -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Tony Gravagno Sent: Friday, 26 August 2011 08:53 To: u2-users@listserver.u2ug.org Subject: Re: [U2] callHTTP creating Header (Karl-Heinz Winter) Karl - your original request said: How can I create the correct header? My mental response was stop bothering with CallHTTP and use cURL. I refrained from posting that because of the inevitable retribution from people who prefer to bang their heads against flaky software rather than just looking outside of the box for a real solution. ( oh he is sooo asking for it...) But now that you've moved from CallHTTP to sockets. Mein Gott, Mann! Nein Nein! Tun Sie nicht das! Sockets are much lower-level than what you need to do HTTP calls. If you have a good solution to your problem, OK, sockets are great for doing many things. And it's nice if you found free code that does exactly what you need. But if you don't actually need complex software at that level, then for maintainability later, you should consider a higher-level solution. Well, that's my opinion anyway - use the right tools for the job, and all that... Viel Erfolg! T From: Karl-Heinz Winter The second example shows how to do a request with OPENSOCKET, WRITESOCKET and READSOCKET. These classes are posting the data without any change. I tried it and the webserver response ist OK! When creating it with setRequestHeader or with addRequestParamete I will receive the error 415 (Unsupported media type) from the server. How can I create the correct header? ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] Why Pick U2?
But swap space isn't really memory, it's disk and nowhere near as fast as memory, and (I don't know for sure) probably even far slower than SSD's. In reality, if your creating a tempfs partition for the speed of memory vs disk, then using swap space defeats the purpose. George Gallen Senior Programmer/Analyst Accounting/Data Division ggal...@wyanokegroup.com ph:856.848.9005 Ext 220 The Wyanoke Group http://www.wyanokegroup.com From: u2-users-boun...@listserver.u2ug.org [u2-users-boun...@listserver.u2ug.org] On Behalf Of Wols Lists [antli...@youngman.org.uk] Sent: Thursday, August 25, 2011 7:28 PM To: u2-users@listserver.u2ug.org Subject: Re: [U2] Why Pick U2? On 25/08/11 16:47, George Gallen wrote: keep in mind: SSD drives have a limited number of writes (much better today than before) tempfs do not (or at least I don't think so) SSD drives however usually can store a LOT more than a tempfs file, which depends on your physical memory - You couldn't create a 100GB tempfs if you wanted to Completely wrong ... :-) My /tmp dir happens to be 8Gb in size - on a system with 8Gb of ram. I *also* have a 20Gb /var/tmp/portage. Both of these are tmpfs systems, so I have 28Gb of tmpfs on a system with only 8Gb of ram :-) That said, you must have sufficient total memory - I've got something in excess of 40Gb of total address space. I'm not sure how big my swap partitions are, but there's more than 32Gb (my rule is at least twice the mobo's max ram capacity, and with 1.5Tb of disk space, that's peanuts :-) But ram disks do default to half available ram, and that burnt me when I first hit it... SSD drives don't forget when you reboot But that's the whole point of ram disks :-) Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users