Re: [U2] [UV] RESIZE INPLACE

2013-04-28 Thread Manu Fernandes
Hi,

Given the risk of manipulating a file of this size, I recommend the use of 
distributed files (DEFINE.DF).
Just as effective, if not better, each part file is administered individually 
(backups, resizing, indexing, !accessing, locking,...)

Procedure :

1 - analyse the keys to build a distribution algorythm ; at worst use hashing 
algorythm ; don't forget a elsewhere partnumber (1 ) 

2 - create part files (define how many, size, ...,  by analysing number 
key-records, time growing ,...)

3 - define distributed file ; DICT adress the original DICT

4 - copy all record from orig.file to df.file (do it one time before live to 
check if all keys can be processed by your algorythm)

5 - edit VOC orig.file to adress df.file as data file

6 - resize all part file individually.

7 - delete the orig.DATA file index from os ; to get back your 144gb

My two pence
manu

 -Message d'origine-
 De : u2-users-boun...@listserver.u2ug.org [mailto:u2-users-
 boun...@listserver.u2ug.org] De la part de Perry Taylor
 Envoyé : jeudi 25 avril 2013 22:10
 À : U2-Users List
 Objet : [U2] [UV] RESIZE INPLACE
 
 Before I go and resize a 144GB file has anyone had any experiences with the
 INPLACE option of RESIZE in UniVerse?  Good, bad, ugly???
 
 Thanks.
 Perry
 
 Perry Taylor
 Senior MV Architect
 ZirMed
 888 West Market Street, Suite 400
 Louisville, KY 40202
 www.zirmed.comhttp://www.zirmed.com/
 
 
 
 CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is
 for the sole use of the intended recipient(s) and may contain confidential and
 privileged information.  Any unauthorized review, use, disclosure or 
 distribution
 is prohibited. ZirMed, Inc. has strict policies regarding the content of 
 e-mail
 communications, specifically Protected Health Information, any
 communications containing such material will be returned to the originating
 party with such advisement noted. If you are not the intended recipient, 
 please
 contact the sender by reply e-mail and destroy all copies of the original
 message.
 ___
 U2-Users mailing list
 U2-Users@listserver.u2ug.org
 http://listserver.u2ug.org/mailman/listinfo/u2-users

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users


Re: [U2] What tools do you use for data warehouse...

2013-04-28 Thread Manu Fernandes
Hi,

We use a in-house ETL which is based on DICT independant table/column 
definition.
The user interface to define table/column is a SB+ app ; easy to use.

At first, you define you tables and columns to be created/loaded into your dw ; 
each table are linked to one datafile and in case of mv/sv'ed; linked to a 
controling field (mv/sv)

Next, you define each column by setting their sql properties, the source of the 
value (attribute number or sb+.expression) ; the human label of the column ; 
with it you can create transformed data. (by default you can retrieve the 
dictionnaries) here a screen sample : 
http://wiki.infodata.lu/lib/exe/fetch.php?media=public/etl/etl_dw_defn1.png 

With these table/columns definition, the system build sql-stmt to  create the 
table into the dw and load the data into the table via insert / loadinto ,...

After what,  the ETL send the sql-stmt to the dw.

The sql-stmts are build from sql dialect-templates then , we can adress all SQL 
dbms 

After what, you can define datamarts ; as a set of tables, and request 
immediate or, via crontab/taskmanager, sheduled refreshing processus of one/* 
datamart

For more details, send me a mail.

manu

 -Message d'origine-
 De : u2-users-boun...@listserver.u2ug.org [mailto:u2-users-
 boun...@listserver.u2ug.org] De la part de Tom Whitmore
 Envoyé : vendredi 26 avril 2013 19:50
 À : U2 Users List
 Objet : [U2] What tools do you use for data warehouse...
 
 Hi,
 I was wondering what tools you use to export data to an SQL data warehouse
 from UniVerse.  This export could occur on multiple flavors of Unix.
 
 What we would need to do is extract the UV data and perform some data
 translations before importing the data into the SQL table.
 
 I know at one point DataStage was a powerful but expensive tool that would
 accomplish this task.
 
 All suggestions are greatly appreciated!
 Tom Whitmore
 RATEX Business Solutions
 ___
 U2-Users mailing list
 U2-Users@listserver.u2ug.org
 http://listserver.u2ug.org/mailman/listinfo/u2-users

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users


Re: [U2] [UV] RESIZE INPLACE

2013-04-28 Thread Robert Frailey

Thats cool
- Original Message - 
From: Manu Fernandes e...@infodata.lu

To: U2 Users List u2-users@listserver.u2ug.org
Sent: Sunday, April 28, 2013 2:45 AM
Subject: Re: [U2] [UV] RESIZE INPLACE



Hi,

Given the risk of manipulating a file of this size, I recommend the use of 
distributed files (DEFINE.DF).
Just as effective, if not better, each part file is administered 
individually (backups, resizing, indexing, !accessing, locking,...)


Procedure :

1 - analyse the keys to build a distribution algorythm ; at worst use 
hashing algorythm ; don't forget a elsewhere partnumber (1 )


2 - create part files (define how many, size, ...,  by analysing number 
key-records, time growing ,...)


3 - define distributed file ; DICT adress the original DICT

4 - copy all record from orig.file to df.file (do it one time before live 
to check if all keys can be processed by your algorythm)


5 - edit VOC orig.file to adress df.file as data file

6 - resize all part file individually.

7 - delete the orig.DATA file index from os ; to get back your 144gb

My two pence
manu


-Message d'origine-
De : u2-users-boun...@listserver.u2ug.org [mailto:u2-users-
boun...@listserver.u2ug.org] De la part de Perry Taylor
Envoyé : jeudi 25 avril 2013 22:10
À : U2-Users List
Objet : [U2] [UV] RESIZE INPLACE

Before I go and resize a 144GB file has anyone had any experiences with 
the

INPLACE option of RESIZE in UniVerse?  Good, bad, ugly???

Thanks.
Perry

Perry Taylor
Senior MV Architect
ZirMed
888 West Market Street, Suite 400
Louisville, KY 40202
www.zirmed.comhttp://www.zirmed.com/



CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, 
is
for the sole use of the intended recipient(s) and may contain 
confidential and
privileged information.  Any unauthorized review, use, disclosure or 
distribution
is prohibited. ZirMed, Inc. has strict policies regarding the content of 
e-mail

communications, specifically Protected Health Information, any
communications containing such material will be returned to the 
originating
party with such advisement noted. If you are not the intended recipient, 
please

contact the sender by reply e-mail and destroy all copies of the original
message.
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users


___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users 


___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users


Re: [U2] What tools do you use for data warehouse...

2013-04-28 Thread Robert Frailey

cool thanks
- Original Message - 
From: Wols Lists antli...@youngman.org.uk

To: u2-users@listserver.u2ug.org
Sent: Friday, April 26, 2013 4:38 PM
Subject: Re: [U2] What tools do you use for data warehouse...



On 26/04/13 20:33, Kevin Le wrote:
We have a few applications written in VB that use ODBC to access 
Unidata...

but I find it to be a security risk since ODBC can be used in Access and
allow the user to dump entire tables of data with no
controls/auditing/logging.

Are there any other ways of getting data from Unidata that could be more
secure?


Look on PickWiki for a bunch of data dump programs. I wrote some, I'm
sure there are more. They'll dump stuff in a variety of flat-file
formats for you to pick up from the CIFS (or NFS) share that other
people have suggested.

Cheers,
Wol
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users 


___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users