Re: [U2] What tools do you use for data warehouse...

2013-04-28 Thread Robert Frailey 

cool thanks
- Original Message - 
From: "Wols Lists" 

To: 
Sent: Friday, April 26, 2013 4:38 PM
Subject: Re: [U2] What tools do you use for data warehouse...



On 26/04/13 20:33, Kevin Le wrote:
We have a few applications written in VB that use ODBC to access 
Unidata...

but I find it to be a security risk since ODBC can be used in Access and
allow the user to dump entire tables of data with no
controls/auditing/logging.

Are there any other ways of getting data from Unidata that could be more
secure?


Look on PickWiki for a bunch of data dump programs. I wrote some, I'm
sure there are more. They'll dump stuff in a variety of flat-file
formats for you to pick up from the CIFS (or NFS) share that other
people have suggested.

Cheers,
Wol
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users 


___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

Re: [U2] [UV] RESIZE INPLACE

2013-04-28 Thread Robert Frailey 

Thats cool
- Original Message - 
From: "Manu Fernandes" 

To: "U2 Users List" 
Sent: Sunday, April 28, 2013 2:45 AM
Subject: Re: [U2] [UV] RESIZE INPLACE



Hi,

Given the risk of manipulating a file of this size, I recommend the use of 
distributed files (DEFINE.DF).
Just as effective, if not better, each part file is administered 
individually (backups, resizing, indexing, !accessing, locking,...)


Procedure :

1 - analyse the keys to build a distribution algorythm ; at worst use 
hashing algorythm ; don't forget a elsewhere partnumber (1 )


2 - create part files (define how many, size, ...,  by analysing number 
key-records, time growing ,...)


3 - define distributed file ; DICT adress the original DICT

4 - copy all record from orig.file to df.file (do it one time before live 
to check if all keys can be processed by your algorythm)


5 - edit VOC orig.file to adress df.file as data file

6 - resize all part file individually.

7 - delete the orig.DATA file &index from os ; to get back your 144gb

My two pence
manu


-Message d'origine-
De : u2-users-boun...@listserver.u2ug.org [mailto:u2-users-
boun...@listserver.u2ug.org] De la part de Perry Taylor
Envoyé : jeudi 25 avril 2013 22:10
À : U2-Users List
Objet : [U2] [UV] RESIZE INPLACE

Before I go and resize a 144GB file has anyone had any experiences with 
the

INPLACE option of RESIZE in UniVerse?  Good, bad, ugly???

Thanks.
Perry

Perry Taylor
Senior MV Architect
ZirMed
888 West Market Street, Suite 400
Louisville, KY 40202
www.zirmed.com



CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, 
is
for the sole use of the intended recipient(s) and may contain 
confidential and
privileged information.  Any unauthorized review, use, disclosure or 
distribution
is prohibited. ZirMed, Inc. has strict policies regarding the content of 
e-mail

communications, specifically Protected Health Information, any
communications containing such material will be returned to the 
originating
party with such advisement noted. If you are not the intended recipient, 
please

contact the sender by reply e-mail and destroy all copies of the original
message.
___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users


___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users 


___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

Re: [U2] What tools do you use for data warehouse...

2013-04-28 Thread Manu Fernandes 
Hi,

We use a in-house ETL which is based on DICT independant "table/column" 
definition.
The user interface to define table/column is a SB+ app ; easy to use.

At first, you define you tables and columns to be created/loaded into your dw ; 
each table are linked to one datafile and in case of mv/sv'ed; linked to a 
"controling" field (mv/sv)

Next, you define each column by setting their sql properties, the source of the 
value (attribute number or sb+.expression) ; the human label of the column ; 
with it you can create "transformed" data. (by default you can retrieve the 
dictionnaries) here a screen sample : 
http://wiki.infodata.lu/lib/exe/fetch.php?media=public/etl/etl_dw_defn1.png 

With these table/columns definition, the system build sql-stmt to  create the 
table into the dw and load the data into the table via insert / loadinto ,...

After what,  the ETL send the sql-stmt to the dw.

The sql-stmts are build from sql dialect-templates then , we can adress all SQL 
dbms 

After what, you can define datamarts ; as a set of tables, and request 
immediate or, via crontab/taskmanager, sheduled refreshing processus of one/* 
datamart

For more details, send me a mail.

manu

> -Message d'origine-
> De : u2-users-boun...@listserver.u2ug.org [mailto:u2-users-
> boun...@listserver.u2ug.org] De la part de Tom Whitmore
> Envoyé : vendredi 26 avril 2013 19:50
> À : U2 Users List
> Objet : [U2] What tools do you use for data warehouse...
> 
> Hi,
> I was wondering what tools you use to export data to an SQL data warehouse
> from UniVerse.  This export could occur on multiple flavors of Unix.
> 
> What we would need to do is extract the UV data and perform some data
> "translations" before importing the data into the SQL table.
> 
> I know at one point DataStage was a powerful but expensive tool that would
> accomplish this task.
> 
> All suggestions are greatly appreciated!
> Tom Whitmore
> RATEX Business Solutions
> ___
> U2-Users mailing list
> U2-Users@listserver.u2ug.org
> http://listserver.u2ug.org/mailman/listinfo/u2-users

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users

Re: [U2] [UV] RESIZE INPLACE

2013-04-28 Thread Manu Fernandes 
Hi,

Given the risk of manipulating a file of this size, I recommend the use of 
distributed files (DEFINE.DF).
Just as effective, if not better, each part file is administered individually 
(backups, resizing, indexing, !accessing, locking,...)

Procedure :

1 - analyse the keys to build a distribution algorythm ; at worst use hashing 
algorythm ; don't forget a elsewhere partnumber (1 ) 

2 - create part files (define how many, size, ...,  by analysing number 
key-records, time growing ,...)

3 - define distributed file ; DICT adress the original DICT

4 - copy all record from orig.file to df.file (do it one time before live to 
check if all keys can be processed by your algorythm)

5 - edit VOC orig.file to adress df.file as data file

6 - resize all part file individually.

7 - delete the orig.DATA file &index from os ; to get back your 144gb

My two pence
manu

> -Message d'origine-
> De : u2-users-boun...@listserver.u2ug.org [mailto:u2-users-
> boun...@listserver.u2ug.org] De la part de Perry Taylor
> Envoyé : jeudi 25 avril 2013 22:10
> À : U2-Users List
> Objet : [U2] [UV] RESIZE INPLACE
> 
> Before I go and resize a 144GB file has anyone had any experiences with the
> INPLACE option of RESIZE in UniVerse?  Good, bad, ugly???
> 
> Thanks.
> Perry
> 
> Perry Taylor
> Senior MV Architect
> ZirMed
> 888 West Market Street, Suite 400
> Louisville, KY 40202
> www.zirmed.com
> 
> 
> 
> CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is
> for the sole use of the intended recipient(s) and may contain confidential and
> privileged information.  Any unauthorized review, use, disclosure or 
> distribution
> is prohibited. ZirMed, Inc. has strict policies regarding the content of 
> e-mail
> communications, specifically Protected Health Information, any
> communications containing such material will be returned to the originating
> party with such advisement noted. If you are not the intended recipient, 
> please
> contact the sender by reply e-mail and destroy all copies of the original
> message.
> ___
> U2-Users mailing list
> U2-Users@listserver.u2ug.org
> http://listserver.u2ug.org/mailman/listinfo/u2-users

___
U2-Users mailing list
U2-Users@listserver.u2ug.org
http://listserver.u2ug.org/mailman/listinfo/u2-users