Re: [U2] What tools do you use for data warehouse...
Hi, We use a in-house ETL which is based on DICT independant table/column definition. The user interface to define table/column is a SB+ app ; easy to use. At first, you define you tables and columns to be created/loaded into your dw ; each table are linked to one datafile and in case of mv/sv'ed; linked to a controling field (mv/sv) Next, you define each column by setting their sql properties, the source of the value (attribute number or sb+.expression) ; the human label of the column ; with it you can create transformed data. (by default you can retrieve the dictionnaries) here a screen sample : http://wiki.infodata.lu/lib/exe/fetch.php?media=public/etl/etl_dw_defn1.png With these table/columns definition, the system build sql-stmt to create the table into the dw and load the data into the table via insert / loadinto ,... After what, the ETL send the sql-stmt to the dw. The sql-stmts are build from sql dialect-templates then , we can adress all SQL dbms After what, you can define datamarts ; as a set of tables, and request immediate or, via crontab/taskmanager, sheduled refreshing processus of one/* datamart For more details, send me a mail. manu -Message d'origine- De : u2-users-boun...@listserver.u2ug.org [mailto:u2-users- boun...@listserver.u2ug.org] De la part de Tom Whitmore Envoyé : vendredi 26 avril 2013 19:50 À : U2 Users List Objet : [U2] What tools do you use for data warehouse... Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
cool thanks - Original Message - From: Wols Lists antli...@youngman.org.uk To: u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 4:38 PM Subject: Re: [U2] What tools do you use for data warehouse... On 26/04/13 20:33, Kevin Le wrote: We have a few applications written in VB that use ODBC to access Unidata... but I find it to be a security risk since ODBC can be used in Access and allow the user to dump entire tables of data with no controls/auditing/logging. Are there any other ways of getting data from Unidata that could be more secure? Look on PickWiki for a bunch of data dump programs. I wrote some, I'm sure there are more. They'll dump stuff in a variety of flat-file formats for you to pick up from the CIFS (or NFS) share that other people have suggested. Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
[U2] What tools do you use for data warehouse...
Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
Tom, We use a tool called Kourier from Koretechologies that does a nice job. Very flexible and you can schedule the tasks to be done. -Dan Dan Goble | Senior Systems Engineer Interline Brands, Inc. 804 East Gate Drive Suite 100, Mount Laurel, NJ 08054 Office: 856.533.3110 | Mobile: 609.792.6855 E-mail: dan.go...@interlinebrands.com | Website: www.interlinebrands.com This e-mail and any files transmitted with it are confidential and intended solely for the individual or entity to whom they are addressed. Please notify the sender immediately by e-mail if you have received this e-mail in error and delete all copies of this message. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Tom Whitmore Sent: Friday, April 26, 2013 1:50 PM To: U2 Users List Subject: [U2] What tools do you use for data warehouse... Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
We use Kourier and Koretech for electronic forms i.e. custom Invoices, SalesOrders,Statements and P.O's to automatically fax and e-mail to customers and vendors. - Original Message - From: Dan Goble dan.go...@interlinebrands.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 1:02 PM Subject: Re: [U2] What tools do you use for data warehouse... Tom, We use a tool called Kourier from Koretechologies that does a nice job. Very flexible and you can schedule the tasks to be done. -Dan Dan Goble | Senior Systems Engineer Interline Brands, Inc. 804 East Gate Drive Suite 100, Mount Laurel, NJ 08054 Office: 856.533.3110 | Mobile: 609.792.6855 E-mail: dan.go...@interlinebrands.com | Website: www.interlinebrands.com This e-mail and any files transmitted with it are confidential and intended solely for the individual or entity to whom they are addressed. Please notify the sender immediately by e-mail if you have received this e-mail in error and delete all copies of this message. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Tom Whitmore Sent: Friday, April 26, 2013 1:50 PM To: U2 Users List Subject: [U2] What tools do you use for data warehouse... Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
Call Kore and talk with Paul. Their products are very reasonable. Paul Trebbien Kore Technologies, Senior Support Tech. Solutions that work. People who care. Direct 858.300.2618 Fax 858.300.2600 Main 858.678.0030 Web koretech.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Tom Whitmore tewhitm...@ratex.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 11:50 AM Subject: [U2] What tools do you use for data warehouse... Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
We have a few applications written in VB that use ODBC to access Unidata... but I find it to be a security risk since ODBC can be used in Access and allow the user to dump entire tables of data with no controls/auditing/logging. Are there any other ways of getting data from Unidata that could be more secure? Kevin On Friday, April 26, 2013, Robert Frailey wrote: Call Kore and talk with Paul. Their products are very reasonable. Paul Trebbien Kore Technologies, Senior Support Tech. Solutions that work. People who care. Direct 858.300.2618 Fax 858.300.2600 Main 858.678.0030 Web koretech.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Tom Whitmore tewhitm...@ratex.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 11:50 AM Subject: [U2] What tools do you use for data warehouse... Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
For constant repeating queries, dump the data *from* Unidata instead of doing *on the fly* requests. So if you *always* need the list of invoices, products, amounts, just dump it to a tab-file from inside Unidata every night in a batch. -Original Message- From: Kevin Le veg...@gmail.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Fri, Apr 26, 2013 12:33 pm Subject: Re: [U2] What tools do you use for data warehouse... We have a few applications written in VB that use ODBC to access Unidata... but I find it to be a security risk since ODBC can be used in Access and allow the user to dump entire tables of data with no controls/auditing/logging. Are there any other ways of getting data from Unidata that could be more secure? Kevin On Friday, April 26, 2013, Robert Frailey wrote: Call Kore and talk with Paul. Their products are very reasonable. Paul Trebbien Kore Technologies, Senior Support Tech. Solutions that work. People who care. Direct 858.300.2618 Fax 858.300.2600 Main 858.678.0030 Web koretech.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Tom Whitmore tewhitm...@ratex.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 11:50 AM Subject: [U2] What tools do you use for data warehouse... Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
Dump it to a pointer on a CIFS volume on the server, all they or anyone will see is the file from a mapped windows workstation drive. I think our Programmer, Brooke has incorporated an export function in our Salesorders to automatically dump shipping data from every Salesorder and append it to a file in a CIFS directory. Our FedEx/UPS Computers in the US, Ireland and England automatically pull that data file real-time, or sort of real-time to create the shipments. We do lots of data exports for excell and access. E-mail Brook and ask him about it. bkend...@utahmed.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Wjhonson wjhon...@aol.com To: u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 1:37 PM Subject: Re: [U2] What tools do you use for data warehouse... For constant repeating queries, dump the data *from* Unidata instead of doing *on the fly* requests. So if you *always* need the list of invoices, products, amounts, just dump it to a tab-file from inside Unidata every night in a batch. -Original Message- From: Kevin Le veg...@gmail.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Fri, Apr 26, 2013 12:33 pm Subject: Re: [U2] What tools do you use for data warehouse... We have a few applications written in VB that use ODBC to access Unidata... but I find it to be a security risk since ODBC can be used in Access and allow the user to dump entire tables of data with no controls/auditing/logging. Are there any other ways of getting data from Unidata that could be more secure? Kevin On Friday, April 26, 2013, Robert Frailey wrote: Call Kore and talk with Paul. Their products are very reasonable. Paul Trebbien Kore Technologies, Senior Support Tech. Solutions that work. People who care. Direct 858.300.2618 Fax 858.300.2600 Main 858.678.0030 Web koretech.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Tom Whitmore tewhitm...@ratex.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 11:50 AM Subject: [U2] What tools do you use for data warehouse... Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
There is really no reason to export the data from Universe. When I created the data warehouse product for Eclipse we simply collected all the data from the various transaction files associated with a specific reporting function and wrote them out on demand for a given query to a flattened out Universe file specifically designed to accommodate reporting/SQL. For example all of the data pertaining to sales for a particular time period on a sales order line item by line item basis as records. One the data is in an SQL friendly normalized format (and perhaps even moved to a non-production server) all of the popular data warehouse reporting tools (Cognos, Pentaho, MS Business Intelligence, SAP Crystal Solutions, etc) can be used via ODBC to create your slice and dice graphical reporting. If you absolutely HAVE to export the data I would recommend the simplest possible solution, tab delimited flat files since pretty much any SQL database can import that. Tom Whitmore wrote: Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users -- Jeff Schasny - Denver, Co, USA jschasny at gmail dot com ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
How about limiting access and audits? I see you are form a medical company. How are you protecting your data and applying hippa? On Friday, April 26, 2013, Robert Frailey wrote: Dump it to a pointer on a CIFS volume on the server, all they or anyone will see is the file from a mapped windows workstation drive. I think our Programmer, Brooke has incorporated an export function in our Salesorders to automatically dump shipping data from every Salesorder and append it to a file in a CIFS directory. Our FedEx/UPS Computers in the US, Ireland and England automatically pull that data file real-time, or sort of real-time to create the shipments. We do lots of data exports for excell and access. E-mail Brook and ask him about it. bkend...@utahmed.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Wjhonson wjhon...@aol.com To: u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 1:37 PM Subject: Re: [U2] What tools do you use for data warehouse... For constant repeating queries, dump the data *from* Unidata instead of doing *on the fly* requests. So if you *always* need the list of invoices, products, amounts, just dump it to a tab-file from inside Unidata every night in a batch. -Original Message- From: Kevin Le veg...@gmail.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Fri, Apr 26, 2013 12:33 pm Subject: Re: [U2] What tools do you use for data warehouse... We have a few applications written in VB that use ODBC to access Unidata... but I find it to be a security risk since ODBC can be used in Access and allow the user to dump entire tables of data with no controls/auditing/logging. Are there any other ways of getting data from Unidata that could be more secure? Kevin On Friday, April 26, 2013, Robert Frailey wrote: Call Kore and talk with Paul. Their products are very reasonable. Paul Trebbien Kore Technologies, Senior Support Tech. Solutions that work. People who care. Direct 858.300.2618 Fax 858.300.2600 Main 858.678.0030 Web koretech.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Tom Whitmore tewhitm...@ratex.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 11:50 AM Subject: [U2] What tools do you use for data warehouse... Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-usershttp://listserver.u2ug.org/**mailman/listinfo/u2-users http**://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-usershttp://listserver.u2ug.org/**mailman/listinfo/u2-users http**://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
Ditto. We have used Kourier for over eight years; it has been definitely an IT 'best buy' for us. We support a data warehouse and numerous edi/system integrations. Marc Rutherford Principal Programmer Analyst Advanced Bionics LLC 661) 362 1754 -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Dan Goble Sent: Friday, April 26, 2013 12:02 PM To: U2 Users List Subject: Re: [U2] What tools do you use for data warehouse... Tom, We use a tool called Kourier from Koretechologies that does a nice job. Very flexible and you can schedule the tasks to be done. -Dan Dan Goble | Senior Systems Engineer Interline Brands, Inc. 804 East Gate Drive Suite 100, Mount Laurel, NJ 08054 Office: 856.533.3110 | Mobile: 609.792.6855 E-mail: dan.go...@interlinebrands.com | Website: www.interlinebrands.com This e-mail and any files transmitted with it are confidential and intended solely for the individual or entity to whom they are addressed. Please notify the sender immediately by e-mail if you have received this e-mail in error and delete all copies of this message. -Original Message- From: u2-users-boun...@listserver.u2ug.org [mailto:u2-users-boun...@listserver.u2ug.org] On Behalf Of Tom Whitmore Sent: Friday, April 26, 2013 1:50 PM To: U2 Users List Subject: [U2] What tools do you use for data warehouse... Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
Why can you not dump it to a protected directory? -Original Message- From: Kevin Le veg...@gmail.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Fri, Apr 26, 2013 1:30 pm Subject: Re: [U2] What tools do you use for data warehouse... How about limiting access and audits? I see you are form a medical company. How are you protecting your data and applying hippa? On Friday, April 26, 2013, Robert Frailey wrote: Dump it to a pointer on a CIFS volume on the server, all they or anyone will see is the file from a mapped windows workstation drive. I think our Programmer, Brooke has incorporated an export function in our Salesorders to automatically dump shipping data from every Salesorder and append it to a file in a CIFS directory. Our FedEx/UPS Computers in the US, Ireland and England automatically pull that data file real-time, or sort of real-time to create the shipments. We do lots of data exports for excell and access. E-mail Brook and ask him about it. bkend...@utahmed.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Wjhonson wjhon...@aol.com To: u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 1:37 PM Subject: Re: [U2] What tools do you use for data warehouse... For constant repeating queries, dump the data *from* Unidata instead of doing *on the fly* requests. So if you *always* need the list of invoices, products, amounts, just dump it to a tab-file from inside Unidata every night in a batch. -Original Message- From: Kevin Le veg...@gmail.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Fri, Apr 26, 2013 12:33 pm Subject: Re: [U2] What tools do you use for data warehouse... We have a few applications written in VB that use ODBC to access Unidata... but I find it to be a security risk since ODBC can be used in Access and allow the user to dump entire tables of data with no controls/auditing/logging. Are there any other ways of getting data from Unidata that could be more secure? Kevin On Friday, April 26, 2013, Robert Frailey wrote: Call Kore and talk with Paul. Their products are very reasonable. Paul Trebbien Kore Technologies, Senior Support Tech. Solutions that work. People who care. Direct 858.300.2618 Fax 858.300.2600 Main 858.678.0030 Web koretech.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Tom Whitmore tewhitm...@ratex.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 11:50 AM Subject: [U2] What tools do you use for data warehouse... Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-usershttp://listserver.u2ug.org/**mailman/listinfo/u2-users http**://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-usershttp://listserver.u2ug.org/**mailman/listinfo/u2-users http**://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
In samba you can setup authorized access to the CIFS volumes Its easy to make a directory in temp or some odd obsure place and do a logical link. the only thing they see is what you want them to see. If you dont have rights to the account, you don't login We have access control on all processes in Dataflo and unidata, only myself and brooke have all the keys to the castle. All processes have a tracking file with user date and time stamp. Robert - Original Message - From: Kevin Le veg...@gmail.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 2:29 PM Subject: Re: [U2] What tools do you use for data warehouse... How about limiting access and audits? I see you are form a medical company. How are you protecting your data and applying hippa? On Friday, April 26, 2013, Robert Frailey wrote: Dump it to a pointer on a CIFS volume on the server, all they or anyone will see is the file from a mapped windows workstation drive. I think our Programmer, Brooke has incorporated an export function in our Salesorders to automatically dump shipping data from every Salesorder and append it to a file in a CIFS directory. Our FedEx/UPS Computers in the US, Ireland and England automatically pull that data file real-time, or sort of real-time to create the shipments. We do lots of data exports for excell and access. E-mail Brook and ask him about it. bkend...@utahmed.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Wjhonson wjhon...@aol.com To: u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 1:37 PM Subject: Re: [U2] What tools do you use for data warehouse... For constant repeating queries, dump the data *from* Unidata instead of doing *on the fly* requests. So if you *always* need the list of invoices, products, amounts, just dump it to a tab-file from inside Unidata every night in a batch. -Original Message- From: Kevin Le veg...@gmail.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Fri, Apr 26, 2013 12:33 pm Subject: Re: [U2] What tools do you use for data warehouse... We have a few applications written in VB that use ODBC to access Unidata... but I find it to be a security risk since ODBC can be used in Access and allow the user to dump entire tables of data with no controls/auditing/logging. Are there any other ways of getting data from Unidata that could be more secure? Kevin On Friday, April 26, 2013, Robert Frailey wrote: Call Kore and talk with Paul. Their products are very reasonable. Paul Trebbien Kore Technologies, Senior Support Tech. Solutions that work. People who care. Direct 858.300.2618 Fax 858.300.2600 Main 858.678.0030 Web koretech.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Tom Whitmore tewhitm...@ratex.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 11:50 AM Subject: [U2] What tools do you use for data warehouse... Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-usershttp://listserver.u2ug.org/**mailman/listinfo/u2-users http**://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-usershttp://listserver.u2ug.org/**mailman/listinfo/u2-users http**://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users
Re: [U2] What tools do you use for data warehouse...
you can and I do this a lot to keep different plants from seeing other plant reports and data. - Original Message - From: Wjhonson wjhon...@aol.com To: u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 2:50 PM Subject: Re: [U2] What tools do you use for data warehouse... Why can you not dump it to a protected directory? -Original Message- From: Kevin Le veg...@gmail.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Fri, Apr 26, 2013 1:30 pm Subject: Re: [U2] What tools do you use for data warehouse... How about limiting access and audits? I see you are form a medical company. How are you protecting your data and applying hippa? On Friday, April 26, 2013, Robert Frailey wrote: Dump it to a pointer on a CIFS volume on the server, all they or anyone will see is the file from a mapped windows workstation drive. I think our Programmer, Brooke has incorporated an export function in our Salesorders to automatically dump shipping data from every Salesorder and append it to a file in a CIFS directory. Our FedEx/UPS Computers in the US, Ireland and England automatically pull that data file real-time, or sort of real-time to create the shipments. We do lots of data exports for excell and access. E-mail Brook and ask him about it. bkend...@utahmed.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Wjhonson wjhon...@aol.com To: u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 1:37 PM Subject: Re: [U2] What tools do you use for data warehouse... For constant repeating queries, dump the data *from* Unidata instead of doing *on the fly* requests. So if you *always* need the list of invoices, products, amounts, just dump it to a tab-file from inside Unidata every night in a batch. -Original Message- From: Kevin Le veg...@gmail.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Fri, Apr 26, 2013 12:33 pm Subject: Re: [U2] What tools do you use for data warehouse... We have a few applications written in VB that use ODBC to access Unidata... but I find it to be a security risk since ODBC can be used in Access and allow the user to dump entire tables of data with no controls/auditing/logging. Are there any other ways of getting data from Unidata that could be more secure? Kevin On Friday, April 26, 2013, Robert Frailey wrote: Call Kore and talk with Paul. Their products are very reasonable. Paul Trebbien Kore Technologies, Senior Support Tech. Solutions that work. People who care. Direct 858.300.2618 Fax 858.300.2600 Main 858.678.0030 Web koretech.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Tom Whitmore tewhitm...@ratex.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 11:50 AM Subject: [U2] What tools do you use for data warehouse... Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-usershttp://listserver.u2ug.org/**mailman/listinfo/u2-users http**://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-usershttp://listserver.u2ug.org/**mailman/listinfo/u2-users http**://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users __**_ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/**mailman/listinfo/u2-usershttp://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
Samba running on the server is nice because the user only needs to map a windows drive to it, the UNIX server doesn't have to replicate that directory out to a windows client. All the work load is on the client. Windows apps like excel and access will allow you to imbed the network path i.e. \\150.0.0.105\tmp\file.name and as long as you authenticated to the network and have rights to the file, you get it. in UNIX ln-s /dbms/live/MIDVALE/CUSTOMER/CUSTOMER/CUSTLIST CUSTLIST puts access only to the directory CUSTLIST and nothing else. if the logical link is created in the samba directory, the unidata owner owns it, samba owner can access it but not delete it or change it, just copy it. you can chgown it, chgrp it or chgmod it depending on your needed rights. I use logical links all over the place to manage temp files, protect the file system from overloads, secure directories and efficiently manage disk space. For our international plants who use databases on the same box residing in the USA, it's easier to make a temp CIFS directory to exchange large files unrelated to the UNIX system but too large to just e-mail. Those plants already have a mapped directory to the box on each workstation so dropping image files and the like into a custom folder and allowing them the rights to remove and insert those files with minimal impact on the UNIX box and the network secure tunnels between the plants make sense without overloading the internet mail systems. If I ever get time to play with Java programming some more, I would like to write some custom windows apps to pull data from the plants and insert them into access automatically, no time for the wicked. Rob - Original Message - From: Robert Frailey rfrai...@utahmed.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 3:03 PM Subject: Re: [U2] What tools do you use for data warehouse... In samba you can setup authorized access to the CIFS volumes Its easy to make a directory in temp or some odd obsure place and do a logical link. the only thing they see is what you want them to see. If you dont have rights to the account, you don't login We have access control on all processes in Dataflo and unidata, only myself and brooke have all the keys to the castle. All processes have a tracking file with user date and time stamp. Robert - Original Message - From: Kevin Le veg...@gmail.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 2:29 PM Subject: Re: [U2] What tools do you use for data warehouse... How about limiting access and audits? I see you are form a medical company. How are you protecting your data and applying hippa? On Friday, April 26, 2013, Robert Frailey wrote: Dump it to a pointer on a CIFS volume on the server, all they or anyone will see is the file from a mapped windows workstation drive. I think our Programmer, Brooke has incorporated an export function in our Salesorders to automatically dump shipping data from every Salesorder and append it to a file in a CIFS directory. Our FedEx/UPS Computers in the US, Ireland and England automatically pull that data file real-time, or sort of real-time to create the shipments. We do lots of data exports for excell and access. E-mail Brook and ask him about it. bkend...@utahmed.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Wjhonson wjhon...@aol.com To: u2-users@listserver.u2ug.org Sent: Friday, April 26, 2013 1:37 PM Subject: Re: [U2] What tools do you use for data warehouse... For constant repeating queries, dump the data *from* Unidata instead of doing *on the fly* requests. So if you *always* need the list of invoices, products, amounts, just dump it to a tab-file from inside Unidata every night in a batch. -Original Message- From: Kevin Le veg...@gmail.com To: U2 Users List u2-users@listserver.u2ug.org Sent: Fri, Apr 26, 2013 12:33 pm Subject: Re: [U2] What tools do you use for data warehouse... We have a few applications written in VB that use ODBC to access Unidata... but I find it to be a security risk since ODBC can be used in Access and allow the user to dump entire tables of data with no controls/auditing/logging. Are there any other ways of getting data from Unidata that could be more secure? Kevin On Friday, April 26, 2013, Robert Frailey wrote: Call Kore and talk with Paul. Their products are very reasonable. Paul Trebbien Kore Technologies, Senior Support Tech. Solutions that work. People who care. Direct 858.300.2618 Fax 858.300.2600 Main 858.678.0030 Web koretech.com Thank You Robert Frailey Manager Information Systems Utah Medical Products Inc. Femcare-Nikomed Ltd. rfrai...@utahmed.com 801-569-4016 - Original Message - From: Tom Whitmore tewhitm...@ratex.com To: U2 Users List u2-users
Re: [U2] What tools do you use for data warehouse...
On 26/04/13 20:33, Kevin Le wrote: We have a few applications written in VB that use ODBC to access Unidata... but I find it to be a security risk since ODBC can be used in Access and allow the user to dump entire tables of data with no controls/auditing/logging. Are there any other ways of getting data from Unidata that could be more secure? Look on PickWiki for a bunch of data dump programs. I wrote some, I'm sure there are more. They'll dump stuff in a variety of flat-file formats for you to pick up from the CIFS (or NFS) share that other people have suggested. Cheers, Wol ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
Re: [U2] What tools do you use for data warehouse...
SSIS of course. Why would anybody want to use anything else? On 26/04/2013 18:50, Tom Whitmore wrote: Hi, I was wondering what tools you use to export data to an SQL data warehouse from UniVerse. This export could occur on multiple flavors of Unix. What we would need to do is extract the UV data and perform some data translations before importing the data into the SQL table. I know at one point DataStage was a powerful but expensive tool that would accomplish this task. All suggestions are greatly appreciated! Tom Whitmore RATEX Business Solutions ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users ___ U2-Users mailing list U2-Users@listserver.u2ug.org http://listserver.u2ug.org/mailman/listinfo/u2-users
