Re: Authentication with Active Directory
I think that Dave has basically answered your question but I'll toss out the notion that if it was acceptable in your environment you could do the same sort of permissions but at the application level instead of the db. CF can do authentication with Active Directory via the CFLDAP tag. You could fetch a list of permissions and then proxy the calls to the db and only allow certain queries involving your sprocs and views to people with sufficient privileges. Though it is functionally equivalent to what you are talking about, it may be that they want the roles and permissions enforced down at the SQL Server level. There are some good reasons to do so and then there are some reasons that, well, that's just how an organization has always done it and isn't changing now. Anyway, if you are investigating CF talking to Active Directory, start with the CFLDAP tag. Take care, Judah On Tue, May 26, 2009 at 3:35 PM, wrote: > > Hi, > > Does anyone know how to setup a datasource to authenticate with Active > Directory. We are moving away from service accounts on SQL Server and I > need to pass the Windows login credentials through my CF apps to SQL Server > so the user is allowed access to certain views and sprocs. For example > in .net you add "IntegratedSecurity=SSPI" to the connection script and your > done. > > > Thanks for any advice. I have only been using CF for about 6 months now > after our main developer left. This is my first programming job so bear > with me please. > > > thanks, > Mike > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322816 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: PayPal Custom Tag
Yes please send or post. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322815 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: PayPal Custom Tag
Yes I do. >@torrent girlDo you still need it? >-- >Ryan > > > > > >>> ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322814 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Image Manipulation Problems with CF8/Win7
cool, i also have a win 2003 vps but cf7 & also a centos railo setup. -- Ryan On Tue, May 26, 2009 at 8:45 PM, Rick Faircloth wrote: > > Hi, Ryan... > > No my production server is a VPS with Win 2003 Server and CF 8. > > In my previous post, I'm referring to my dev setup. > > > On Tue, May 26, 2009 at 7:41 PM, Ryan Letulle wrote: > > > > > Rick, > > Out of curiosity: you were running production cf on xp and now you are > > trying to do the same on win 7? > > > > -- > > Ryan > > > > > > > > On Tue, May 26, 2009 at 6:37 PM, Rick Faircloth < > r...@whitestonemedia.com > > >wrote: > > > > > > > > Just let me start with saying that I'm loving using Windows 7...stable, > > > slick, *all* my software runs > > > so much better than in XP (never did used Vista...skipped that > > > party)...however... > > > > > > One issue is really getting on my nerds...whenever I try to run the > same > > > code that I've used for > > > years and just recently before switching over to Windows 7 for > uploading > > a > > > new image, creating > > > the various version I need, then deleting the original image, I get > > errors > > > that CF can't delete > > > the image for some "unknown reason." Someone using Win 7 came up with > a > > > workaround...putting > > > the image name in a database then running a scheduled task to delete > > later. > > > It works, but that is > > > a lot of extra coding, processing, etc. I was willing to go that > route, > > if > > > necessary, but... > > > > > > Now, I run into the fact that I can't immediately rename a file I just > > > uploaded. I'm thinking this is the same > > > basic issue as with deleting...Windows 7, perhaps with CF 8, is somehow > > > locking down the file for > > > a period of time (it usually with release control after a little time > > > passes...seconds to minutes) > > > until it allows the file to be deleted or changed. > > > > > > Saving an original, *unused* file's name to a db for scheduled deletion > > > would work...a lot of trouble, but it would work. > > > Preventing me from renaming a file immediately is a no-go. (Perhaps I > > can > > > copy the file and then rename the > > > copy) > > > > > > Is there anyone testing or working on Windows 7 that has run into these > > > issues (basically one issue) and > > > figured out what's going on and if there is a solution? It's not a > > problem > > > with the code code...it's the same exact code > > > I was previously running on XP and CF 8...only the OS has changed. > > > > > > I couldn't find anything on Google or other search engines, etc., that > > > addresses this. > > > > > > Anyone have any ideas? > > > > > > Thanks, > > > > > > Rick > > > > > > -- > > > > > > > > > -- > > > "Ninety percent of the politicians give the other ten percent a bad > > > reputation." Henry Kissinger > > > > > > > > > > > > > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322813 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Image Manipulation Problems with CF8/Win7
Hi, Ryan... No my production server is a VPS with Win 2003 Server and CF 8. In my previous post, I'm referring to my dev setup. On Tue, May 26, 2009 at 7:41 PM, Ryan Letulle wrote: > > Rick, > Out of curiosity: you were running production cf on xp and now you are > trying to do the same on win 7? > > -- > Ryan > > > > On Tue, May 26, 2009 at 6:37 PM, Rick Faircloth >wrote: > > > > > Just let me start with saying that I'm loving using Windows 7...stable, > > slick, *all* my software runs > > so much better than in XP (never did used Vista...skipped that > > party)...however... > > > > One issue is really getting on my nerds...whenever I try to run the same > > code that I've used for > > years and just recently before switching over to Windows 7 for uploading > a > > new image, creating > > the various version I need, then deleting the original image, I get > errors > > that CF can't delete > > the image for some "unknown reason." Someone using Win 7 came up with a > > workaround...putting > > the image name in a database then running a scheduled task to delete > later. > > It works, but that is > > a lot of extra coding, processing, etc. I was willing to go that route, > if > > necessary, but... > > > > Now, I run into the fact that I can't immediately rename a file I just > > uploaded. I'm thinking this is the same > > basic issue as with deleting...Windows 7, perhaps with CF 8, is somehow > > locking down the file for > > a period of time (it usually with release control after a little time > > passes...seconds to minutes) > > until it allows the file to be deleted or changed. > > > > Saving an original, *unused* file's name to a db for scheduled deletion > > would work...a lot of trouble, but it would work. > > Preventing me from renaming a file immediately is a no-go. (Perhaps I > can > > copy the file and then rename the > > copy) > > > > Is there anyone testing or working on Windows 7 that has run into these > > issues (basically one issue) and > > figured out what's going on and if there is a solution? It's not a > problem > > with the code code...it's the same exact code > > I was previously running on XP and CF 8...only the OS has changed. > > > > I couldn't find anything on Google or other search engines, etc., that > > addresses this. > > > > Anyone have any ideas? > > > > Thanks, > > > > Rick > > > > -- > > > > > -- > > "Ninety percent of the politicians give the other ten percent a bad > > reputation." Henry Kissinger > > > > > > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322812 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: MySQL IDE on OS X
I use Sequelpro aswell its really good. Paul On 26/05/2009, at 4:46 PM, Charlie Griefer wrote: > > On Tue, May 26, 2009 at 12:54 PM, David McGuigan > wrote: > >> >> Can anyone recommend a good MySQL IDE on OS X? So far I've been using >> Navicat but it's kind of a joke. >> >> Anyone have one they actually like? >> > > I'm a relatively recent MBP user, so haven't really delved too > deeply into > it yet, but have heard good things about Sequel Pro ( > http://www.sequelpro.com/). Used to be CocoaSQL. > > -- > I have failed as much as I have succeeded. But I love my life. I > love my > wife. And I wish you my kind of success. > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322811 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Image Manipulation Problems with CF8/Win7
Rick, Out of curiosity: you were running production cf on xp and now you are trying to do the same on win 7? -- Ryan On Tue, May 26, 2009 at 6:37 PM, Rick Faircloth wrote: > > Just let me start with saying that I'm loving using Windows 7...stable, > slick, *all* my software runs > so much better than in XP (never did used Vista...skipped that > party)...however... > > One issue is really getting on my nerds...whenever I try to run the same > code that I've used for > years and just recently before switching over to Windows 7 for uploading a > new image, creating > the various version I need, then deleting the original image, I get errors > that CF can't delete > the image for some "unknown reason." Someone using Win 7 came up with a > workaround...putting > the image name in a database then running a scheduled task to delete later. > It works, but that is > a lot of extra coding, processing, etc. I was willing to go that route, if > necessary, but... > > Now, I run into the fact that I can't immediately rename a file I just > uploaded. I'm thinking this is the same > basic issue as with deleting...Windows 7, perhaps with CF 8, is somehow > locking down the file for > a period of time (it usually with release control after a little time > passes...seconds to minutes) > until it allows the file to be deleted or changed. > > Saving an original, *unused* file's name to a db for scheduled deletion > would work...a lot of trouble, but it would work. > Preventing me from renaming a file immediately is a no-go. (Perhaps I can > copy the file and then rename the > copy) > > Is there anyone testing or working on Windows 7 that has run into these > issues (basically one issue) and > figured out what's going on and if there is a solution? It's not a problem > with the code code...it's the same exact code > I was previously running on XP and CF 8...only the OS has changed. > > I couldn't find anything on Google or other search engines, etc., that > addresses this. > > Anyone have any ideas? > > Thanks, > > Rick > > -- > > -- > "Ninety percent of the politicians give the other ten percent a bad > reputation." Henry Kissinger > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322810 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Image Manipulation Problems with CF8/Win7
Just let me start with saying that I'm loving using Windows 7...stable, slick, *all* my software runs so much better than in XP (never did used Vista...skipped that party)...however... One issue is really getting on my nerds...whenever I try to run the same code that I've used for years and just recently before switching over to Windows 7 for uploading a new image, creating the various version I need, then deleting the original image, I get errors that CF can't delete the image for some "unknown reason." Someone using Win 7 came up with a workaround...putting the image name in a database then running a scheduled task to delete later. It works, but that is a lot of extra coding, processing, etc. I was willing to go that route, if necessary, but... Now, I run into the fact that I can't immediately rename a file I just uploaded. I'm thinking this is the same basic issue as with deleting...Windows 7, perhaps with CF 8, is somehow locking down the file for a period of time (it usually with release control after a little time passes...seconds to minutes) until it allows the file to be deleted or changed. Saving an original, *unused* file's name to a db for scheduled deletion would work...a lot of trouble, but it would work. Preventing me from renaming a file immediately is a no-go. (Perhaps I can copy the file and then rename the copy) Is there anyone testing or working on Windows 7 that has run into these issues (basically one issue) and figured out what's going on and if there is a solution? It's not a problem with the code code...it's the same exact code I was previously running on XP and CF 8...only the OS has changed. I couldn't find anything on Google or other search engines, etc., that addresses this. Anyone have any ideas? Thanks, Rick -- -- "Ninety percent of the politicians give the other ten percent a bad reputation." Henry Kissinger ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322809 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Authentication with Active Directory
Thanks Dave, that's what I was afraid of. >> Does anyone know how to setup a datasource to authenticate with Active >> Directory. We are moving away from service accounts on SQL Server and I >> need to pass the Windows login credentials through my CF apps to SQL Server >> so the user is allowed access to certain views and sprocs. For example >> in .net you add "IntegratedSecurity=SSPI" to the connection script and your >> done. > >Are you talking about passing the end-user's credentials to the >database? If so, I'm pretty sure that CF simply doesn't support this, >as it doesn't have the ability to impersonate users. .NET applications >can do this sort of thing because they're tightly tied to Windows, run >in-process with IIS, etc. However, you can use Windows Authentication >to pass the service account's credentials to CF, which is not the >default behavior. > >In any case, even if you could do this, it would generally be a bad >idea for performance reasons. Each user would have their own >connection pool, and you wouldn't be able to reuse connections across >users. > >Dave Watts, CTO, Fig Leaf Software >http://www.figleaf.com/ > >Fig Leaf Software provides the highest caliber vendor-authorized >instruction at our training centers in Washington DC, Atlanta, >Chicago, Baltimore, Northern Virginia, or on-site at your location. >Visit http://training.figleaf.com/ for more information! ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322808 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Authentication with Active Directory
> Does anyone know how to setup a datasource to authenticate with Active > Directory. We are moving away from service accounts on SQL Server and I > need to pass the Windows login credentials through my CF apps to SQL Server > so the user is allowed access to certain views and sprocs. For example > in .net you add "IntegratedSecurity=SSPI" to the connection script and your > done. Are you talking about passing the end-user's credentials to the database? If so, I'm pretty sure that CF simply doesn't support this, as it doesn't have the ability to impersonate users. .NET applications can do this sort of thing because they're tightly tied to Windows, run in-process with IIS, etc. However, you can use Windows Authentication to pass the service account's credentials to CF, which is not the default behavior. In any case, even if you could do this, it would generally be a bad idea for performance reasons. Each user would have their own connection pool, and you wouldn't be able to reuse connections across users. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ Fig Leaf Software provides the highest caliber vendor-authorized instruction at our training centers in Washington DC, Atlanta, Chicago, Baltimore, Northern Virginia, or on-site at your location. Visit http://training.figleaf.com/ for more information! ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322807 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: (ot) Apply my own CSS in Firefox on a particular web site?
Jim McAtee wrote: > I frequent one particular web site (a forum) that I find difficult to read > due to the choice of skin colors, font face, sizing and line spacing. Is > there any way in Firefox that I can apply a style sheet to _only_ this > particular web site? As a *blind* man, I can relate. I recommend 'Stylish' from http://userstyles.org/. That will give you total control over the styles applied and the sites to which they are applied. HTH Mark ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322806 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Authentication with Active Directory
Hi, Does anyone know how to setup a datasource to authenticate with Active Directory. We are moving away from service accounts on SQL Server and I need to pass the Windows login credentials through my CF apps to SQL Server so the user is allowed access to certain views and sprocs. For example in .net you add "IntegratedSecurity=SSPI" to the connection script and your done. Thanks for any advice. I have only been using CF for about 6 months now after our main developer left. This is my first programming job so bear with me please. thanks, Mike ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322805 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: MySQL IDE on OS X
DBVisualizer! it rocks for multiple database server types like MSSQL and MySQL and many more... as long as you have the JDBC drivers for it! (it's paid though, but fairly priced!) http://www.dbvis.com/products/dbvis/ 2009/5/26 Wil Genovese > > From MySQL's web site > > http://dev.mysql.com/downloads/gui-tools/5.0.html > > Wil Genovese > > > On Tue, May 26, 2009 at 2:54 PM, David McGuigan >wrote: > > > > > Can anyone recommend a good MySQL IDE on OS X? So far I've been using > > Navicat but it's kind of a joke. > > > > Anyone have one they actually like? > > > > > > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322804 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Checking for Existence of RSS.CHANNEL.ITEM
Sorry I missed the earlier thread - but looks like Dominic helped you out. On Tue, May 26, 2009 at 1:57 PM, Steve LaBadie wrote: > > Perfect Dominic, Thanks for your assistance. > > Steve LaBadie, Web Manager > East Stroudsburg University > 200 Prospect St. > East Stroudsburg, Pa 18301 > 570-422-3999 > http://www.esu.edu > slaba...@po-box.esu.edu > > -Original Message- > From: Dominic Watson [mailto:watson.domi...@googlemail.com] > Sent: Tuesday, May 26, 2009 2:47 PM > To: cf-talk > Subject: Re: Checking for Existence of RSS.CHANNEL.ITEM > > >> > > With this line, you guarantee that variable.items is an array. It may > be empty, but it will always be an array and so you avoid the kind of > validation code that can get messy with CF and XML. > > A more poignant example might be if you only wanted to show items with > a given category. Using XPath: > > variables.items = XmlSearch(objRss, '//item[category="somecategory"]'); > // then just loop items ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322803 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
(ot) Apply my own CSS in Firefox on a particular web site?
In CSS design articles, it seems to me that I've read of users being able to apply their own CSS to web pages, often in the context of the visually impaired modifying things like font size and color. The discussion usually centers around how to avoid keeping those custom style sheets from working when someone visits your site. I frequent one particular web site (a forum) that I find difficult to read due to the choice of skin colors, font face, sizing and line spacing. Is there any way in Firefox that I can apply a style sheet to _only_ this particular web site? ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322802 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: MySQL IDE on OS X
Charlie! That app is AWESOME. EXACTLY what I was looking for. Better windowing, much more attractive, smart shortcuts, inline quick querier. So slick. Command 1 2 3. So simple and clever. There's even a keyboard shortcut to execute your inline query ( though it's a weird one: Fn + Enter ). Seriously thanks a million. On Tue, May 26, 2009 at 2:46 PM, Charlie Griefer wrote: > > On Tue, May 26, 2009 at 12:54 PM, David McGuigan >wrote: > > > > > Can anyone recommend a good MySQL IDE on OS X? So far I've been using > > Navicat but it's kind of a joke. > > > > Anyone have one they actually like? > > > > I'm a relatively recent MBP user, so haven't really delved too deeply into > it yet, but have heard good things about Sequel Pro ( > http://www.sequelpro.com/). Used to be CocoaSQL. > > -- > I have failed as much as I have succeeded. But I love my life. I love my > wife. And I wish you my kind of success. > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322801 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: MySQL IDE on OS X
On Tue, May 26, 2009 at 12:54 PM, David McGuigan wrote: > > Can anyone recommend a good MySQL IDE on OS X? So far I've been using > Navicat but it's kind of a joke. > > Anyone have one they actually like? > I'm a relatively recent MBP user, so haven't really delved too deeply into it yet, but have heard good things about Sequel Pro ( http://www.sequelpro.com/). Used to be CocoaSQL. -- I have failed as much as I have succeeded. But I love my life. I love my wife. And I wish you my kind of success. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322800 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: MySQL IDE on OS X
You know, I use the MySQL Query Browser on Vista a lot and actually love it. On OS X however, that app literally crashes on me within 30 seconds of launching it each and every time, and I've got a completely fresh install of OS X as of Saturday night with just CS4, Adium, some browsers, ColdFusion and MySQL installed. Is it stable for you? Thanks. On Tue, May 26, 2009 at 2:32 PM, Wil Genovese wrote: > > From MySQL's web site > > http://dev.mysql.com/downloads/gui-tools/5.0.html > > Wil Genovese > > > On Tue, May 26, 2009 at 2:54 PM, David McGuigan >wrote: > > > > > Can anyone recommend a good MySQL IDE on OS X? So far I've been using > > Navicat but it's kind of a joke. > > > > Anyone have one they actually like? > > > > > > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322799 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: MySQL IDE on OS X
>From MySQL's web site http://dev.mysql.com/downloads/gui-tools/5.0.html Wil Genovese On Tue, May 26, 2009 at 2:54 PM, David McGuigan wrote: > > Can anyone recommend a good MySQL IDE on OS X? So far I've been using > Navicat but it's kind of a joke. > > Anyone have one they actually like? > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322798 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
MySQL IDE on OS X
Can anyone recommend a good MySQL IDE on OS X? So far I've been using Navicat but it's kind of a joke. Anyone have one they actually like? ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322797 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
RE: Checking for Existence of RSS.CHANNEL.ITEM
Perfect Dominic, Thanks for your assistance.
Steve LaBadie, Web Manager
East Stroudsburg University
200 Prospect St.
East Stroudsburg, Pa 18301
570-422-3999
http://www.esu.edu
slaba...@po-box.esu.edu
-Original Message-
From: Dominic Watson [mailto:watson.domi...@googlemail.com]
Sent: Tuesday, May 26, 2009 2:47 PM
To: cf-talk
Subject: Re: Checking for Existence of RSS.CHANNEL.ITEM
>
With this line, you guarantee that variable.items is an array. It may
be empty, but it will always be an array and so you avoid the kind of
validation code that can get messy with CF and XML.
A more poignant example might be if you only wanted to show items with
a given category. Using XPath:
variables.items = XmlSearch(objRss, '//item[category="somecategory"]');
// then just loop items
Without XPath:
if( StructKeyExists(xmlobj.rss.channel, 'items') ){
for(i=1; i LTE ArrayLen(xmlobj.rss.channel.items); i=i+1){
if(StructKeyExists(xmlobj.rss.channel.items[i], 'category')){
for(n=1; n LTE ArrayLen(xmlobj.rss.channel.items[i].category;
n=n+1){
if(xmlobj.rss.channel.items[i].category[n].xmlText =
'somecateogry'){
// finally do something with the item!
}
}
}
}
}
(nightmare).
Anyways, to do what you want:
There are no events for today
This may be of help too:
http://cfrss.riaforge.org/
Dominic
~|
Want to reach the ColdFusion community with something they want? Let them know
on the House of Fusion mailing lists
Archive:
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322796
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe:
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Checking for Existence of RSS.CHANNEL.ITEM
>
With this line, you guarantee that variable.items is an array. It may
be empty, but it will always be an array and so you avoid the kind of
validation code that can get messy with CF and XML.
A more poignant example might be if you only wanted to show items with
a given category. Using XPath:
variables.items = XmlSearch(objRss, '//item[category="somecategory"]');
// then just loop items
Without XPath:
if( StructKeyExists(xmlobj.rss.channel, 'items') ){
for(i=1; i LTE ArrayLen(xmlobj.rss.channel.items); i=i+1){
if(StructKeyExists(xmlobj.rss.channel.items[i], 'category')){
for(n=1; n LTE ArrayLen(xmlobj.rss.channel.items[i].category; n=n+1){
if(xmlobj.rss.channel.items[i].category[n].xmlText = 'somecateogry'){
// finally do something with the item!
}
}
}
}
}
(nightmare).
Anyways, to do what you want:
There are no events for today
This may be of help too:
http://cfrss.riaforge.org/
Dominic
~|
Want to reach the ColdFusion community with something they want? Let them know
on the House of Fusion mailing lists
Archive:
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322795
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe:
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Parsing large CSVs and inserting in MSSQL
I have a dormant 'roided out MS SQL 2008 Standard box I can use in lieu. In fact, the plan was to migrate to that after I've built this module. :) Thanks for catching that (and for your help). Jason -Original Message- From: Mark Kruger [mailto:mkru...@cfwebtools.com] Sent: Tuesday, May 26, 2009 1:37 PM To: cf-talk Subject: RE: Parsing large CSVs and inserting in MSSQL Jason, Here's a big "uh oh" for you If you are using MSSQL express you don't have the SSIS services that come with it. DTS may be possible through installing the active X controls on the same server - but you may be out of luck if you want to do SSIS. -Mark Mark A. Kruger, CFG, MCSE (402) 408-3733 ext 105 www.cfwebtools.com www.coldfusionmuse.com www.necfug.com -Original Message- From: Jason Durham [mailto:jdur...@cti-stl.com] Sent: Tuesday, May 26, 2009 1:27 PM To: cf-talk Subject: RE: Parsing large CSVs and inserting in MSSQL Thanks to everybody who has replied. It appears I need to do some homework on MS SQL. :) -Original Message- From: Mark Kruger [mailto:mkru...@cfwebtools.com] Sent: Tuesday, May 26, 2009 11:03 AM To: cf-talk Subject: RE: Parsing large CSVs and inserting in MSSQL Jason, This is not what you want to hear but My advice would be don't use CF to do this. DTS (or SSIS) is quite capable of doing this in about 1/30 the time that CF is able to do this. One of our DTS packages consumes a file of over 300k rows in less than 15 seconds every few minutes. You can't get that with CF no matter how hard you try :) But if you insist on doing it with CF, don't use CFFILE. Instead read the lines in one at a time using a line reader technique - that will allow you to handle one line at a time instead of reding the entire file into memory. -Mark Mark A. Kruger, CFG, MCSE (402) 408-3733 ext 105 www.cfwebtools.com www.coldfusionmuse.com www.necfug.com -Original Message- From: Jason Durham [mailto:jdur...@cti-stl.com] Sent: Tuesday, May 26, 2009 10:53 AM To: cf-talk Subject: Parsing large CSVs and inserting in MSSQL I have been tasked with providing a mechanism to upload/parse/perform a couple of checks/save CSV data. The current test file is 28,000 records (~16 columns). I expect this file to grow in size each month, to an indeterminate number (hundreds of thousands). It seems that I'll need to set a limit on the number of rows being processed at each time. The two obvious options (in my eyes)... #1 break the CSV up into several smaller CSV files and write them back to the file system before processing each individually (all checks performed in memory) #2 set a large timeout value and attempt to load all of the records from the CSV into a temp table, retrieving back smaller, more manageable record sets Currently, I'm doing #2 but not limiting the number of records (28,000). The data is getting into the temp table, being retrieved, but the final insert is causing ColdFusion to hang. The final insert consists of one cfquery with an internal loop over the "temp table" query object. The final insert is within a single transaction so I can rollback if it fails. This process will only take place on my development machine, connecting to the live database. 2.6 Core 2 Duo, 4GB, Vista 32 with a 100MB connection to production server running MS SQL 2005 Express. Perhaps I need to take a step back and consider alternatives. Btw, the "checks" I'm performing are simply that 2 of the columns do not contain a unique value (FKs). I'm currently doing this with QoQs but I could probably push this off with a fairly complicated query to MS SQL. What do the CF wizards suggest? TIA ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322794 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Parsing large CSVs and inserting in MSSQL
Jason, Here's a big "uh oh" for you If you are using MSSQL express you don't have the SSIS services that come with it. DTS may be possible through installing the active X controls on the same server - but you may be out of luck if you want to do SSIS. -Mark Mark A. Kruger, CFG, MCSE (402) 408-3733 ext 105 www.cfwebtools.com www.coldfusionmuse.com www.necfug.com -Original Message- From: Jason Durham [mailto:jdur...@cti-stl.com] Sent: Tuesday, May 26, 2009 1:27 PM To: cf-talk Subject: RE: Parsing large CSVs and inserting in MSSQL Thanks to everybody who has replied. It appears I need to do some homework on MS SQL. :) -Original Message- From: Mark Kruger [mailto:mkru...@cfwebtools.com] Sent: Tuesday, May 26, 2009 11:03 AM To: cf-talk Subject: RE: Parsing large CSVs and inserting in MSSQL Jason, This is not what you want to hear but My advice would be don't use CF to do this. DTS (or SSIS) is quite capable of doing this in about 1/30 the time that CF is able to do this. One of our DTS packages consumes a file of over 300k rows in less than 15 seconds every few minutes. You can't get that with CF no matter how hard you try :) But if you insist on doing it with CF, don't use CFFILE. Instead read the lines in one at a time using a line reader technique - that will allow you to handle one line at a time instead of reding the entire file into memory. -Mark Mark A. Kruger, CFG, MCSE (402) 408-3733 ext 105 www.cfwebtools.com www.coldfusionmuse.com www.necfug.com -Original Message- From: Jason Durham [mailto:jdur...@cti-stl.com] Sent: Tuesday, May 26, 2009 10:53 AM To: cf-talk Subject: Parsing large CSVs and inserting in MSSQL I have been tasked with providing a mechanism to upload/parse/perform a couple of checks/save CSV data. The current test file is 28,000 records (~16 columns). I expect this file to grow in size each month, to an indeterminate number (hundreds of thousands). It seems that I'll need to set a limit on the number of rows being processed at each time. The two obvious options (in my eyes)... #1 break the CSV up into several smaller CSV files and write them back to the file system before processing each individually (all checks performed in memory) #2 set a large timeout value and attempt to load all of the records from the CSV into a temp table, retrieving back smaller, more manageable record sets Currently, I'm doing #2 but not limiting the number of records (28,000). The data is getting into the temp table, being retrieved, but the final insert is causing ColdFusion to hang. The final insert consists of one cfquery with an internal loop over the "temp table" query object. The final insert is within a single transaction so I can rollback if it fails. This process will only take place on my development machine, connecting to the live database. 2.6 Core 2 Duo, 4GB, Vista 32 with a 100MB connection to production server running MS SQL 2005 Express. Perhaps I need to take a step back and consider alternatives. Btw, the "checks" I'm performing are simply that 2 of the columns do not contain a unique value (FKs). I'm currently doing this with QoQs but I could probably push this off with a fairly complicated query to MS SQL. What do the CF wizards suggest? TIA ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322793 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Parsing large CSVs and inserting in MSSQL
Thanks to everybody who has replied. It appears I need to do some homework on MS SQL. :) -Original Message- From: Mark Kruger [mailto:mkru...@cfwebtools.com] Sent: Tuesday, May 26, 2009 11:03 AM To: cf-talk Subject: RE: Parsing large CSVs and inserting in MSSQL Jason, This is not what you want to hear but My advice would be don't use CF to do this. DTS (or SSIS) is quite capable of doing this in about 1/30 the time that CF is able to do this. One of our DTS packages consumes a file of over 300k rows in less than 15 seconds every few minutes. You can't get that with CF no matter how hard you try :) But if you insist on doing it with CF, don't use CFFILE. Instead read the lines in one at a time using a line reader technique - that will allow you to handle one line at a time instead of reding the entire file into memory. -Mark Mark A. Kruger, CFG, MCSE (402) 408-3733 ext 105 www.cfwebtools.com www.coldfusionmuse.com www.necfug.com -Original Message- From: Jason Durham [mailto:jdur...@cti-stl.com] Sent: Tuesday, May 26, 2009 10:53 AM To: cf-talk Subject: Parsing large CSVs and inserting in MSSQL I have been tasked with providing a mechanism to upload/parse/perform a couple of checks/save CSV data. The current test file is 28,000 records (~16 columns). I expect this file to grow in size each month, to an indeterminate number (hundreds of thousands). It seems that I'll need to set a limit on the number of rows being processed at each time. The two obvious options (in my eyes)... #1 break the CSV up into several smaller CSV files and write them back to the file system before processing each individually (all checks performed in memory) #2 set a large timeout value and attempt to load all of the records from the CSV into a temp table, retrieving back smaller, more manageable record sets Currently, I'm doing #2 but not limiting the number of records (28,000). The data is getting into the temp table, being retrieved, but the final insert is causing ColdFusion to hang. The final insert consists of one cfquery with an internal loop over the "temp table" query object. The final insert is within a single transaction so I can rollback if it fails. This process will only take place on my development machine, connecting to the live database. 2.6 Core 2 Duo, 4GB, Vista 32 with a 100MB connection to production server running MS SQL 2005 Express. Perhaps I need to take a step back and consider alternatives. Btw, the "checks" I'm performing are simply that 2 of the columns do not contain a unique value (FKs). I'm currently doing this with QoQs but I could probably push this off with a fairly complicated query to MS SQL. What do the CF wizards suggest? TIA ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322792 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Parsing large CSVs and inserting in MSSQL
+2 for DTS/SSIS Case in point. Back in the CF 5 (or 6) days I tried to import a 20+ meg MLS xml file into SQL server using CF (Yeah I know... I had no idea at the time). The first run just about killed my dev server. After 30-60 seconds the task manager showed that the machine was using 750 megs ram (It had 512 installed). After several tries with PHP and (I think) VB script I ended up writing a little DTS using ActiveX and it went from 10 min to a "blip" on the task manager. It took like 5 seconds. That left a very lasting impression on me. G! On Tue, May 26, 2009 at 12:17 PM, C S wrote: > > >My advice would be don't use CF to do this. DTS (or SSIS) is quite capable > >of doing this in about 1/30 the time that CF is able to do this. One of > our > >DTS packages consumes a file of over 300k rows in less than 15 seconds > every > >few minutes. You can't get that with CF no matter how hard you try :) > > +1 > > Using dts/ssis, or even your basic bulk insert query, would certainly be > faster than looping via cf. > > > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322791 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Checking for Existence of RSS.CHANNEL.ITEM
Dominic, Is this what you are suggesting I do? I don't receive any errors, but would like to output a statement (There are no events for today) Why are you suggesting this over the structKeyExists #items[i].title.xmltext# Steve LaBadie, Web Manager East Stroudsburg University 200 Prospect St. East Stroudsburg, Pa 18301 570-422-3999 http://www.esu.edu slaba...@po-box.esu.edu -Original Message- From: Dominic Watson [mailto:watson.domi...@googlemail.com] Sent: Tuesday, May 26, 2009 1:13 PM To: cf-talk Subject: Re: Checking for Existence of RSS.CHANNEL.ITEM ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322790 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Secure CFIDE Virtual Directory
> Looking for your advice on the best way to create a secure IIS virtual > directory to /CFIDE. > My understanding is that certain folders within that need to web accessible > for cfchart,cfform, > cfdocument to work, is that correct? However I don't want to expose my > /cfide/administrator > and /cfide/adminapi to the wide world :-) or anything else which might post a > security risk for > that matter. > > What is the best way of doing this? I'm thinking about creating a copy of the > CFIDE folder and > calling it SecureCFIDE (or something to that effect), it contains only the > required elements and > not the admin panel etc, then creating a Virtual Directory link to that in > the IIS sites that require > it, does that sound like a fair idea? Which files are required? Actually, you'll typically have to do a bit more than that. Here's a rough guide to what I usually do. First, when I install CF, I tend to use the built-in JRun web server. After the install, I use the web server configuration utility to connect CF to the public web server, but leave the JRun web server running solely for administration. I also configure the server to only allow access to the JRun web server from localhost or from specific trusted IP addresses. Second, I do create a separate copy of CFIDE for public use. It includes everything except Administrator and adminapi, and the loose files in the root of the CFIDE directory itself. I actually keep the Administrator and adminapi directories, and just set very restrictive permissions on those two directories, to prevent any user from accessing them. The reason I do this is that the web server can be configured to check the validity of requests before forwarding them to CF, but by default doesn't do this if there's no matching file corresponding to the requested URL pattern. Third, I map the "public" CFIDE directory as a virtual directory within each public virtual web server. Dave Watts, CTO, Fig Leaf Software http://www.figleaf.com/ Fig Leaf Software provides the highest caliber vendor-authorized instruction at our training centers in Washington DC, Atlanta, Chicago, Baltimore, Northern Virginia, or on-site at your location. Visit http://training.figleaf.com/ for more information! ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322789 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Secure CFIDE Virtual Directory
FYI, you can move/copy the js files out of cfide and configure CF to reference them from the new location. See http://kb2.adobe.com/cps/000/3e56e2e5.html, and probably other docs too. To answer your original question, I lock down the IP addresses that can access /cfide to prevent anyone from outside of the company from hitting any of those pages. Thanks Mark -Original Message- From: Robert Rawlins [mailto:robert.rawl...@thinkbluemedia.co.uk] Sent: Tuesday, May 26, 2009 12:18 PM To: cf-talk Subject: Secure CFIDE Virtual Directory Hello Guys, Looking for your advice on the best way to create a secure IIS virtual directory to /CFIDE. My understanding is that certain folders within that need to web accessible for cfchart,cfform,cfdocument to work, is that correct? However I don't want to expose my /cfide/administrator and /cfide/adminapi to the wide world :-) or anything else which might post a security risk for that matter. What is the best way of doing this? I'm thinking about creating a copy of the CFIDE folder and calling it SecureCFIDE (or something to that effect), it contains only the required elements and not the admin panel etc, then creating a Virtual Directory link to that in the IIS sites that require it, does that sound like a fair idea? Which files are required? Cheers all, Rob ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322788 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Checking for Existence of RSS.CHANNEL.ITEM
Try something like: #items[i].title.xmltext# HTH Dominic 2009/5/19 Steve LaBadie : > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322787 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Parsing large CSVs and inserting in MSSQL
Yes... I was going to mention that but I didn't want to muddy the waters :) Mark A. Kruger, CFG, MCSE (402) 408-3733 ext 105 www.cfwebtools.com www.coldfusionmuse.com www.necfug.com -Original Message- From: Ian Skinner [mailto:h...@ilsweb.com] Sent: Tuesday, May 26, 2009 11:10 AM To: cf-talk Subject: Re: Parsing large CSVs and inserting in MSSQL Mark Kruger wrote: > Jason, > > But if you insist on doing it with CF, don't use CFFILE. Instead read > the lines in one at a time using a line reader technique - that will > allow you to handle one line at a time instead of reding the entire file into memory. I also recommended pushing the heavy lifting into the database. But I did want to point out that in ColdFusion 8, you can now use the tag to get a CFML line reader, so one does not need to go to the Java for this anymore. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322786 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Parsing large CSVs and inserting in MSSQL
>My advice would be don't use CF to do this. DTS (or SSIS) is quite capable >of doing this in about 1/30 the time that CF is able to do this. One of our >DTS packages consumes a file of over 300k rows in less than 15 seconds every >few minutes. You can't get that with CF no matter how hard you try :) +1 Using dts/ssis, or even your basic bulk insert query, would certainly be faster than looping via cf. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322785 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Secure CFIDE Virtual Directory
Hello Guys, Looking for your advice on the best way to create a secure IIS virtual directory to /CFIDE. My understanding is that certain folders within that need to web accessible for cfchart,cfform,cfdocument to work, is that correct? However I don't want to expose my /cfide/administrator and /cfide/adminapi to the wide world :-) or anything else which might post a security risk for that matter. What is the best way of doing this? I'm thinking about creating a copy of the CFIDE folder and calling it SecureCFIDE (or something to that effect), it contains only the required elements and not the admin panel etc, then creating a Virtual Directory link to that in the IIS sites that require it, does that sound like a fair idea? Which files are required? Cheers all, Rob ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322784 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Checking for Existence of RSS.CHANNEL.ITEM
Raymond, Is this correct? http://192.147.113.183/scripts/admin/r25_xml/RSSHotEvents.xml"; method="get"> #objRSS.rss.channel.item[i].title.xmltext# There are no events! -- #date# #objRSS.rss.channel.item[i].space.xmltext##time# http://esuevents.admin.esu.edu/wv3/wv3_servlet/urd/run/wv_event.We ekList?evdt class="morelink">more Steve LaBadie, Web Manager East Stroudsburg University 200 Prospect St. East Stroudsburg, Pa 18301 570-422-3999 http://www.esu.edu slaba...@po-box.esu.edu -Original Message- From: Raymond Camden [mailto:rcam...@gmail.com] Sent: Friday, May 22, 2009 11:53 AM To: cf-talk Subject: Re: Checking for Existence of RSS.CHANNEL.ITEM ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322783 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Parsing large CSVs and inserting in MSSQL
Mark Kruger wrote: > Jason, > > But if you insist on doing it with CF, don't use CFFILE. Instead read the > lines in one at a time using a line reader technique - that will allow you > to handle one line at a time instead of reding the entire file into memory. I also recommended pushing the heavy lifting into the database. But I did want to point out that in ColdFusion 8, you can now use the tag to get a CFML line reader, so one does not need to go to the Java for this anymore. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322782 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Re: Parsing large CSVs and inserting in MSSQL
Jason Durham wrote: > What do the CF wizards suggest? > Push this work into the database using stored procedures and bulk loaders. Use ColdFusion to get the file, move it somewhere the database bulk loader can get to it, fire off the stored procedure, and notify the user of any results or problems. Databases are optimized for handling large sets of data. ColdFusion is optimized to present that data over the intranet to clients. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322781 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
RE: Parsing large CSVs and inserting in MSSQL
Jason, This is not what you want to hear but My advice would be don't use CF to do this. DTS (or SSIS) is quite capable of doing this in about 1/30 the time that CF is able to do this. One of our DTS packages consumes a file of over 300k rows in less than 15 seconds every few minutes. You can't get that with CF no matter how hard you try :) But if you insist on doing it with CF, don't use CFFILE. Instead read the lines in one at a time using a line reader technique - that will allow you to handle one line at a time instead of reding the entire file into memory. -Mark Mark A. Kruger, CFG, MCSE (402) 408-3733 ext 105 www.cfwebtools.com www.coldfusionmuse.com www.necfug.com -Original Message- From: Jason Durham [mailto:jdur...@cti-stl.com] Sent: Tuesday, May 26, 2009 10:53 AM To: cf-talk Subject: Parsing large CSVs and inserting in MSSQL I have been tasked with providing a mechanism to upload/parse/perform a couple of checks/save CSV data. The current test file is 28,000 records (~16 columns). I expect this file to grow in size each month, to an indeterminate number (hundreds of thousands). It seems that I'll need to set a limit on the number of rows being processed at each time. The two obvious options (in my eyes)... #1 break the CSV up into several smaller CSV files and write them back to the file system before processing each individually (all checks performed in memory) #2 set a large timeout value and attempt to load all of the records from the CSV into a temp table, retrieving back smaller, more manageable record sets Currently, I'm doing #2 but not limiting the number of records (28,000). The data is getting into the temp table, being retrieved, but the final insert is causing ColdFusion to hang. The final insert consists of one cfquery with an internal loop over the "temp table" query object. The final insert is within a single transaction so I can rollback if it fails. This process will only take place on my development machine, connecting to the live database. 2.6 Core 2 Duo, 4GB, Vista 32 with a 100MB connection to production server running MS SQL 2005 Express. Perhaps I need to take a step back and consider alternatives. Btw, the "checks" I'm performing are simply that 2 of the columns do not contain a unique value (FKs). I'm currently doing this with QoQs but I could probably push this off with a fairly complicated query to MS SQL. What do the CF wizards suggest? TIA ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322780 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Parsing large CSVs and inserting in MSSQL
Check out: http://msdn.microsoft.com/en-us/library/ms188365.aspx "For information about preparing data for bulk import, such as the requirements for importing data from a CSV data file, see..." On Tue, May 26, 2009 at 11:52 AM, Jason Durham wrote: > > I have been tasked with providing a mechanism to upload/parse/perform a > couple of checks/save CSV data. The current test file is 28,000 records > (~16 columns). I expect this file to grow in size each month, to an > indeterminate number (hundreds of thousands). > > > > It seems that I'll need to set a limit on the number of rows being > processed at each time. The two obvious options (in my eyes)... > > > > #1 break the CSV up into several smaller CSV files and write them back > to the file system before processing each individually (all checks > performed in memory) > > #2 set a large timeout value and attempt to load all of the records from > the CSV into a temp table, retrieving back smaller, more manageable > record sets > > > > Currently, I'm doing #2 but not limiting the number of records (28,000). > The data is getting into the temp table, being retrieved, but the final > insert is causing ColdFusion to hang. The final insert consists of one > cfquery with an internal loop over the "temp table" query object. The > final insert is within a single transaction so I can rollback if it > fails. > > > > This process will only take place on my development machine, connecting > to the live database. 2.6 Core 2 Duo, 4GB, Vista 32 with a 100MB > connection to production server running MS SQL 2005 Express. > > > > Perhaps I need to take a step back and consider alternatives. Btw, the > "checks" I'm performing are simply that 2 of the columns do not contain > a unique value (FKs). I'm currently doing this with QoQs but I could > probably push this off with a fairly complicated query to MS SQL. What > do the CF wizards suggest? > > > > TIA > > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322779 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Parsing large CSVs and inserting in MSSQL
I have found that using the Java "Line Reader" works great. It doesn't load a text file into memory but will read it line by line which is perfect for a CSV. There is a CFC out there called filereader.cfc that should get you started. J.J. On Tue, May 26, 2009 at 10:52 AM, Jason Durham wrote: > > I have been tasked with providing a mechanism to upload/parse/perform a > couple of checks/save CSV data. The current test file is 28,000 records > (~16 columns). I expect this file to grow in size each month, to an > indeterminate number (hundreds of thousands). > > > > It seems that I'll need to set a limit on the number of rows being > processed at each time. The two obvious options (in my eyes)... > > > > #1 break the CSV up into several smaller CSV files and write them back > to the file system before processing each individually (all checks > performed in memory) > > #2 set a large timeout value and attempt to load all of the records from > the CSV into a temp table, retrieving back smaller, more manageable > record sets > > > > Currently, I'm doing #2 but not limiting the number of records (28,000). > The data is getting into the temp table, being retrieved, but the final > insert is causing ColdFusion to hang. The final insert consists of one > cfquery with an internal loop over the "temp table" query object. The > final insert is within a single transaction so I can rollback if it > fails. > > > > This process will only take place on my development machine, connecting > to the live database. 2.6 Core 2 Duo, 4GB, Vista 32 with a 100MB > connection to production server running MS SQL 2005 Express. > > > > Perhaps I need to take a step back and consider alternatives. Btw, the > "checks" I'm performing are simply that 2 of the columns do not contain > a unique value (FKs). I'm currently doing this with QoQs but I could > probably push this off with a fairly complicated query to MS SQL. What > do the CF wizards suggest? > > > > TIA > > > > ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322778 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Parsing large CSVs and inserting in MSSQL
I have been tasked with providing a mechanism to upload/parse/perform a couple of checks/save CSV data. The current test file is 28,000 records (~16 columns). I expect this file to grow in size each month, to an indeterminate number (hundreds of thousands). It seems that I'll need to set a limit on the number of rows being processed at each time. The two obvious options (in my eyes)... #1 break the CSV up into several smaller CSV files and write them back to the file system before processing each individually (all checks performed in memory) #2 set a large timeout value and attempt to load all of the records from the CSV into a temp table, retrieving back smaller, more manageable record sets Currently, I'm doing #2 but not limiting the number of records (28,000). The data is getting into the temp table, being retrieved, but the final insert is causing ColdFusion to hang. The final insert consists of one cfquery with an internal loop over the "temp table" query object. The final insert is within a single transaction so I can rollback if it fails. This process will only take place on my development machine, connecting to the live database. 2.6 Core 2 Duo, 4GB, Vista 32 with a 100MB connection to production server running MS SQL 2005 Express. Perhaps I need to take a step back and consider alternatives. Btw, the "checks" I'm performing are simply that 2 of the columns do not contain a unique value (FKs). I'm currently doing this with QoQs but I could probably push this off with a fairly complicated query to MS SQL. What do the CF wizards suggest? TIA ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322777 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
Windows 2003 vs 2008
Hi, I'm considering moving my application to a dedicated server. The package includes Windows 2003 or 2008 at the same price. Is there a major difference, as far as CF is concerned. Memory requirements? Performance? ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322776 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
Re: Perhaps I shouldn't have done this???
On Saturday 23 May 2009, Rick Faircloth wrote: > I've used cfftp in the past and never used sandboxing...and I've disabled > it now and the cfftp is working perfectly. Perhaps that's just a > precaution for someone hosting sites using CF and allows users to use > functionality that uses cfftp? More likely a doc. oversight - please put a comment on that page for future reference :-) -- Helping to authoritatively harvest cross-platform sticky e-services as part of the IT team of the year, '09 and '08 Tom Chiverton Developer Tel: +44 0161 618 5032 Fax: +44 0161 618 5099 tom.chiver...@halliwells.com 3 Hardman Square, Manchester, M3 3EB www.Halliwells.com This email is sent for and on behalf of Halliwells LLP. Halliwells LLP is a limited liability partnership registered in England and Wales under registered number OC307980 whose registered office address is at Halliwells LLP, 3 Hardman Square, Spinningfields, Manchester, M3 3EB. A list of members is available for inspection at the registered office together with a list of those non members who are referred to as partners. We use the word partner to refer to a member of the LLP, or an employee or consultant with equivalent standing and qualifications. Regulated by the Solicitors Regulation Authority. CONFIDENTIALITY This email is intended only for the use of the addressee named above and may be confidential or legally privileged. If you are not the addressee you must not read it and must not use any information contained in nor copy it nor inform any person other than Halliwells LLP or the addressee of its existence or contents. If you have received this email in error please delete it and notify Halliwells LLP IT Department on 0870 365 2500. For more information about Halliwells LLP visit www.Halliwells.com. ~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322775 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=89.70.4
