[R] aucRoc in caret package [SEC=UNCLASSIFIED]

Hi all, I used the following code and data to get auc values for two sets of predictions: library(caret) table(predicted1, trainy) trainy hard soft 1 270 2 11 99 aucRoc(roc(predicted1, trainy)) [1] 0.5 table(predicted2, trainy) trainy hard soft 1

Re: [R] aucRoc in caret package [SEC=UNCLASSIFIED]

Using AUC for discrete predictor variables with inly two levels doesn't seem very sensible. What are you planning to to with this measure? -- David. On Jun 1, 2011, at 8:47 PM, jin...@ga.gov.au jin...@ga.gov.au wrote: Hi all, I used the following code and data to get auc values for two

Re: [R] aucRoc in caret package [SEC=UNCLASSIFIED]

: David Winsemius [mailto:dwinsem...@comcast.net] Sent: Thursday, 2 June 2011 10:55 AM To: Li Jin Cc: R-help@r-project.org Subject: Re: [R] aucRoc in caret package [SEC=UNCLASSIFIED] Using AUC for discrete predictor variables with inly two levels doesn't seem very sensible. What are you planning

Re: [R] aucRoc in caret package [SEC=UNCLASSIFIED]

-project.org Subject: Re: [R] aucRoc in caret package [SEC=UNCLASSIFIED] Using AUC for discrete predictor variables with inly two levels doesn't seem very sensible. What are you planning to to with this measure? -- David. On Jun 1, 2011, at 8:47 PM, jin...@ga.gov.au jin...@ga.gov.au wrote: Hi

Re: [R] aucRoc in caret package [SEC=UNCLASSIFIED]

. Thanks. Jin -Original Message- From: David Winsemius [mailto:dwinsem...@comcast.net] Sent: Thursday, 2 June 2011 10:55 AM To: Li Jin Cc: R-help@r-project.org Subject: Re: [R] aucRoc in caret package [SEC=UNCLASSIFIED] Using AUC for discrete predictor variables with inly two levels doesn't

Re: [R] aucRoc in caret package [SEC=UNCLASSIFIED]

@r-project.org Subject: Re: [R] aucRoc in caret package [SEC=UNCLASSIFIED] David, The ROC curve should really be computed with some sort of numeric data (as opposed to classes). It varies the cutoff to get a continuum of sensitivity and specificity values.  Using the classes as 1's and 2's implies