Re: [R] ROC within SEM

2018-06-07 Thread Eric Berger
Hi Ray, Have you done any search at all? I did a search on "R package ROC latent variable" and got several hits. In particular the package randomLCA seems relevant https://cran.r-project.org/web/packages/randomLCA/vignettes/randomLCA-package.pdf I glanced at the documentation which mentions 2

Re: [R] ROC within SEM

2018-06-06 Thread David Winsemius
> On Jun 6, 2018, at 10:37 AM, Palmer, Raymond F wrote: > > Dear R group. > Does anyone have an idea how to utilize a latent variable in an ROC (AUC) > analysis? I want to create a latent variable, then use that latent construct > as a continuous variable in an ROC. > I understand both SEM

[R] ROC within SEM

2018-06-06 Thread Palmer, Raymond F
Dear R group. Does anyone have an idea how to utilize a latent variable in an ROC (AUC) analysis? I want to create a latent variable, then use that latent construct as a continuous variable in an ROC. I understand both SEM and ROC analysis can be done in R, but how to use the latent variable in

Re: [R] ROC curve for each fold in one plot

2017-10-18 Thread PIKAL Petr
List <r-help@r-project.org> > Subject: [R] ROC curve for each fold in one plot > > Hi all, > > I have tried a 5 fold cross validation using caret package with random forest > method on iris dataset as example. Then I need ROC curve for each fold: > > > > set.see

[R] ROC curve for each fold in one plot

2017-10-16 Thread Elahe chalabi via R-help
Hi all, I have tried a 5 fold cross validation using caret package with random forest method on iris dataset as example. Then I need ROC curve for each fold: > set.seed(1) > train_control <- trainControl(method="cv", number=5,savePredictions = TRUE,classProbs = TRUE) > output <-

[R] ROC Curves for Neural Networks

2013-06-07 Thread Richard Beckett
Trying to plot an ROC curve to determine effectiveness of a neural network model in R.  using the neuralnet package I created nn1a:  nn1a-neuralnet(warstns ~ aigenlz+ p2l+anoclinv2+flinstab+mill+minconl+fllgdppclz+lpoplz+floil+flmtnestz+c_peaceyears, data=na.omit(dfram1), hidden=4)  then

Re: [R] ROC Curve: negative AUC

2012-11-23 Thread brunosm
Thanks, Do you know how to correct it? Cheers, Bruno -- View this message in context: http://r.789695.n4.nabble.com/ROC-Curve-negative-AUC-tp4650469p4650530.html Sent from the R help mailing list archive at Nabble.com. __ R-help@r-project.org

[R] ROC Curve: negative AUC

2012-11-22 Thread brunosm
Hi all, does anyone know why the area under the curve (AUC) is negative? I'm using ROC function with a logistic regression, package Epi. First time it happens... Thanks a lot! Bruno -- View this message in context: http://r.789695.n4.nabble.com/ROC-Curve-negative-AUC-tp4650469.html Sent

Re: [R] ROC Curve: negative AUC

2012-11-22 Thread Wensui Liu
wrong direction for ranking On Thu, Nov 22, 2012 at 1:58 PM, brunosm brunos...@gmail.com wrote: the area under the curve (AUC) is negative? I'm using ROC function with a logistic regression, package Epi. First time it happens... Thanks a lot! Bruno -- ==

Re: [R] ROC Curve: negative AUC

2012-11-22 Thread Thomas Lumley
On Fri, Nov 23, 2012 at 7:58 AM, brunosm brunos...@gmail.com wrote: Hi all, does anyone know why the area under the curve (AUC) is negative? I'm using ROC function with a logistic regression, package Epi. First time it happens... Have you looked at the ROC curve? That should tell you

Re: [R] ROC with more than one predictor

2012-10-24 Thread Suzen, Mehmet
On Tue, Oct 23, 2012 at 11:52 PM, Luigi marongiu.lu...@gmail.com wrote: Any tip on how to proceed? You may want to do check rocplus package. Its vignette is pretty good. http://cran.r-project.org/web/packages/rocplus/vignettes/rocplus.pdf In your case, I think pairwise comparison would be one

[R] ROC with more than one predictor

2012-10-23 Thread Luigi
Dear all, I would like to perform a receiver operating characteristics (ROC) curve analysis on data obtained using molecular assays. I have here an example: the first column is the sample number, the second is the response variable and the last three columns are the predictors. I wish to set the

Re: [R] ROC curves with ROCR

2012-07-16 Thread Jessica Streicher
Wild guess : You need to have some kind of score for ROC to work (so you can work with a threshold), so a predict() that only returns classlabels probably won't work. On 13.07.2012, at 15:25, blerta wrote: Hi, I don't really understand how ROCR works. Here's another example with a

[R] ROC curves with ROCR

2012-07-15 Thread blerta
Hi, I don't really understand how ROCR works. Here's another example with a randomforest model: I have the training dataset(bank_training) and testing dataset(bank_testing) and I ran a randomForest as below: bankrf-randomForest(y~., bank_training, mtry=4, ntree=2,

Re: [R] ROC Analysis

2012-03-25 Thread Camille Leclerc
Hi everybody, Pascal, your code works, but when I want to do the graph I have an error message. here is my code : x-rev(unlist(pred@cutoffs)) tpf-unlist(performance(pred, tpr)@y.values) fpf-unlist(performance(pred,fpr)@y.values) ll-length(x) p-(tpf[1:(ll-1)]-tpf[2:ll])/(fpf[1:(ll-1)]-fpf[2:ll])

Re: [R] ROC Analysis

2012-03-16 Thread Camille Leclerc
Hi everybody, Pascal, your script works again but I want to calculate the LR otherwise. I know the likelihood ratio is linked at the roc curve and so there are different ways to calculate the LR. The slope of an ROC curve can be defined in three ways: (1) as the tangent at a particular point on

Re: [R] ROC Analysis

2012-03-15 Thread Camille Leclerc
Hi, I made a mistake, effectively Pascal your method given to the first message is correct. I didn't use the good data, so it's sure that it could not work ! But, I have an another question : Can I obtain a same graph except that the y-axis represents the likelihood ratio ? All the best,

Re: [R] ROC Analysis

2012-03-14 Thread Camille Leclerc
Hi, Pascal, I tried to use your method which functions but the values of the abscissa are not good. When I talked about “value”, I wanted mean the values of my starting dataset that I have classified into two classes positive and negative classes, such as this : Value Status TPF

[R] ROC Analysis

2012-03-13 Thread Camille Leclerc
Hi everybody, I have a data set with a value and a status (positive or negative case) and I want make a ROC Analysis. So, with ROCR Package, I have got the ROC curve (True Positive Fraction [tpf] according 1-True Negative Fraction [1-tnf]). http://r.789695.n4.nabble.com/file/n4469203/01.png

Re: [R] ROC curve

2012-01-31 Thread Jim Lemon
On 01/30/2012 08:52 PM, Josiane NJIWA wrote: Hello all, I am very new to R and i am facing two problems. First i didn't succeed changing the konsole language in english even after trying the line command set language='en'. I would like to plot ROC curves. I have a serie of 10 threshold

[R] ROC curve

2012-01-30 Thread Josiane NJIWA
Hello all, I am very new to R and i am facing two problems. First i didn't succeed changing the konsole language in english even after trying the line command set language='en'. I would like to plot ROC curves. I have a serie of 10 threshold tests that i do for 10 patients. The prediction

Re: [R] ROC curve

2012-01-30 Thread Corey Dow-Hygelund
Hi Josiane, Concerning ROC curves, the package ROCR should do what you want to do. Use install.packages to add it to you library. Getting you data into a text file format, use read.delim to read into an data frame. Once you have a data frame, you can use the methods in ROCR to analyze the

Re: [R] ROC curve

2012-01-30 Thread David Winsemius
On Jan 30, 2012, at 4:52 AM, Josiane NJIWA wrote: Hello all, I am very new to R and i am facing two problems. First i didn't succeed changing the konsole language in english even after trying the line command set language='en'. R is a functional language, so it shouldn't surprise you

Re: [R] ROC plot for KNN

2011-10-03 Thread AHmed
Qian Liu littleduck24 at gmail.com writes: Hi I need some help with ploting the ROC for K-nearest neighbors. Since KNN is a non-parametric classification methods, the predicted value will be either 0 or 1. It will not be able to test for different cutoff to plot ROC. What is the package

[R] ROC plot for KNN

2011-08-30 Thread Qian Liu
Hi I need some help with ploting the ROC for K-nearest neighbors. Since KNN is a non-parametric classification methods, the predicted value will be either 0 or 1. It will not be able to test for different cutoff to plot ROC. What is the package or functions I should use to plot ROC for KNN?

[R] ROC plot with SEC and SPC as input

2011-07-07 Thread CZ
Hi, I am working on a ROC plot problem. Thanks in advance for any help. We run 20 cross validation (CV) on our data for each customized threshold, i.e. from 0.1 to 0.9. Then for these 9 threshold values, we get the overall performance, that is we are able to get overall sensitivity and

[R] ROC curves

2011-03-08 Thread Shun-Fu Chen
__ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.

Re: [R] ROC from R-SVM?

2011-02-22 Thread Max Kuhn
The objects functions for kernel methods are unrelated to the area under the ROC curve. However, you can try to choose the cost and kernel parameters to maximize the ROC AUC. See the caret package, specifically the train function. Max On Mon, Feb 21, 2011 at 5:34 PM, Angel Russo

Re: [R] ROC from R-SVM?

2011-02-22 Thread Angel Russo
To: r-help@r-project.org Subject: [R] ROC from R-SVM? *Hi, *Does anyone know how can I show an *ROC curve for R-SVM*? I understand in R-SVM we are not optimizing over SVM cost parameter. Any example ROC for R-SVM code or guidance can be really useful. Thanks, Angel. [[alternative

Re: [R] ROC from R-SVM?

2011-02-22 Thread Andrew Ziem
: r-help-boun...@r-project.org [mailto:r-help-boun...@r-project.org] On Behalf Of Angel Russo Sent: Monday, February 21, 2011 3:34 PM To: r-help@r-project.org Subject: [R] ROC from R-SVM? *Hi, *Does anyone know how can I show an *ROC curve for R-SVM*? I understand in R-SVM we are not optimizing

[R] ROC from R-SVM?

2011-02-21 Thread Angel Russo
*Hi, *Does anyone know how can I show an *ROC curve for R-SVM*? I understand in R-SVM we are not optimizing over SVM cost parameter. Any example ROC for R-SVM code or guidance can be really useful. Thanks, Angel. [[alternative HTML version deleted]]

[R] ROC curve in R

2010-07-01 Thread ashu6886
Hi, i have a fairly large amount of genomic data. I have created a dataframe which has Reference as one column and Variation as another. I want to plot a ROC curve based on these 2 columns. I have serached the R manual but I could not understand. Can anybody help me with the R code for plotting

Re: [R] ROC curve in R

2010-07-01 Thread David Winsemius
On Jul 1, 2010, at 12:50 PM, ashu6886 wrote: Hi, i have a fairly large amount of genomic data. I have created a dataframe which has Reference as one column and Variation as another. I want to plot a ROC curve based on these 2 columns. I have serached the R manual but I could not

Re: [R] ROC curve in R

2010-07-01 Thread Bert Gunter
Did you try googling on R ROC function (or something similar) or using the RSiteSearch() function? ?RSiteSearch RSiteSearch(ROC,restr=func) Learn to use R's various search capabilities before posting, please! Bert Gunter Genentech Nonclinical Biostatistics -Original Message- From

Re: [R] ROC curve in R

2010-07-01 Thread Saeed Abu Nimeh
Try the ROCR package. http://rocr.bioinf.mpi-sb.mpg.de/ROCR.pdf Saeed On Thu, Jul 1, 2010 at 9:50 AM, ashu6886 ashu.infy.m...@gmail.com wrote: Hi, i have a fairly large amount of genomic data. I have created a dataframe which has Reference as one column and Variation as another. I want to

Re: [R] ROC curve in R

2010-07-01 Thread Tal Galili
gunter.ber...@gene.com wrote: Did you try googling on R ROC function (or something similar) or using the RSiteSearch() function? ?RSiteSearch RSiteSearch(ROC,restr=func) Learn to use R's various search capabilities before posting, please! Bert Gunter Genentech Nonclinical Biostatistics

Re: [R] ROC curve in R

2010-07-01 Thread Changbin Du
Read the ROCR package, it is very good. On Thu, Jul 1, 2010 at 9:50 AM, ashu6886 ashu.infy.m...@gmail.com wrote: Hi, i have a fairly large amount of genomic data. I have created a dataframe which has Reference as one column and Variation as another. I want to plot a ROC curve based on

Re: [R] ROC curve in R

2010-07-01 Thread Frank E Harrell Jr
On 07/01/2010 01:33 PM, Changbin Du wrote: Read the ROCR package, it is very good. Just be sure you really need an ROC curve. More often than not it gets in the way of understanding. Frank On Thu, Jul 1, 2010 at 9:50 AM, ashu6886ashu.infy.m...@gmail.com wrote: Hi, i have a

Re: [R] ROC curve

2010-05-24 Thread Claudia Beleites
Dear Changbin, I want to know how to select the optimal decision threshold from the ROC curve? Depends on what optimal means. I think there are a bunch of different criteria used: - point closest to the ideal model - point furthest from the guessing model - these criteria may include costs,

Re: [R] ROC curve

2010-05-24 Thread Frank E Harrell Jr
On 05/24/2010 02:14 AM, Claudia Beleites wrote: Dear Changbin, I want to know how to select the optimal decision threshold from the ROC curve? Depends on what optimal means. I think there are a bunch of different criteria used: - point closest to the ideal model - point furthest from the

[R] ROC curve

2010-05-23 Thread Changbin Du
HI, Dear R community, I want to know how to select the optimal decision threshold from the ROC curve? At what threshold will give the highest accuracy? Thanks! -- Sincerely, Changbin -- [[alternative HTML version deleted]] __

[R] ROC curve in randomForest

2010-04-30 Thread Changbin Du
require(randomForest) rf.pred-predict(fit, valid, type=prob) rf.pred[1:20, ] 0 1 16 0. 1. 23 0.3158 0.6842 43 0.3030 0.6970 52 0.0886 0.9114 55 0.1216 0.8784 75 0.0920 0.9080 82 0.4332 0.5668 120 0.2302 0.7698 128 0.1336 0.8664 147 0.4272 0.5728 148 0.0490 0.9510 153

[R] ROC curve in randomSurvivalForest

2010-04-22 Thread Nick Fankhauser
I'm using randomSurvivalForest to predict survival from a rather small sample. As it's not enough data to have training and validation set, I rely on the Estimate of error rate computed by the randomForest. If I understand the method correctly, it repeatedly partitions the data into varying

Re: [R] roc plot with zero length labels error

2009-11-13 Thread Uwe Ligges
[Going through some old and from what I see unanswered messages Hard to tell what is going on without telling us the data. Works with the examples, so may be related to one of the objects scicomp5.model1, pred, T, or auc. PLEASE do read the posting guide

[R] ROC

2009-11-03 Thread carol white
My question would be related more to time-dependent ROC (survivalROC package): I would like to know how true positives (TP) and false positives (FP) are related to the order of survival times and diagnostic markers. That is, having the a set of TP and FP, each of them is calculated from which

[R] roc plot with zero length labels error

2009-10-29 Thread Chris Anderson
I am trying to create the roc plot bootstrap method from library(verification), and when I set the plot =both or emp then I get the following error. The roc.plot works fine when the plot is set to binorm. This is my first time using this function in R and am not sure what this error means or

[R] ROC curve and gains/lift chart

2009-08-21 Thread clue_less
What is the difference between ROC curve and gains/lift chart? how to do them in R? Thanks. -- View this message in context: http://www.nabble.com/ROC-curve-and-gains-lift-chart-tp25083979p25083979.html Sent from the R help mailing list archive at Nabble.com.

Re: [R] ROC curve and gains/lift chart

2009-08-21 Thread Christian Schulz
Have look in the ROCR package and Example's. HTH Christian What is the difference between ROC curve and gains/lift chart? how to do them in R? Thanks. __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do

[R] ROC curve using epicalc (after logistic regression) (re-sent)

2009-07-27 Thread Clifford Long
Dear R-help, I am resending as I believe I screwed up the e-mail address to R-help earlier. Sorry for my lack of attention to detail, and for any inconvenience. I have also sent the question to the package maintainer, as suggested in the posting guide. Regards, Cliff -- Forwarded

[R] ROC curve using epicalc (after logistic regression)

2009-07-26 Thread Clifford Long
Dear R-help list, I'm attempting to use the ROC routine from the epicalc package after performing a logistic regression analysis. My code is included after the sessionInfo() result. The datafile (GasketMelt1.csv) is attached. I updated both R and the epicalc packages and tried again before

[R] Roc curves confidence intervals

2009-02-05 Thread marc bernard
Dear all, I am looking for an R package that allows me to calculate and plot the confidence intervals for the roc curve using for example some bootstrapping. I tried ROCR who seems doing such work but i couldn't find the right option in it. Many thanks Bests Marc

Re: [R] Roc curves confidence intervals

2009-02-05 Thread David Freedman
Would you be interested in the cross-validation that's on pp 3 and 4 of the ROCR package PDF? plot(perf,lwd=3,avg=vertical,spread.estimate=boxplot,add=TRUE) there are various options for the 'spread.estimate' David Freedman marc bernard-2 wrote: Dear all, I am looking for an R package

[R] ROC curve from logistic regression

2008-09-08 Thread gallon li
I know how to compute the ROC curve and the empirical AUC from the logistic regression after fitting the model. But here is my question, how can I compute the standard error for the AUC estimator resulting form logistic regression? The variance should be more complicated than AUC based on known

Re: [R] ROC curve from logistic regression

2008-09-08 Thread Frank E Harrell Jr
gallon li wrote: I know how to compute the ROC curve and the empirical AUC from the logistic regression after fitting the model. But here is my question, how can I compute the standard error for the AUC estimator resulting form logistic regression? The variance should be more complicated than

Re: [R] ROC curve from logistic regression

2008-09-08 Thread Pedro.Rodriguez
- sqrt(var) return(list(AUC=area, std=s)) } -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Frank E Harrell Jr Sent: Monday, September 08, 2008 8:22 AM To: gallon li Cc: r-help Subject: Re: [R] ROC curve from logistic regression gallon li wrote

Re: [R] ROC curve from logistic regression

2008-09-08 Thread Jorge Ivan Velez
Hi there, See ?lroc in the epicalc package. HTH, Jorge On Mon, Sep 8, 2008 at 4:02 AM, gallon li [EMAIL PROTECTED] wrote: I know how to compute the ROC curve and the empirical AUC from the logistic regression after fitting the model. But here is my question, how can I compute the

[R] ROC analysis

2008-03-19 Thread Eleni Christodoulou
Hello list, I am trying to perform ROC analysis and count the AUC in order to validate my results. I use package ROCR. I would like to count the AUC not under the cutoff found by performance but to use another cutoff that I calculate. How could I change the following command in order to get what

Re: [R] ROC analysis

2008-03-19 Thread Richard Pearson
Eleni Does the fpr.stop argument do what you want? This is described in ?performance under the details of the auc measure. Try, e.g. perform=performance(pred,measure=auc,fpr.stop=0.5) Richard. Eleni Christodoulou wrote: Hello list, I am trying to perform ROC analysis and count the AUC in

Re: [R] ROC analysis

2008-03-19 Thread Eleni Christodoulou
Richard, thanks, I think it will work. I will calculate the cutoff value and then, from the prediction object, find the fpr that is related to it and put it as argument to performance. I will keep you informed. Eleni On Wed, Mar 19, 2008 at 11:51 AM, Richard Pearson [EMAIL PROTECTED] wrote:

Re: [R] ROC analysis

2008-03-19 Thread Frank E Harrell Jr
Eleni Christodoulou wrote: Richard, thanks, I think it will work. I will calculate the cutoff value and then, from the prediction object, find the fpr that is related to it and put it as argument to performance. I will keep you informed. Eleni You will probably need to bootstrap the entire