Dear Eric and David

By accepting lower thresholds I actually mean accepting higher FDRs but 
that is not so useful here because there is not so many hits after the very 
high probabilities and I will not be gaining much by using lower 
thresholds. PeptideProphet gives me a lot of PSMs with very high confidence 
and very low FDR. But as I allow higher FDRs like 2-3% it falls behind PEP 
from MaxQuant.

Here is another plot to better show my point. I have compared the combined 
results above with Max Quant's results as I increase the FDR. As it can be 
seen, number of unique peptides is more with PepPro/iPro for low FDR, but 
in the end it falls behind PEP.


<https://lh3.googleusercontent.com/-VZgUOiAvvno/WG1ggpOR3uI/AAAAAAAABBA/nyrjsBbLrGQ60eo3iqB3beMOVs4ZCXCAACLcB/s1600/Picture1.png>


And this can be understood from the following plot:


<https://lh3.googleusercontent.com/-jmsbfmBfbXA/WG1hNLP8e1I/AAAAAAAABBI/SBnRc5-naTw09vjKk0K4m9xcCBgS-1Z8QCLcB/s1600/Picture2.png>


Do you have any thoughts on this?


Thank you very much,

Ali




On Wednesday, January 4, 2017 at 3:08:14 PM UTC-5, Ali wrote:
>
> Dear David and Eric
>
> Thanks for your replies and suggestions. I thought that I might be able to 
> increase identification by accepting hits with lower thresholds. I do 
> understand what you mentioned here.
>
> Thanks again,
> Ali
>
> On Tuesday, January 3, 2017 at 1:57:38 PM UTC-5, Eric Deutsch wrote:
>>
>> In the ideal case where the PeptideProphet and iProphet had perfect 
>> discriminating power, i.e. the correct and incorrect PSM distributions do 
>> not overlap, you would expect a large peak at P=0 and P=1 and nothing in 
>> between. As a dataset diverges from this ideal and the correct and 
>> incorrect distributions begin to overlap, you will still have very large 
>> peaks near P=0 and near P=1, with a small number of intermediate values 
>> where the probability is between 0 and 1.
>>
>>  
>>
>> So, in short, your distribution is exactly what you would expect based on 
>> what you did. It is indicative of a great dataset. You should follow 
>> David’s suggestion, and then if you replot, you will see huge peaks at 0 
>> and 1 with rather little in between.
>>
>>  
>>
>> Regards,
>>
>> Eric
>>
>>  
>>
>>  
>>
>> *From:* [email protected] [mailto:[email protected]] 
>> *On Behalf Of *David Shteynberg
>> *Sent:* Tuesday, January 03, 2017 10:36 AM
>> *To:* spctools-discuss
>> *Subject:* Re: [spctools-discuss] PeptideProphet/iProphet Probability 
>> Distribution
>>
>>  
>>
>> These results are showing you that iProphet has great discriminating 
>> power even when you restrict the input to only non-low probability PSMs 
>> (filtering with PeptideProphet probability).  The best way to run iProphet 
>> is to give it all the data from PeptideProphet (use a PeptideProphet 
>> minimum probability of 0).
>>
>>  
>>
>> -David
>>
>>  
>>
>> On Mon, Jan 2, 2017 at 9:26 PM, Ali <[email protected]> wrote:
>>
>> Dear all
>>
>>  
>>
>> I am plotting the distribution of the assigned PeptideProphet and 
>> iProphet probabilities to my search results. I am seeing a rather strange 
>> pattern shown below. Why am I seeing so many hits with very high confidence 
>> (probability >0.98) but suddenly after that threshold the number of 
>> assigned probabilities to the PSMs decrease abruptly? What could be the 
>> reason for this pattern? One would expect to see all ranges of 
>> probabilities for PSMs.
>>
>>  
>>
>>
>> <https://lh3.googleusercontent.com/-BeikGpozjkw/WGsygFV83UI/AAAAAAAABAg/DcG6lRxucM4IRclvdadal-eFSaA05sd6QCLcB/s1600/Picture1.png>
>>
>>  
>>
>>  
>>
>> This figure is the combination of different search engines:
>>
>> - Comet (min PepPro=0.5)
>>
>> - X! Tandem GPM (min PepPro=0.05)
>>
>> - X! Tandem TPP (min PepPro=0.05)
>>
>>  
>>
>> The horizontal axis is between 0.5 and 1.
>>
>>  
>>
>> and I can see the same pattern for the PeptideProphet distribution of 
>> each one of these search engine results including SpectraST (Except for X! 
>> Tandem GPM).
>>
>>  
>>
>> Thank you very much,
>>
>>  
>>
>> Ali
>>
>>  
>>
>>  
>>
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "spctools-discuss" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to [email protected].
>> To post to this group, send email to [email protected].
>> Visit this group at https://groups.google.com/group/spctools-discuss.
>> For more options, visit https://groups.google.com/d/optout.
>>
>>  
>>
>> -- 
>> You received this message because you are subscribed to the Google Groups 
>> "spctools-discuss" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to [email protected].
>> To post to this group, send email to [email protected].
>> Visit this group at https://groups.google.com/group/spctools-discuss.
>> For more options, visit https://groups.google.com/d/optout.
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"spctools-discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/spctools-discuss.
For more options, visit https://groups.google.com/d/optout.

Reply via email to