On Fri, Mar 15, 2013 at 10:24 AM, <[email protected]> wrote: >> Having both margin fixed is an unlikely situation, especially for >> confusion matrices. Your case looks like the one margin fixed. Could >> you elaborate more on the final goal of your attempt? > > I would like to investigate more on Cohen's kappa ( > http://en.wikipedia.org/wiki/Cohens_kappa): > It's not clear to how kappa would distribute given this "stratified > sampling".
FYI: https://github.com/statsmodels/statsmodels/blob/master/statsmodels/stats/inter_rater.py#L237 I never looked at randomization (bootstrap, permutation for this) > > If I simply generate a "non-stratified" random confusion matrix, kappa > becomes 0. My guess is that if you want to sample form the unconditional or semi-conditional (?) distribution, you would need to use the actual probabilities for the contingency table, not a uniform/independent. Josef > > > Regards, > Paul > > > This message and any attachment are confidential and may be privileged or > otherwise protected from disclosure. If you are not the intended recipient, > you must not copy this message or attachment or disclose the contents to any > other person. If you have received this transmission in error, please notify > the sender immediately and delete the message and any attachment from your > system. Merck KGaA, Darmstadt, Germany and any of its subsidiaries do not > accept liability for any omissions or errors in this message which may arise > as a result of E-Mail-transmission or for damages resulting from any > unauthorized changes of the content of this message and any attachment > thereto. Merck KGaA, Darmstadt, Germany and any of its subsidiaries do not > guarantee that this message is free of viruses and does not accept liability > for any damages caused by any virus transmitted therewith. > > Click http://www.merckgroup.com/disclaimer to access the German, French, > Spanish and Portuguese versions of this disclaimer. > > ------------------------------------------------------------------------------ > Everyone hates slow websites. So do we. > Make your web apps faster with AppDynamics > Download AppDynamics Lite for free today: > http://p.sf.net/sfu/appdyn_d2d_mar > _______________________________________________ > Scikit-learn-general mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/scikit-learn-general ------------------------------------------------------------------------------ Everyone hates slow websites. So do we. Make your web apps faster with AppDynamics Download AppDynamics Lite for free today: http://p.sf.net/sfu/appdyn_d2d_mar _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
