What do you need the random matrix for? A baseline?
A simple baseline is to predict the most common class for all obs.
On 15 Mar 2013 14:38, <[email protected]> wrote:
> On Fri, Mar 15, 2013 at 10:24 AM, <[email protected]> wrote:
> >> Having both margin fixed is an unlikely situation, especially for
> >> confusion matrices. Your case looks like the one margin fixed. Could
> >> you elaborate more on the final goal of your attempt?
> >
> > I would like to investigate more on Cohen's kappa (
> > http://en.wikipedia.org/wiki/Cohens_kappa):
> > It's not clear to how kappa would distribute given this "stratified
> > sampling".
>
> FYI:
> https://github.com/statsmodels/statsmodels/blob/master/statsmodels/stats/inter_rater.py#L237
> I never looked at randomization (bootstrap, permutation for this)
>
> >
> > If I simply generate a "non-stratified" random confusion matrix, kappa
> > becomes 0.
>
> My guess is that if you want to sample form the unconditional or
> semi-conditional (?) distribution, you would need to use the actual
> probabilities for the contingency table, not a uniform/independent.
>
> Josef
>
> >
> >
> > Regards,
> > Paul
> >
> >
> > This message and any attachment are confidential and may be privileged
> or otherwise protected from disclosure. If you are not the intended
> recipient, you must not copy this message or attachment or disclose the
> contents to any other person. If you have received this transmission in
> error, please notify the sender immediately and delete the message and any
> attachment from your system. Merck KGaA, Darmstadt, Germany and any of its
> subsidiaries do not accept liability for any omissions or errors in this
> message which may arise as a result of E-Mail-transmission or for damages
> resulting from any unauthorized changes of the content of this message and
> any attachment thereto. Merck KGaA, Darmstadt, Germany and any of its
> subsidiaries do not guarantee that this message is free of viruses and does
> not accept liability for any damages caused by any virus transmitted
> therewith.
> >
> > Click http://www.merckgroup.com/disclaimer to access the German,
> French, Spanish and Portuguese versions of this disclaimer.
> >
> >
> ------------------------------------------------------------------------------
> > Everyone hates slow websites. So do we.
> > Make your web apps faster with AppDynamics
> > Download AppDynamics Lite for free today:
> > http://p.sf.net/sfu/appdyn_d2d_mar
> > _______________________________________________
> > Scikit-learn-general mailing list
> > [email protected]
> > https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>
>
> ------------------------------------------------------------------------------
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics
> Download AppDynamics Lite for free today:
> http://p.sf.net/sfu/appdyn_d2d_mar
> _______________________________________________
> Scikit-learn-general mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>
------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_mar
_______________________________________________
Scikit-learn-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
