On 01/27/2016 03:15 PM, Pedro Rodriguez wrote:
Thanks for response Andy,
The main thing I wanted to get out of asking was:
1. Is this a reasonable thing to try?
Yes.
2. Has it been done before?
Not for TuPAQ afaik.
I would want to make it scikit-learn compatible, but having it be a PR
isn't my main goal (only a possible plus). Looks like this might be
interesting to do and comparing against auto-sklearn would give me an
idea of how well it does against a well thought out/tuned take on
automated model search.
The iterations assumption is fair, it also assumes that an iteration
across algorithms is equivalent which isn't true. That would be
something else I would be interested in looking at (use time budget
instead)
Not all algorithms even have a concept of iteration. What is an
iteration for a Random Forest? What is an iteration for PCA? What is an
iteration for an SVM?
Sometimes, even if you could stop early, the result might be nonsensical.
------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=267308311&iu=/4140
_______________________________________________
Scikit-learn-general mailing list
Scikit-learn-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
