I want a way to write a script to swarm over several data sets and create model params for each of them, programmatically. Currently, you have to create a "swarm description" JSON file [1] for each swarm you want to run, then pass it to the run_swarm.py script [2].
I've recently updated the swarming code to create a model_params.py file so the swarm run and model execution can be scripted [3], but I want to extend this so I can programmatically create swarm descriptions from data sets. I'm thinking about creating a new feature request in our issue tracker, that goes something like this: * * * "Ability to create swarm permutations from a script" The current `nupic.swarming.permutations_runner` module was obviously created as a part of a command-line utility, but I want to create and run swarms in my own program. I'd like to see a `runPermutations` function that will accept a dict in place of the filepath to a swarm description file. Even better would be an inner function that is not expected to be called with CLI arguments. EVEN BETTER would be a complete interface for for swarming at `nupic.swarming` that exposes easy ways to run swarms without the CLI and returns model_params as the result, so they can immediately be turned into a model object without ever touching the file system. * * * Any comments or suggestions before I create this ticket? Of course, I could always just create some transient JSON swarm description files behind the scenes and pass the file paths into runPermutations, which is what I will do in the meantime. But I think we should treat swarming in general as more than just a command line utility. [1] https://github.com/numenta/nupic/wiki/Running-Swarms#the-swarm-description [2] https://github.com/numenta/nupic/wiki/Running-Swarms#example [3] https://github.com/numenta/nupic/wiki/Running-Swarms#running-a-swarm-programmatically --------- Matt Taylor OS Community Flag-Bearer Numenta
_______________________________________________ nupic mailing list [email protected] http://lists.numenta.org/mailman/listinfo/nupic_lists.numenta.org
