Skip to content

Hyper-Parameter Optimization Framework - WIP - #477

Draft
D-McDougall wants to merge 1 commit into
masterfrom
nni
Draft

Hyper-Parameter Optimization Framework - WIP#477
D-McDougall wants to merge 1 commit into
masterfrom
nni

Conversation

@D-McDougall

Copy link
Copy Markdown
Collaborator

@breznak,
As promised, here is my attempt at using NNI:
https://github.com/Microsoft/nni

I started from their MNIST example, and I modified the following files to work with Nupic:

  • src/examples/mnist_nni/search_space.json
  • src/examples/mnist_nni/config.yml
  • src/examples/mnist_nni/mnist.py

I accidentally added the MNIST data files into git version control, so this branch is large and should never be merged to master :(

@D-McDougall D-McDougall added tooling research new functionality of HTM theory, research idea labels May 17, 2019
@breznak

breznak commented May 17, 2019

Copy link
Copy Markdown
Member

Perfect, thank you!
I'll add just FTR that this is an alternative to #433.

  • I think we could pick the python version of SP MNIST you've implemented.
  • the JSON with param space looks quite neat 👍

So one of the problems of this approach is lack of "default starting point params configuration"? Which is a failr choice, would make sense to put our so far best as a starting point.

@breznak

breznak commented Sep 3, 2020

Copy link
Copy Markdown
Member

Another hyper-param optimization framework, should support automated multithreading etc.
https://optuna.org/
Might look at, instead of our handwritten solution.

@breznak breznak changed the title NNI Meta-Parameter Optimization Framework - WIP Hyper-Parameter Optimization Framework - WIP Sep 3, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

research new functionality of HTM theory, research idea tooling

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants