I have recently made a small Python port of my GPU NeoRL library. It doesn’t have the same features, so the most important differences are listed here:
- It is fully connected (not sparsely connected)
- It uses a new method for organizing temporal data (predictive coding)
- It is slower
- It is much easier to understand!
I call this port MiniNeoRL, since it serves mostly to help me prototype new algorithms and to explain the algorithms to others. Now I am not exactly a Python expert, but I think the code is simple enough such that with some explanation it should be easy to understand.
Along with MiniNeoRL I have made this slideshow that serves as a brief overview of what NeoRL is and how it works:
Until next time!