Tutorials

We have compiled a series of tutorials that take you from the very basics of Projective Simulation (PS) to applications presented in research papers.

Learning PS

These tutorials are designed to introduce the fundamentals of PS.

• Intro to PS: This notebook guides you through the basics of a PS agent equipped with a two-layer ECM. You will learn how the agent updates its internal structure based on reinforcement learning.
• Memory Based State Estimators: This notebook guides you through four types of memory model, each of can serve as the foundation for constructing an episodic and compositional memory.

Applications

Here you will find tutorials illustrating the use of PS in various applications, often developed within scientific papers.

• Learning to reset in target search problems: This notebook explores how a PS agent can learn an efficient resetting strategy for searching randomly distributed targets.

Contributing

If you would like to contribute, please see this tutorial on contributing guidelines.