Kognitivní systémy A6MX33KSY Brain Simulator - Úvod Jaroslav Vítků

Cíle cvičení Použití Brain Simulatoru pro modelování v KSI -CV1: základní principy, použití stávajících uzlů -CV2: pokročilejší použití, skriptování v C# (python) Typy učení (supervised/unsupervised/reinforcement) Čas na dotazy ohledně semestrálních prací Jednoduché zadání

Nová verze BrainSimulatoru Brain Simulator ke stažení (dokumentace) Fórum pro dotazy

C# Node Scripting How to write own code in the BrainSimulator? Possibility 1 -Download BrainSimulator sources -Open project in the Visual Studio -Implement own Node/World Possibility 2 -Use a special nodes for scripting -C# and Python nodes -Demo now

Types of Learning Supervised Unsupervised Reinforcement

Data examples Data

Supervised learning Supervised learning: given labeled examples label label 1 label 3 label 4 label 5 labeled examples examples

Supervised learning model/ predictor label label 1 label 3 label 4 label 5 Supervised learning: given labeled examples

Supervised learning model/ predictor Supervised learning: learn to predict new example predicted label

Supervised learning: classification Supervised learning: given labeled examples label apple banana Classification: a finite set of labels

Unsupervised learning Unsupervised learning: given data, i.e. examples, but no labels

Reinforcement learning left, right, straight, left, left, left, straight left, straight, straight, left, right, straight, straight GOOD BAD left, right, straight, left, left, left, straight left, straight, straight, left, right, straight, straight Given a sequence of examples/states and a reward after completing that sequence, learn to predict the action to take in for an individual example/state

Reinforcement learning example … WIN! … LOSE! Backgammon Given sequences of moves and whether or not the player won at the end, learn to make good moves

Brain Simulator – Learning Supervised -FF network, MNIST classifier -LSTM network, prediction of sequences Unsupervised -MNIST + RBM (unsupervised) Reinforcement -Q-Learning Breakout game -Discrete Q-Learning

Brain Simulator – Useful stuff Visual Attention -Focuser example

Reaching AGI with Brain Simulator Brain Simulator ke stažení + dokumentace Fórum pro dotazy Ukázkové projekty ke stažení s s Typy učení, slidy zdroj: Děkuji za pozornost

A6MX33KSY – semestrální práce Témata: -Predikce pohybu jednoho objektu -Simulace pozornosti při průchodu bludištěm -Hra Logik -Hra Piškvorky -Hra Blockout

Brain Simulator – modules Implemented modules -FFNs, RNNs, CNNs, LSTM, RBMs -Self-organizing networks (SOM, GNG) -Vector symbolic architectures (HRR, BSC) -Hierarchical temporal memory (spatial & temporal poolers) -Spiking networks & STDP -Computer vision (filters, segmentation, optical flow …) -SLAM, PID … -Q-Learning Imported modules -Caffe, BLAS, BEPU Physics, Space Engineers