Kognitivní systémy A6MX33KSY Brain Simulator - Úvod Jaroslav Vítků.

Prezentace na téma: "Kognitivní systémy A6MX33KSY Brain Simulator - Úvod Jaroslav Vítků."— Transkript prezentace:

1 Kognitivní systémy A6MX33KSY Brain Simulator - Úvod Jaroslav Vítků

2 Cíle cvičení Použití Brain Simulatoru pro modelování v KSI -CV1: základní principy, použití stávajících uzlů -CV2: pokročilejší použití, skriptování v C# (python) Typy učení (supervised/unsupervised/reinforcement) Čas na dotazy ohledně semestrálních prací Jednoduché zadání

3 Nová verze BrainSimulatoru Brain Simulator ke stažení (dokumentace) http://www.goodai.com/brain-simulator Fórum pro dotazy http://forum.goodai.com/index.php

4 C# Node Scripting How to write own code in the BrainSimulator? Possibility 1 -Download BrainSimulator sources -Open project in the Visual Studio -Implement own Node/World Possibility 2 -Use a special nodes for scripting -C# and Python nodes -Demo now

5 Types of Learning Supervised Unsupervised Reinforcement

6 Data examples Data

7 Supervised learning Supervised learning: given labeled examples label label 1 label 3 label 4 label 5 labeled examples examples

8 Supervised learning model/ predictor label label 1 label 3 label 4 label 5 Supervised learning: given labeled examples

9 Supervised learning model/ predictor Supervised learning: learn to predict new example predicted label

10 Supervised learning: classification Supervised learning: given labeled examples label apple banana Classification: a finite set of labels

11 Unsupervised learning Unsupervised learning: given data, i.e. examples, but no labels

12 Reinforcement learning left, right, straight, left, left, left, straight left, straight, straight, left, right, straight, straight GOOD BAD left, right, straight, left, left, left, straight left, straight, straight, left, right, straight, straight 18.5 -3 Given a sequence of examples/states and a reward after completing that sequence, learn to predict the action to take in for an individual example/state

13 Reinforcement learning example … WIN! … LOSE! Backgammon Given sequences of moves and whether or not the player won at the end, learn to make good moves

14 Brain Simulator – Learning Supervised -FF network, MNIST classifier -LSTM network, prediction of sequences Unsupervised -MNIST + RBM (unsupervised) Reinforcement -Q-Learning Breakout game -Discrete Q-Learning

15 Brain Simulator – Useful stuff Visual Attention -Focuser example

16 Reaching AGI with Brain Simulator Brain Simulator ke stažení + dokumentace http://www.goodai.com/brain-simulator Fórum pro dotazy http://forum.goodai.com/index.php Ukázkové projekty ke stažení https://github.com/GoodAI/BrainSimulatorSampleProject s https://github.com/GoodAI/BrainSimulatorSampleProject s Typy učení, slidy zdroj: http://goo.gl/FzmBGHhttp://goo.gl/FzmBGH Děkuji za pozornost jaroslav.vitku@keenswh.com

17 A6MX33KSY – semestrální práce Témata: -Predikce pohybu jednoho objektu -Simulace pozornosti při průchodu bludištěm -Hra Logik -Hra Piškvorky -Hra Blockout

18 Brain Simulator – modules Implemented modules -FFNs, RNNs, CNNs, LSTM, RBMs -Self-organizing networks (SOM, GNG) -Vector symbolic architectures (HRR, BSC) -Hierarchical temporal memory (spatial & temporal poolers) -Spiking networks & STDP -Computer vision (filters, segmentation, optical flow …) -SLAM, PID … -Q-Learning Imported modules -Caffe, BLAS, BEPU Physics, Space Engineers