# NeuralNetworks

**Repository Path**: koolo233/NeuralNetworks

## Basic Information

- **Project Name**: NeuralNetworks
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: MIT
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2022-01-04
- **Last Updated**: 2022-01-04

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# NeuralNetworks
Python implementation of Neural Networks


网页打开jupyter可能存在公式渲染错误的问题，在VS Code中利用Markdown Preview Enhanced进行渲染则可以保证正常。

具体操作为：
* 安装VS Code以及Markdown Preview Enhanced插件
* 打开README.md并启用Markdown Preview Enhanced渲染
* 切换到需要进行渲染的Jupyter Markdown Block并进入编辑模式


### ToDo list
- [x] [Perceptron](https://github.com/koolo233/NeuralNetworks/blob/main/Perceptron.ipynb)
- [x] [Adaptive Linear Neuron(Adaline)](https://github.com/koolo233/NeuralNetworks/blob/main/Adaline.ipynb)
- [x] [Basic Automatic Differentiation(AD)](https://github.com/koolo233/NeuralNetworks/blob/main/BasicAutomaticDifferentiation.ipynb)
- [x] [Multilayer Perceptrons(Fully Connected Neural Network)](https://github.com/koolo233/NeuralNetworks/blob/main/FullyConnectedNeuralNetwork.ipynb)
- [x] [Radial-Basis Function Networks(RBF)](https://github.com/koolo233/NeuralNetworks/blob/main/RBF.ipynb)
- [x] [Hopfield](https://github.com/koolo233/NeuralNetworks/blob/main/Hopfield.ipynb)
- [ ] Jordan
- [x] [Elman](https://github.com/koolo233/NeuralNetworks/blob/main/Elman.ipynb)
- [x] [Hamming Neural Network](https://github.com/koolo233/NeuralNetworks/blob/main/Hamming.ipynb)
- [x] [Self-Organizing Feature Map(SOFM)](https://github.com/koolo233/NeuralNetworks/blob/main/SOFM.ipynb)
- [x] [Cerebellar Model Articulation Controller(CMAC)](https://github.com/koolo233/NeuralNetworks/blob/main/CMAC.ipynb)
- [ ] Deep Boltzmann Machine(DBM)
- [ ] Deep Belief Network(DBN)
- [ ] Convolutional Neural Networks(CNN)
- [ ] Recurrent Neural Network(RNN)
- [ ] Graph Neural Network(GNN)
- [ ] Graph Convolutional Netword(GCN)
- [ ] Deep Q-Learning(DQN)
- [ ] Neural Architecture Search(NAS -> ENAS)

### Result
#### [Perceptron](https://github.com/koolo233/NeuralNetworks/blob/main/Perceptron.ipynb)
* [and](https://github.com/koolo233/NeuralNetworks/blob/main/Perceptron.ipynb)
![and](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/add_perceptron.gif "segment")

* [or](https://github.com/koolo233/NeuralNetworks/blob/main/Perceptron.ipynb)
![or](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/or_perceptron.gif "segment")

* [Nor(x1)](https://github.com/koolo233/NeuralNetworks/blob/main/Perceptron.ipynb)
![Nor(x1)](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/nor_x1_perceptron.gif "segment")

* [Nor(x2)](https://github.com/koolo233/NeuralNetworks/blob/main/Perceptron.ipynb)
![Nor(x2)](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/nor_x2_perceptron.gif "segment")

* [xoR](https://github.com/koolo233/NeuralNetworks/blob/main/Perceptron.ipynb)
![xor](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/xor_perceptron.gif "segment")

* [线性可分样本簇](https://github.com/koolo233/NeuralNetworks/blob/main/Perceptron.ipynb)
![xor](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/blobs_perceptron.gif "segment")

* [线性不可分样本簇](https://github.com/koolo233/NeuralNetworks/blob/main/Perceptron.ipynb)
![xor](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/moons_perceptron.gif "segment")

#### [Adaptive Linear Neuron(Adaline)](https://github.com/koolo233/NeuralNetworks/blob/main/Adaline.ipynb)
* [and](https://github.com/koolo233/NeuralNetworks/blob/main/Adaline.ipynb)
![and](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/add_adaline.gif "segment")

* [or](https://github.com/koolo233/NeuralNetworks/blob/main/Adaline.ipynb)
![or](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/or_adaline.gif "segment")

* [Nor(x1)](https://github.com/koolo233/NeuralNetworks/blob/main/Adaline.ipynb)
![Nor(x1)](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/nor_x1_adaline.gif "segment")

* [Nor(x2)](https://github.com/koolo233/NeuralNetworks/blob/main/Adaline.ipynb)
![Nor(x2)](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/nor_x2_adaline.gif "segment")

* [xoR](https://github.com/koolo233/NeuralNetworks/blob/main/Adaline.ipynb)
![xor](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/xor_adaline.gif "segment")

* [线性可分样本簇](https://github.com/koolo233/NeuralNetworks/blob/main/Adaline.ipynb)
![xor](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/blobs_adaline.gif "segment")

* [线性不可分样本簇](https://github.com/koolo233/NeuralNetworks/blob/main/Adaline.ipynb)
![xor](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/moons_adaline.gif "segment")

#### [Basic Automatic Differentiation(AD)](https://github.com/koolo233/NeuralNetworks/blob/main/BasicAutomaticDifferentiation.ipynb)
![AD_test](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/AD_test_data.gif "segment")

#### [Multilayer Perceptrons(Fully Connected Neural Network)](https://github.com/koolo233/NeuralNetworks/blob/main/FullyConnectedNeuralNetwork.ipynb)

* [and](https://github.com/koolo233/NeuralNetworks/blob/main/FullyConnectedNeuralNetwork.ipynb)
![and](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/add_BPNetwork.gif "segment")

* [or](https://github.com/koolo233/NeuralNetworks/blob/main/FullyConnectedNeuralNetwork.ipynb)
![or](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/or_BPNetwork.gif "segment")

* [Nor(x1)](https://github.com/koolo233/NeuralNetworks/blob/main/FullyConnectedNeuralNetwork.ipynb)
![Nor(x1)](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/nor_x1_BPNetwork.gif "segment")

* [Nor(x2)](https://github.com/koolo233/NeuralNetworks/blob/main/FullyConnectedNeuralNetwork.ipynb)
![Nor(x2)](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/nor_x2_BPNetwork.gif "segment")

* [xoR](https://github.com/koolo233/NeuralNetworks/blob/main/FullyConnectedNeuralNetwork.ipynb)
![xor](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/xor_BPNetwork.gif "segment")

* [线性可分样本簇](https://github.com/koolo233/NeuralNetworks/blob/main/FullyConnectedNeuralNetwork.ipynb)
![xor](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/blobs_BPNetwork.gif "segment")

* [线性不可分样本簇](https://github.com/koolo233/NeuralNetworks/blob/main/FullyConnectedNeuralNetwork.ipynb)
![xor](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/moons_BPNetwork.gif "segment")

* [非线性回归](https://github.com/koolo233/NeuralNetworks/blob/main/FullyConnectedNeuralNetwork.ipynb)
![nonlinear_regression](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/nonlinear_regression_BPNetwork.gif "segment")

#### [Radial-Basis Function Networks(RBF)](https://github.com/koolo233/NeuralNetworks/blob/main/RBF.ipynb)

* [分类](https://github.com/koolo233/NeuralNetworks/blob/main/RBF.ipynb)

![分类](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/RBF_classification.gif "segment")

* [回归](https://github.com/koolo233/NeuralNetworks/blob/main/RBF.ipynb)

![回归](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/RBF_regression.gif "segment")

#### [Hopfield](https://github.com/koolo233/NeuralNetworks/blob/main/Hopfield.ipynb)

* [联想记忆](https://github.com/koolo233/NeuralNetworks/blob/main/Hopfield.ipynb)

![nonlinear_regression](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/Hopfield.png "segment")

#### [Elman](https://github.com/koolo233/NeuralNetworks/blob/main/Elman.ipynb)

* [回归1](https://github.com/koolo233/NeuralNetworks/blob/main/Elman.ipynb)

![regression](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/ELman_regression_example_1.gif "segment")

* [回归2](https://github.com/koolo233/NeuralNetworks/blob/main/Elman.ipynb)

![regression](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/ELman_regression_example_2.gif "segment")

#### [HammingNN](https://github.com/koolo233/NeuralNetworks/blob/main/Hamming.ipynb)

* [联想记忆](https://github.com/koolo233/NeuralNetworks/blob/main/Hamming.ipynb)

![regression](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/Hamming_example_1.png "segment")

#### [SOFM](https://github.com/koolo233/NeuralNetworks/blob/main/SOFM.ipynb)

* [保序映射](https://github.com/koolo233/NeuralNetworks/blob/main/SOFM.ipynb)

![保序映射](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/SOFM_example_1.gif "segment")

* [聚类](https://github.com/koolo233/NeuralNetworks/blob/main/SOFM.ipynb)

![聚类](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/SOFM_example_2.gif "segment")

#### [Cerebellar Model Articulation Controller(CMAC)](https://github.com/koolo233/NeuralNetworks/blob/main/CMAC.ipynb)

* [拟合函数](https://github.com/koolo233/NeuralNetworks/blob/main/CMAC.ipynb)
![regression](https://raw.githubusercontent.com/koolo233/NeuralNetworks/main/images/CMAC_sin_cos.gif "segment")