@Author: Fan
All the project only based on numpy
Active Function Support
- Sigmoid
- ReLU
- LeakyReLU
- tanh
- Softmax
Loss Function Support
- CrossEntrop
- L1 distance
- L2 distance
Optimizer Strategies Support
- SGD
- Momentum
- Adam
Initialize Strategies Support
- Gaussion initialize
- Constant initialize
- Xavier initialize
- He_normal initialize
Regularization Strategies Support
- Batch Normal
- Dropout
- Parameters regularize
CNN Support
- Padding
- Pooling
- Kernal
RNN Support
- Classic RNN
- LSTM