Version 0.4.0.

• Embedding backward
• Momentum
• NesterovMomentum
• Adagrad
• RMSprop
• Adadelta
• Adam
• Adamax

Version 0.3.0.

• Add chatbot application.
• Add more examples.
• Support LSTM.
• Support GRU.

Version 0.2.5.

Add almost all test.

Second release.

Support Layers:

• Batch Normalization Layer
• Embedding Layer
• MeanPooling Layer
• Flatten Layer

Support Activations:

• SymmetricElliot
• LReLU
• SoftPlus
• SoftSign

Support Initializations:

• HeNormal
• HeUniform
• Orthogonal

Add more tutorials.

Add more API comments.

First release.

Support layers:

• Dense (perceptron) Layer
• Softmax Layer
• Dropout Layer
• Convolution Layer
• MaxPooling Layer
• SimpleRNN Layer

Support Activations:

• Sigmoid
• Tanh
• ReLU
• Softmax
• Elliot

Support Initializations:

• Uniform
• Normal
• LecunUniform
• GlorotUniform
• GlorotNormal

Support Objectives:

• MeanSquaredError
• HellingerDistance
• BinaryCrossEntropy
• SoftmaxCategoricalCrossEntropy

Support Optimizers:

• SGD