Welcome to our Support Center
Updated

Dense

Description

Define the dense layer according to its parameters. To be used for the TimeDistributed layer. Type : polymorphic.

 

Input parameters

 

parameters : layer parameters.

Β units :Β integer, dimensionality of the output space.
Β activationΒ :Β enum, activation function to use.
Default value β€œlinear”.
Β use_bias? :Β boolean, whether the layer uses a bias vector.
Default value β€œTrue”.
Β optimizer :

Β algorithmΒ :Β enum, (name of optimizer) for optimizer instance.
Default value β€œadam”.
Β learning_rate :Β float, define the learning rate to use.
Default value β€œ0.001”.
Β beta_1 :Β float, define the exponential decay rate for the 1st moment estimates.
Default value β€œ0.9”.
Β beta_2 :Β float, define the exponential decay rate for the 2nd moment estimates.
Default value β€œ0.999”.

Β weight_initializerΒ :Β enum, initializer for the kernel weights matrix.
Default value β€œglorot_uniform”.
Β bias_initializerΒ :Β enum, initializer for the bias vector.
Default value β€œzero”.
Β training?Β :Β boolean, whether the layer is in training mode (can store data for backward).
Default value β€œTrue”.
Β store?Β :Β boolean, whether the layer stores the last iteration gradient (accessible via the β€œget_gradients” function).
Default value β€œFalse”.
Β update?Β :Β boolean, whether the layer’s variables should be updated during backward. Equivalent to freeze the layer.
Default value β€œTrue”.
Β lda_coeff :Β float, defines the coefficient by which the loss derivative will be multiplied before being sent to the previous layer (since during the backward run we go backwards).
Default value β€œ1”.

Β 

Output parameters

 

DenseΒ out : layer dense architecture.

Example

All these exemples are snippets PNG, you can drop these Snippet onto the block diagram and get the depicted code added to your VI (Do not forget to install HAIBAL library to run it).

Dense layer inside TimeDistributed layer

1 – Generate a set of data

We generate an array of data of type single and shape [batch_size = 10, time = 6, input_dim = 5].

2 – Define graph

First, we define the first layer of the graph which is an Input layer (explicit input layer method). This layer is setup as an input array shaped [time = 6, input_dim = 5].
Then, we add to the graph the TimeDistributed layer which we setup with a Dense layer using the define method.

3 – Run graph

We call the forward method and retrieve the result with the β€œPrediction 3D” method.
This method returns two variables, the first one is the layer information (cluster composed of the layer name, the graph index and the shape of the output layer) and the second one is the prediction with a shape of [batch_size, time, units].

 

Tags:
Table of Contents