Dense
Description
Setup and add the dense layer into the model during the definition graph step. Type : polymorphic.
Input parameters
Model in : model architecture.
Parameters : layer parameters.
units : integer, dimensionality of the output space.Β ActivationΒ :Β cluster,Β activation function to use.
use bias? : boolean, whether the layer uses a bias vector.
Default value “True”.Β Weight InitializerΒ :Β cluster,Β initializer for theΒ kernelΒ weights matrix.Β Bias InitializerΒ :Β cluster,Β initializer for the bias vector.Β Weight RegularizerΒ :Β cluster,Β regularizer function applied to theΒ kernelΒ weights matrix.Β Bias RegularizerΒ :Β cluster,Β regularizer function applied to the bias vector. training?Β : boolean, whether the layer is in training mode (can store data for backward).
Default value “True”. store?Β : boolean, whether the layer stores the last iteration gradient (accessible via the “get_gradients” function).
Default value “False”. update?Β : boolean, whether the layer’s variables should be updated during backward. Equivalent to freeze the layer.
Default value “True”.
lda coeff : float, defines the coefficient by which the loss derivative will be multiplied before being sent to the previous layer (since during the backward run we go backwards).
Default value “1”.
name (optional) : string, name of the layer.
Output parameters
Model out : model architecture.
Dimension
Input shape
N-Dimension tensor with shape: [batch Size, input_dim 1,…, input_dim N]. The most common situation would be a 2D input with shape [batch size, input_dim 1 = Input dimension].
Output shape
N-Dimension tensor with shape: [batch Size, units 1,…, units N]. For instance, for a 2D input with shape [batch size, input_dim 1], the output would have shape [batch size, units 1].
Example
All these exemples are snippets PNG, you can drop these Snippet onto the block diagram and get the depicted code added to your VI (Do not forget to install Deep Learning library to run it).
Dense layer layer
1 – Generate a set of data
We generate an array of data of type single and shape [batch_size = 10, input_dim = 5].
2 – Define graph
First, we define the first layer of the graph which is an Input layer (explicit input layer method). This layer is setup as an input array shaped [input_dim = 5].
Then we add to the graph the Dense layer.
3 – Run graph
We call the forward method and retrieve the result with the βPrediction 2Dβ method.
This method returns two variables, the first one is the layer information (cluster composed of the layer name, the graph index and the shape of the output layer) and the second one is the prediction with a shape of [batch_size, units].
Dense layer, batch and dimension
1 – Generate a set of data
We generate an array of data of type single and shape [number of batch = 9, batch_size = 10, input_dim = 5].
2 – Define graph
First, we define the first layer of the graph which is an Input layer (explicit input layer method). This layer is setup as an input array shaped [input_dim = 5].
Then we add to the graph the Dense layer.
3 – Run graph
We call the forward method and retrieve the result with the βPrediction 2Dβ method.
This method returns two variables, the first one is the layer information (cluster composed of the layer name, the graph index and the shape of the output layer) and the second one is the prediction with a shape of [batch_size, units].
(Expert) Train model with dense layers (2D)
1 – Define graph
We define a graph with one input layer (A batch of 1D tensor –> 2D array input data), two dense hidden layer and one output layer (A batch of 1D tensor –> 2D array predicted data – output data).
2 – Generate a set of data
We generate array of cosinus data dimensionnated of type single and shape [number of batch = 10, batch_size = 10, input_dim = 6] – 3D array
3 – Train model
We call the forward method Β inside a batch loop (2D array) then we call 2D loss (Ytrue is a batch of 1D tensor –> 2D array predicted data – output true data) then we update weight of the model by using Backward function.
4 – Test model
Every epoch we sequentially make a prediction with the model on the complete dataset (1 Batch of all 1D tensor –> 2D array) and we read the predicted result.
(Expert) Train model with dense layers (3D)
1 – Define graph
We define a graph with one input layer (A batch of 2D tensor –> 3D array input data), two dense hidden layer and one output layer (A batch of 2D tensor –> 2D array predicted data – output data).
2 – Generate a set of data
We generate array of cosinus data dimensionnated of type single and shape [number of batch = 10, batch_size = 10, input_dim1 = 3, input_dim2 = 2] – 4D array
3 – Train model
We call the forward method Β inside a batch loop (3D array) then we call 3D loss (Ytrue is a batch of 2D tensor –> 3D array predicted data – output true data) then we update weight of the model by using Backward function.
4 – Test model
Every epoch we sequentially make a prediction with the model on the complete dataset (1 Batch of all 2D tensor –> 3D array) and we read the predicted result.Β