HAIBAL Blog

Activation GELU

[code_snippet id=14 php=true]

GELU

GELUDescription Define the gelu layer according to its parameters. To be used for the TimeDistributed layer. Type :...

read more

GELU

GELUDescription Setup and add gelu layer into the model during the definition graph step. Type : polymorphic.  ...

read more