deepof.model_utils.positional_encoding

deepof.model_utils.positional_encoding(position: int, d_model: int)

Compute positional encodings, as in https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf.

Parameters:

  • position (int) – position in the sequence.

  • d_model (int) – dimensionality of the embeddings.