deepof.model_utils.get_angles

deepof.model_utils.get_angles(pos: int, i: int, d_model: int)

Auxiliary function for positional encoding computation.

Parameters:
  • pos (int) – position in the sequence.

  • i (int) – number of sequences.

  • d_model (int) – dimensionality of the embeddings.