Which one among the following options defins self-attention mechanish? select anyone? 1. None of the listed options. 2. Simplifies integration of LLMs in projects. 3. Manage memory. 4. Representation of a sentence is computed by relating different words i
The correct option that defines self-attention mechanism is:
4. Representation of a sentence is computed by relating different words in it.
Self-attention allows a model to weigh the significance of different words in a sentence when generating a representation, enabling it to capture contextual relationships effectively.