Question about embedding policy architecture

What are written to the user and system memory in the photos? Are these just the embedding vectors for system actions and user inputs in chronological order per each story? Then the attention mechanism produces another vector to identify which parts to ignore and which parts to pay attention to?