Efficient multi-scale attention (EMA)
EMA attention paper https://arxiv.org/ftp/arxiv/papers/2305/2305.13563.pdf
Paper introduction
Significant Effectiveness of Channel or Space The significant effect of attention mechanisms on producing more discriminable feature representations is illustrated in various computer vision tasks. Visual tasks. However, using channel dimensionality reduction to model cross-channel relationships may bring side effects to extracting deep visual representations. Brings side effects in extracting deep visual representations.
propose