Overcoming the Duality between Internal and Pure Attention