This paper put forward reflection and judgment on the one-sided and limited analogy or correlation research of architecture and clothing in previous studies. Combined with examples, and through the demonstration of the spatial essence of architecture and clothing and phenomenological theory, this paper demonstrated the essential relationship between the two and the possibility of the connection and analogy between architecture and clothing from the perspectives of "function determines space", "spatial perception based on phenomenology" and "interpretation approach based on semiotics and iconology". The establishment of this relevance was precisely around the thinking of "human" on the internal spiritual experience of "spatial perception". In the previous literature, the analogy and relevance between "architecture" and "clothing" were mostly discussed from the similarities of their functions, historical development and artistic style, especially from the similarities of elements such as modeling, color, pattern and skin texture, which was inevitably limited to the superficial research. By studying the spatial essence of the two, this paper hopes to establish a new perspective for subsequent related research and practice.