Perhaps It's because of the unfavorable associations with which the polo shirt is laden. It is frequently considered regarding a uniform — possibly actually, as during the demanded get-up of a pizza delivery person or elementary college university student, or metaphorically, since the go-to garb for corporate drones and preppy fraternity brothers