Disability or difference?

SDAM and aphantasia are two closely related, overlapping phenomenon, and yet people seem to see SDAM as tragedy -- something that limits their enjoyment of life -- while aphantasia is largely seen as a difference rather than a disability. Why do you think this is? What does it say about the power of language and the problem with labels?