A lot of things play into this aptitude (or lack of). How we spend our time, what we use our brains for, compounds weaknesses and strengths a great deal. I read a fascinating book not long ago called Proust and the Squid by Maryanne Wolf about how transitioning from a society that reads 'deeply' -- with books -- into a society that consumes a larger quantity of digital information in other formats has very literally changed how we think, in the same way that the emergence of written language changed how our brains worked when that became a thing. That won't surprise anybody with any layperson understanding of neuroscience, but it's a thing we don't talk about or consider.
Which is not to say that I think aphantasia is down to 'did you read books as a kid, and/or are you of an age that consumes media very differently' or anything so reductive as that. It's always much more complicated than that. It just makes me wonder what patterns or commonalities you would find, if you were able to profile people who did or did not have aphantasia (which would require even knowing which factors to look at in the first place).
I have a hard time imagining what it would be like to have aphantasia -- somewhat ironically, I guess, since the thing that makes it hard is that I have a vivid and really sensory, detail-oriented imagination. Heh.