Is the word "geek" no longer used for what you are describing? Although there a lot of overlap, I thought nerd referred to strong interests in academic subjects and geek referred to niche cultural subjects.
True, I've been conflating the two in all of my posts. As far as how they were used when I was growing up, the distinction tended to be moot because they were most commonly used ironically or jokingly.