I was part of the Harry Potter fandom too, and absolutely - it was like one of those man o' wars that's actually made up of dozens of completely separate species. People will mention "famous" stories, writers and artists, events, and it'll be like: "I have literally never heard of any of these people or things in my life."