So much of the way books get classified has to do with marketing decisions. I think it's more useful to think of literary books and sci-fi/fantasy books as existing on a continuum.