If you're going to have a book full of clever people and nobody ever jokes, it's just not going to ring true to the reader. That said, humor writing is the hardest kind of writing there is.