It's one thing to not want an evil-sorcerer type villain in your story, but it's another thing to avoid having any sort of antagonist at all. A story without an antagonist gets weird pretty quick.