Oftentimes, churches are started by an entrepreneurial church plant visionary whom everybody follows, but he's not following anybody. Even though he's "accountable to a board," he's really not. Authority's a good thing, and if it's not forced upon you as a leader, then I suggest, strongly, that you go buy some.