You strayed from the way and did not return because you were ashamed. It would be more logical if you were ashamed not to return.
or simply: