We will not "forget" so as to be able to rejoice; we will rejoice and therefore let those memories (of wrongs suffered) slip out of our minds!