What does the speaker say about the value of the criticism leveled against his love by the end of the poem