Devotee: I have a question, Śrīla Prabhupāda. Sometimes we try to meditate on Kṛṣṇa, when we chant Hare Kṛṣṇa, sinful memory from our past life is coming. How is this to be understood that Kṛṣṇa says, "From Me the memory comes."
Prabhupāda: Yes. Memory comes to remind you that you were in this condition, in this condition. Whether you are to continue this condition or to make improvement, that is up to you. So if you take instruction from the Vedas then you'll understand that these conditions of life are not very pleasing. So we have to make progress in a different way. (question asked in French)
Prabhupāda: Explain? What is his question?
Bhagavān: (rephrasing the question) The question: how does our love for Kṛṣṇa somehow or other get transformed into lust?
Jayatīrtha: In contact with the material energy.
Prabhupāda: That is not very difficult. One has got his wife or husband, but he or she transfers the love towards somebody else, how does he look?
Jayatīrtha: Personal choice.
Prabhupāda: Yes. It is happening every moment. Natural love is between the husband and wife, but the wife goes somewhere and the husband goes somewhere else. Why? The basic principle is enjoyment. He or she thinks that "I shall be able to enjoy more in this way." So this misguided spirit puts him into trouble. Kṛṣṇa-bahirmukha hañā bhoga vāñchā kare. He does not know the aim of life, and therefore his energy is transferred to something else misleading.
The difficulty is when a person is missing the aim of life, his energy is diverted in different misleading ways.