because the person who gives Jonas the memories used to be the receiver of memory but since Jonas is the new receiver of memory, the old receiver of memory calls himself the giver because he GIVES...
In the novel "The Giver", the Giver tells Jonas that the job and the memories are his life. However, the Giver is said to take walks, and read books after his work.