Time has passed and things have changed, and for Ove, that change hasn't been for the better. These flashbacks show that Ove had exceptionally happy times in the past, and the changes that are taking place in the present and the very recent past are in direct opposition to those memories, making him feel all the worse.