The reason for this post is hilarious. In my life time I installed and over installed Ubuntu for period of times, but every time I had to ask my buddy or Google about removing annoying old Ubuntu core versions from Grub configs and from /boot directory. Well, now I will describe those two simple steps for those who have same problem as I did.