More control over my library

I would like to have more control over my library; such as : Being able to just click on a song in my Library and delete it, have an option to permanently categorize my Library. Essentially have more task options available within my History Library.