This is a known issue. I also have few items annoyingly stuck:
a) 2 quest items from Bard College (Finn / Pantea)
b) 2 quest item from A Night To Remember (Giant Toe / Alto Wine)
c) 1 quest (not item) from Skald's request to kill a Giant (I can redo this quest by revisiting the scene and resulted in multiple same quests stuck)
My observation is, for point (b), once you trigger the quest and acquire the first quest item(s), don't collect any of the same item, or you will stuck with multiple.
I've finished the quest for point (a) and keep interacting with the quest givers to no avail.
I haven't finished quest (b), so not sure if the item will be removed after that.
I wonder when Bethesda will patch this annoying and frustrating glitch!!