Answer:
In Samuel Taylor Coleridge's poem The Rime of the Ancient Mariner (1798) the titular mariner shoots the albatross, which is regarded as an act that will curse the ship, so sailor's companions induce him to wear the dead albatross around his neck. Since then saying "An albatross around one's neck" means a burden which some unfortunate person has to carry.
Meaning: a very difficult burden that you can't get rid of or a reminder of something you did that was wrong
See link.