The Jamaican sprinter, classed as the fastest man in the world, described the son of Prince Charles as "fantastic" company.
"Harry is fantastic," he told The Sun. "I will invite him to my Olympic after party.
"I don't know if Rihanna will be in London, but I'd like to meet her."
A source added: "Harry loves to party and Usain's partial to throwing a shape or two.
"Usain is a huge fan of the monarchy and has extended his invite to Prince William and Kate Middleton to party with him.
"But there's only one provision - he wins the 100 metres, so it will be a celebration party."
Bolt previously squared off against the Prince at a racetrack in Jamaica and showed the 27-year-old how to recreate his signature victory pose.
As well as 'winning' against Bolt on that occasion, Harry also beat the Olympian to the title of the world's coolest man in 2010.
Photo gallery - London 2012 in pictures:
Copyright: Martin Rickett/PA Wire/Press Association Images