But it all seemed to be in good fun.
The rapper and business mogul stopped by Stephen Colbert's "Late Show" Wednesday, where he told a highly entertaining story that involved weed and an inept valet.
Fifty explained he drove the decked-out Lambo to a recent performance at the Barclays Center in Brooklyn. Fellow rapper and "P.I.M.P." collaborator Snoop Dogg was there, too.
"He said, 'Yo, if you need me to come on, I'll come on,'" Fifty recalled, noting that the two performed a remix to their 2003 hit.
"When we went on, it was fun, I had a good time, it was a surprise that he came out," the mogul told the comedian. "But I had more to do, so he left and I continued to perform. When I came off, I was wet, so I was wiped off, got dressed. And I came out, and the car was gone."
Fifty went on, "He went, walked by the car, saw the car and was like, 'Yo, this is--' I don't know if it was jealous feelings or something, but he actually went to the car and got in the car because the keys are in there because we parked inside the Barclays. And the guy that's supposed to be like the valet parking guy, I was like, 'Where did the car go?' He says, 'Snoop took the car.' I said, 'What?!' I'm like, 'How you just let him take my car?!' He's like, 'Yo, he just came, he walked around--'"
"'Cause Snoop, he [smokes] a lot," he added. "I think he thought that that was his car for a minute!"
"But then later, he had made a tape saying that I owe him for the performance," the rapper said. "Because he feel like, 'You got me performing for free, and you got cars like this out here.' He thought I tricked him into a performance, but he offered to perform."
Colbert's takeaway from the highly entertaining story was that "Mr. Jackson here keeps the keys to his car underneath the mat of the seat."
But before Colbert and his audience had the pleasure of hearing that tale, the comedian had some questions for the mogul about his "luxurious lifestyle."
"You have the beautiful suits. I particularly like this one. It's sort of understated for you," Colbert said, leaning over to get a closer look at Fifty's perfectly fitted navy sport coat.
"'Cause it's like paisley, and then it stops," Fifty replied with a proud smile.
"And then you got the watch right there," the late-night host noted.
"Yeah, this is for the rappers. Everybody's watchin'," Fifty said, showing his massive, diamond-encrusted timepiece to the audience.
While on the topic of expensive jewelry, Colbert pulled up a selfie the rapper recently posted of him mean mugging in a bubble bath, holding a cigar and and wearing a blinged-out watch.
"It's a different version of this watch," Fifty explained. "See, that one don't got the circles. You gotta have the one with the circles."
"I have a question about this," Colbert interjected. "Have I been taking bubble baths wrong? Because I thought they were to relax. You do not seem relaxed in this photo at all. You seem a little angry."
But Fifty had a very reasonable explanation.
"That was like photograph No. 10.," he said, noting that the self-timer life can often be frustrating.
"So a man of your level of success doesn't have his own bathroom photographer?" Colbert wondered.
"If you have a bathroom photographer, you're probably out of touch," Fifty replied. Colbert so kindly said he could "borrow" his.
Pulling up another photo from Instagram -- one showing Fifty leaning up against the custom Lamborghini Snoop allegedly stole -- Colbert wondered if the rapper's T-shirt and sneakers that perfectly matched the vehicle's over-the-top gold and blue wrap had "come with the car."
Explaining that the custom wrap was by Versace, Fifty -- who spends an extraordinary amount of time trolling fellow entertainers on Instagram -- admitted, "I be having to find things to do, to be honest with you."
"This is just busy work for you?" Colbert asked, as both men laughed at the absurdity.
But Fifty explained that you "gotta create a separation" between yourself and the people who also drive Lamborghinis. "Ima wear this car when I wear these shoes," he said was his mentality.
"Do you have other outfits that match other cars?" Colbert wondered.
"Yes, I do!" Fifty replied, cheesing hard and nodding proudly. Staring intently at the photo, Colbert mumbled, "I'm in the wrong business, evidently."
Got a story or a tip for us? Email TooFab editors at firstname.lastname@example.org.