Kelly Osbourne Says Simon Cowell ’Threw a Fit’ and Had Her Family Pulled from American Idol Minutes Before Appearance

Kelly Osbourne credits Simon Cowell with being responsible for one of the most off-putting experiences she's had in the television industry.

During the May 21 episode of The Osbournes Podcast, the rock n' roll family discussed their experiences with television and its "cutthroat" nature when the Fashion Police alum, 39, shared an unpleasant memory involving the America's Got Talent judge, 64.

"Do you remember when we were meant to go on American Idol and Simon Cowell threw a s--- fit and we all were there waiting to be on camera and they pulled us off the set?" Kelly asked her family members, Sharon, Jack and Ozzy Osbourne. "Simon was like, 'I don't want them on the show' and had us taken off during the commercial break."

When Jack, 38, asked his mother if her former X Factor judge had ever mentioned anything about their pulled appearance, Sharon said "no" and noted that he "probably doesn't even remember."

"Probably not," Kelly agreed. "But that was really awkward."

Representatives for Cowell and American Idol did not return PEOPLE's request for comment at the time of publication.

Elsewhere in the podcast, Kelly recalled another time when she felt burned by an executive in the entertainment industry. The television personality claimed that she was once told she needed to lose weight in order to make it in the business.

“When I was a kid, I got pulled into the head of the agency's office and he was putting golf balls into a cup and gave me a whole speech about how I was too fat for TV and I needed to lose weight, and that if I lost weight, I would look better,” she recalled.

Kelly decided to not publicly name the executive, but said the incident happened after she was cast in Disney's 2003 adaptation of Freaky Friday starring Lindsay Lohan and Jamie Lee Curtis.

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from celebrity news to compelling human interest stories.

“I just booked a movie with Lindsay Lohan, Freaky Friday. I was gonna play her best friend, and then it was right before mom got diagnosed with cancer, so I quit,” she explained. “And he was just saying, ‘You're not a movie star, but you could be one if you lost weight.’"

Jack quickly chimed in and said that’s “the most L.A. s--- ever" to which Kelly agreed. "I know," she said. "As he's putting golf balls into a cup in his office. And I was just, like, this is the most insulting f---ing [thing]."