Kelsey also accused Camille of asking for a divorce the same day his mother died.
"Honestly, I don't really talk about her very much because so much of her life is spent talking about me and I just think it's sort of pathetic," said the "Frasier" star.
"That's terrible," Kim told Hollywood Life during BravoCon on Saturday. "Maybe there's something we don't know. I don't know. But I feel bad if that's happening because nobody wants to be -- Nobody likes that. And I don’t think that's fair."
In the interview, Kelsey also accused Camille of asking for a divorce the same day his mother died, which Camille denied on social media.
"This is not true," she wrote on Twitter. "My parents were with us in the Hamptons when we received the news about his moms passing. We consoled him and flew back to LA to make arrangements for her funeral."
"It's unfortunate that he is rewriting history," Camille added.
The latest development between the two only adds fuel to Kim's fire, who admits she never felt close to Kelsey.
"I don't really like that guy," Kim told the publication. "I never liked what he did to her. I don't know him personally. I met him and I liked him when I met him, but I think what he did to her was pretty s--tty but I don't know their story."
Kim and Camille were on the popular Bravo reality series as Housewives for the first two seasons, with Kim remaining as a Housewife for another three seasons. Camille has since returned as a Friend.
Meanwhile, Kelsey married his fourth wife, Kayte Walsh, in 2011. They share daughters Faith, seven, and Kelsey, five, and son Auden, three. And Camille tied the knot with David C. Meyer in October 2018.
Watch Kelsey's interview above.
Got a story or a tip for us? Email TooFab editors at email@example.com.