Dr. Jan Adams – the controversial cosmetic surgeon who operated on Kanye West's mother the day before her death – abruptly cut short his interview on Larry King Live Tuesday night.

"I had come here to talk about things in the press that aren't accurate about me," Adams told King during the CNN show. "But I have a tremendous amount of love and respect for the West family. They asked me not to go on."

Later in the show, it was revealed that Adams had received a letter from the West family's lawyers earlier Tuesday asking him not to appear on the show – and threatening to ask the Medical Board of California to decertify him if he spoke about the case.

"When they are comfortable, then I will be comfortable [speaking out]," Adams told King of the possibility he will ever answer questions regarding the case. "If they are never comfortable, then I will never be comfortable."

The doctor then removed his ear piece and walked off stage while King cut to commercial.