Nicole Richie and husband Joel Madden are very much still together.

The 33-year-old designer's dad, Lionel Richie, confirmed as much to Hello! amid rumors Richie and Madden are headed for divorce. The couple recently listed their family home following reports the designer met with an attorney.

"It's completely untrue," Lionel Richie told the magazine. "They've bought a new house and the moving van was pulling up at their old house to move to the new one, hence the story they are breaking up."

"I went over the new place recently," he shared. "'Aren't you going to clear [the rumors] up?' I asked Nicole. 'Nah, it's okay,' she said ... I said to Nicole, 'Rumors you don't worry about. It's when they print something and it's true you need to worry.'"

Richie and Madden have been together since 2006, and welcomed daughter Harlow in Jan. 2008. Son Sparrow followed in Sept. 2009, and the couple married at Lionel Richie's estate in Dec. 2010. The pair were spotted hand-in-hand at a U2 concert last week.

Richie is daughter to Lionel Richie and first wife Brenda Harvey, and stepsister to the singer's children by second wife Diane Alexander, Miles and Sofia. She will return for season two of VH1 series Candidly Nicole on July 29 at 11 p.m. ET.