Billy Ray Cyrus Finds Firerose Divorce 'Annoying' but Is 'Happy' Marriage Is Over: Source (Exclusive)

Billy Ray Cyrus wants "to put all the drama in the past" when it comes to his marriage to Firerose.

A source tells PEOPLE that the country star is "trying to put all the drama in the past" and has a "good support system."

"He's happy in Nashville and doing well," the insider says. "He's with close friends and he has great contact with [his daughter] Noah."

While the source says that the back and forth of the divorce is "annoying" for Cyrus, "he's happy to be out of the marriage."

Ultimately, the insider says that the country star, 62, feels like the relationship "was all a scam."

"He feels lucky that he figured it all out," they add.

A rep for Cyrus declined to comment when reached by PEOPLE, and a rep for Firerose did not immediately respond to a request for comment.

Cyrus filed for divorce on May 23 after nearly seven months of marriage, citing irreconcilable differences and inappropriate marital conduct as reason for the split.

He also filed paperwork asking for an annulment due to fraud.

In her response, Firerose, 36, denied being guilty of inappropriate marital conduct, and accused her ex of acting inappropriately, noting she felt “unsafe” living with him.

On June 13, the "Achy Breaky Heart" singer filed an emergency motion requesting a temporary restraining order to stop his ex from using his personal and business credit cards and accounts, claiming she spent roughly $100,000 of his income on “unauthorized” purchases following their split.

Firerose responded saying there was “no emergency” and that for two years she's had access to his credit cards.

“To claim Wife has made 37 unauthorized charges is untrue,” her attorneys wrote in the filing, which which PEOPLE obtained, adding that her "Husband has no right to cut her off.”

In court documents filed on June 24, Cyrus claimed that he was "physically," verbally and emotionally abused by his ex and denied allegations that he was abusive toward her.

Scott Adkins, Cyrus' manager, claimed he witnessed the abuse toward Cyrus in an affidavit.

A rep for Firerose said that the only people supporting Cyrus' "false claims" are "on his payroll" and have "questionable" credibility.

Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer​​, from celebrity news to compelling human interest stories. 

In documents filed on July 14, the Aussie singer/songwriter alleged that Cyrus filed for divorce in May just one day before she was supposed to undergo a preventative double mastectomy.

Firerose said she was then “ambushed” with divorce papers on May 23, less than 24 hours before she was set to undergo her surgery.

If you are experiencing domestic violence, call the National Domestic Violence Hotline at 1-800-799-7233, or go to thehotline.org. All calls are toll-free and confidential. The hotline is available 24/7 in more than 170 languages.