Prince Harry will turn 40 on September 15, but he has no plans to utilize the occasion to change his life path.

Following a September 1 revelation in the Mail on Sunday, speculation has increased that the Duke of Sussex is looking to return to royal life. According to the source, Harry, who stepped down from royal responsibilities with Meghan Markle in 2020, has been contacting former aides and allies to discuss a partial readmission into the royal fold. However, insiders who have previously worked with Harry told people that the story astonished them.

Instead, the Duke of Sussex is content with his life in California, where he is raising his small family with Meghan and continuing his profession, with a trip to New York City planned later this month, according to people.

As one ally pointed out, Harry is anxious to visit friends in the United Kingdom and engage directly rather than via Zoom with organizations in his native country, notably WellChild.

He also wants to bring his family, Meghan, 43, and their two children, Prince Archie, 5, and Princess Lilibet, 3, back to the United Kingdom for visits. However, he believes that his loss of automatic access to official security, which occurred after he and Meghan stepped down from royal responsibilities, is a substantial impediment.

Harry is prepared to appeal a court judgment that upheld his security denial. Insiders recently told PEOPLE that Harry is working to improve his security so that he, Meghan, and their children may travel to the United Kingdom more freely. This problem is also fundamental to his ongoing alienation with his 75-year-old father, King Charles.

“Harry is terrified and believes the only person who can help is his father,” a royal insider told PEOPLE last month. Another insider close to the incident stated that “Harry is determined to protect his own family at all costs.” (Buckingham Royal would not comment on security arrangements, but a royal source has informed people that the idea that Harry’s security is in the King’s hands is “wholly incorrect.”)

Harry reportedly thoroughly enjoyed reconnecting with the community and visiting old friends and fans during his May visit to the United Kingdom for the 10th anniversary of the Invictus Games, which included a service at St. Paul’s Cathedral. Despite contradicting stories about why he declined to stay at an offered royal palace, a royal insider tells people that the trip “went well,” with Harry visibly energized by spending time with friends and relatives.

“Hopefully, he can find it increasingly easy in the future,” a family friend said.

On August 29, Prince Harry made a clandestine trip to the United Kingdom to attend the funeral ceremony for his late uncle, Lord Robert Fellowes. Fellowes, who died on July 29 at the age of 82, was married to Lady Jane Fellowes, one of Princess Diana’s two older sisters. The Spencer family and other guests warmly greeted Harry, who was delighted to be able to attend the service in a peaceful area of Norfolk.

“Most people were astounded that Harry came,” one of the estimated 300 guests told people. “He was in excellent shape, and you could see he was overjoyed to see everyone. And he was quite glad he had come over.”

Following the service, the prince remained with Diana’s brother, Charles Spencer, at the Spencer family’s historic house in Althorp. This enabled him to be at his mother’s grave as the 27th anniversary of her death approached on August 31.

Following his 40th birthday, Harry will pay tribute to his late mother, Princess Diana, during a visit to New York City. Among his commitments, he will meet with officials from the Diana Award, the only organization named after his mother.

A spokesman confirmed that he will attend activities during UN General Assembly High-Level Week and Climate Week. Climate Week begins on September 22 and goes through September 29, while High-Level Week is from September 23 to September 27. During his visit, he plans to “advance a number of his patronages and philanthropic initiatives,” according to the spokeswoman. “He will participate in engagements with African Parks, the HALO Trust, the Diana Award, and Travalyst.”

Harry will also “be furthering the work of The Archewell Foundation, the nonprofit organization he co-founded with his wife Meghan, The Duchess of Sussex,” according to the spokesman.