Tom Hanks’ daughter has said that she had a tumultuous connection with her mother growing up after her parents divorced.

Hanks was previously married to Samantha Lewes, a former actress, from 1978 to 1987. The couple would have two children together: Elizabeth Ann ‘E.A.’ Hanks (born 1982) and Colin (born 1977).

E.A. has now spoken more about her childhood in her new memoir, The 10: A Memoir of Family and the Open Road, explaining that it grew progressively tough after her parents separated and she moved home with her mother.

In an excerpt from the book shared with PEOPLE, E.A. described how she had ‘few recollections of the early years in Los Angeles’ prior to her parents’ divorce.

Lewes would initially have main custody of the two children, but his role changed after they entered adolescence.

Following the breakup, Lewes would relocate the family to Sacramento, which is approximately six hours distant from Los Angeles.

“Eventually a divorce agreement was settled, and I would visit my dad and stepmother (and soon enough my younger half-brothers) on the weekends and during summers,” she told me.

“But I was a Sacramento girl from the ages of five to fourteen, a period marked by confusion, violence, deprivation, and love. I lived in a white house with columns, a pool in the rear, and a bedroom with horse images all over the walls.

However, E.A.’s connection with her mother deteriorated throughout the years as Lewes struggled with mental health concerns.

“The backyard became so full of dog s**t that you couldn’t walk around it; the house stank of smoke,” E.A. went on to describe. “Most of the time, the fridge was bare or full of expired food, and my mother was spending more and more time in her big four-poster bed, poring over the Bible.”

Another piece described how things came to a climax, with an incident of ‘physical aggression’ prompting the now 42-year-old to pack up and move back in with her father.

“One night, her emotional violence turned physical, and in the aftermath, I moved to Los Angeles, right in the middle of seventh grade,” she said, adding that her parents’ custody arrangement changed from that point forward.

Lewes passed away from lung cancer on March 12, 2002. E.A. was 19 at the time, and her brother was 24.

In the memoir, E.A. also described the moment she found out her mother was terminally sick, admitting that it happened over the phone: “My senior year of high school, she called to say she was dying.”