Sounds similar to They Never Came Home.
https://www.amazon.com/They-Never-Came-Laurel-Leaf-Books/dp/0440207800