I can't give first hand experience, but I know this book includes details for adding a lining to hats. It might help you get over the hump.