Time to strip it out and remove as much of the decaying foam backing as possible. You can order some new foam-backed liner material and attach it with some spray 3M adhesive. But to have it look nice, I'd probably seek a local shop that replaces car headliners and have them do the work.
This website is not affiliated with or endorsed by the Airstream, Inc. or any of its affiliates. Airstream is a registered trademark of Airstream Inc. All rights reserved. Airstream trademark used under license to Social Knowledge LLC.