First, the voltage numbers don't mean much as long as the battery is charging or is being used. The numbers should be read after about an hour or so of no charging or nothing being used. So I doubt that you have damaged the batteries.
Check your fridge, probably in the top of the freezer door trim, for a humidity control switch and make sure it is off. The switch controls heat strips in the door to keep humidity from condensing on the door seals. If you don't have the switch (some newer trailers/fridges don't) the heat strips run all the time. Folks have modified the fridge to add a switch or disconnected them. IIRC the wire for the heaters without the switch comes off the supply side of the light that comes on when the door opens.
Another fridge switch that affects power consumption is the low ambient switch. When it is on, the light in the fridge stays on all the time. If you have that switch, make sure it is off.
I keep thinking of things.....the 4655 is, IMO, a good 4-stage charger and should not overcharge the batteries.
“You cannot reason someone out of a position they have not been reasoned into"
Al, K5TAN and Missy, N4RGO WBCCI 1322
2002 Classic 30 Slideout -S/OS #004
2013 Dodge 2500 Laramie 4x4 Megacab Cummins