Get a new filter. Before installing it, bypass the old one and give the whole system a thorough flush with baking-soda water. Then install the new one and taste away.
Be sure also to use a white water hose, meant for potable water (i.e., the standard RV kind available at WallyWorld and the like). Green hoses, with some age, will start imparting an extremely ugly taste to the water.