I Have A Fridge With The Filtered Water Dispenser, Can I Drink Water From This If I Have Soft Water?

Right now I have hard water and drink water from my filtered water dispenser in my fridge. If I install soft water, will the water in my fridge be drinkable since it has the filter?