You question says you can get water if no filter is installed. And it started when you put in the new filter. So what is the problem? Or you can't get water? If you can't get it. Your filter might not be the correct filter? Or it is not seating correctly or all the way. Also when you replace a water filter you have to bleed the air out of the water line. You do this by using a large cup or pitcher (if it will fit) to dispense the water into until all the air is out of the line. It might take a few minutes & or a couple cups full.
Also on most fridges you can get water at the dispenser without a filter but the only way is if the manufacturer makes what is called a water filter bypass. You would have to look it up by the model number of your fridge. searspartsdirect.com is a great place to look. Just enter your model number & it will give you a complete break down of all the parts for that refrigerator. Or you could ask a retail refrigerator repair company if they can get it for you.
If you need further help, reach me via phone at https://www.6ya.com/expert/thomas_868a5ee3bf9eea64