Feeling guilty for setting boundaries

Does anyone else struggle with feeling guilty for setting boundaries? I finally told my mother I can't talk on the phone every single day, and even though I know it's reasonable, I still feel like I'm doing something wrong. How do you deal with that voice in your head that was programmed by years of manipulation?