It is okay to say no. My time is no more or less valuable than anyone else’s, so if someone asks me to do something I am not obliged to say yes just because they asked. The world won’t end.
Eg. swapping shifts with someone at work. Just because I have the day free doesn’t mean I have to say yes to the shift swap, especially when I had planned to have the day resting. Silly.