Are there clients that are turned off by my work style? Probably. But if they want to be able to get ahold of me at a moment’s notice no matter the time or day, they’re not a good fit for my working style (and, in my experience, the clients that want that often have boundary issues in other ways, too).
Nail on the head here. We have always struggled to keep client relations to working hours, and are guilty of replying and communing at all hours of the day. By setting up this work structure, you are probably finding the ‘right’ clients for you (most of the time).