I know that starting speaking in public is not easy, and I also have a lot of friends that were well known in the field, and now they’re not talking anymore at conferences, events, etc.
This is why a lot of people don’t want to stop doing it and continue to send proposals to many conferences, also when their personal or work life suggests taking a break.
I’ve turned my career many times and took many breaks from public speaking, but then, after a while, when I had something new or relevant to say, I always come back.
Don’t worry about taking a break for personal or work reasons, because, if you like being a public speaker, you’ll find a way to come back on stage, in person or virtually.
My only suggestion is to stay relevant during your sabbatical, keep your contacts active, continue your online activities, perhaps slowly but continuously. Always remember why you’ve done it in the past, and why you want to start again when ready.