No, there are not any particular times. The site has been running very smoothly for me every time I've checked it lately.
In short the hosting service was targeted by DDOS attacks recently (
https://en.wikipedia.org/wiki/Denial-of-service_attack). I know a number of my friends who also use the same hosting service also had site performance issues due to this. The hosting company has taken measures to lock down their network and neutralize the attacks, so performance is starting to come back. They're a large company that has very good hardware setups and bw/storage allotments, I've been with them for over a decade and have been mostly happy. While I use a shared hosting setup (dedicated hosting is cost prohibitive with our "Free" way of things here at RTMM), it's not your typical bargain shared hosting. It's a solid host, typically.
That said, I'm never satisfied with slow performance.. I managed a production engineering team for years at my current job before I moved into more of the developer/designer role. I'd deal with site slowness/downtime daily for major websites that you've likely heard of and visit. It's a very frustrating role, because a lot of the time the resolution is out of your hands. I have some ideas on how to improve things around here though, and I'm working towards that.
While I can't make any promises, rest assured that I'm working on a solutions.