I usually don't prefer watching comedy show in general and I don't find lot of comedy shows that people like funny at all like KonoSuba or even live action comedy shows. I highly rate serious show over any comedy show, so take it what I say how you will.
Cautious hero is funny because of just one character, that's Ristarte, who is a goddess of healing assigned as a support for the Hero, who is summoned to protect S-Class world from the demon lord. Ristarte's inner monalogue's and interactions with other characters are especially funny to watch considering I laughed out loud couple of times, when I usually don't. It is a comedy isekai to start with but suddenly it becomes serious at the last few episodes, which is good, but I don't like the mix up. Stay on whatever you are committed to - either comedy or serious.
As I said, I don't provide comedy shows higher rating, that is 8 or higher. Since, the show made me laugh, couple of times, I can wholeheartedly say that it deserves a 7.