I don't know, I'm just afraid of sponsorblock accidentally skipping a part of the video I'm interested in

It doesn't have to auto-skip, it can e.g. just mark the different types of segments for you to make the call to skip or not. You can also still manually seek to any part of a video (even with auto-skipping enabled).

Thus far it has always been right for me, but you can tweak the settings to offer you a manual skip if you prefer to lean into it more slowly.