Things not seen is the definition of believing without evidence
The objection
You can do all the word study you like; the verse says what it says. Faith is a conviction of things not seen. If the things were seen, you would not need faith — you would have knowledge. The whole category exists precisely to cover the gap where evidence runs out. That is not a caricature invented by critics; it is Hebrews' own framing, and the chapter goes on to praise people for acting on promises they never saw fulfilled.
The response
The verse does say it, and the objection is right that faith is doing work where sight is unavailable. Where it goes wrong is treating not seen and not evidenced as the same category. Almost everything anyone knows about the past is not seen: no living person saw Caesar cross the Rubicon, and historians are not exercising blind faith when they affirm it. The chapter that follows makes the point better than any argument could — every figure it lists is commended for acting on the basis of something that had already happened to them. Abraham had been spoken to. Israel had come out of Egypt. Rahab had heard the reports and drawn a conclusion. Not one of them is praised for believing something arbitrary. They are praised for acting consistently with a track record when the outcome was still ahead of them.