The books of the "unknown traveller" are a kind of saga, a collection of stories,
some might say that you meet a "Wanderer" (whether this is the same one is unclear).
The island of skarrags cannot be found ingame, it would then be in unknown Oceans.
But there are some distributed hints about this people, whether in books or dialogues.