Mary Shelley offers small clues to Victor Frankenstein's appearance throughout her novel, Frankenstein. The first description is provided in Letter IV.
He was not, as the other traveller seemed to be, a savage inhabitant of some undiscovered island, but an European.
Based upon this limited description, readers can assume that Victor is white, with defined features and brown or blonde hair. He is most certainly not physically unrefined, given Walton fails to define him as a savage.
That said, later in the letter, Walton goes further in physically defining Victor. Victor is emaciated from his search for the Creature. This means that Victor is very thin and, one can assume, his facial features are even more refined given his gauntness. Walton describes Victor's eyes as being both mad and wild. At the same time, his outward disposition speaks of kindness.
Later, throughout the novel, Victor is constantly described as being ill. When working on reanimating life, Victor puts all else on hold. His own health is ignored. Therefore, one can assume that Victor has both a look of one who is educated yet thin from obsessive work.
Like the Creature, Victor's exact physical description is masked. While the missing physical descriptions of the Creature are apparent (Shelley does not want to paint a specific picture of the Creature; instead, she wants readers to create their own mental picture of him), leaving Victor's physical appearance open to interpretation makes him far more curious to us.
One could assume that the only important thing about Victor's physical appearance is that he is thin and uncommonly ill. This sets up the image of the "pale student of unhallowed arts" Shelly pictured in her dream which was the beginning of the novel.