Let's see, VoP specifically mentions clothing, simple weapon, 1 day's worth of food, and a spell component pouch. Unfortunately, the Spellbook is none of those.
Bad idea, RAW. If your DM rules that the spellbook does not violate the vow, then there are worse characters to use the Vow on. Remember the restriction on spell component values.