Such a handbook would be massive. There's tons of data on the planes, and a lot of it regarding planes with multiple layers (hell, some even have books devoted to the individual layers! Expedition to Demonweb Pits, anyone?).
Off the top of my head, the BoED, BoVD, Manual of the Planes, Planar Handbook, both Fiendish Codexes, EtDWP, I think there's a book that covers the Outlands+Sigil, the DMG, and a handful of others (including some Eberron and Faerun splat). That's a lot to sift through.