For damage, I'd pump Iajuitsu Focus and take Exotic Weapon Proficiency: Gnomish Quickrazor, or be a Whispergnome and take Improved Weapon Familiarity for the same. Now all you need to do is get them flat footed and you can do tons of damage. Grease, Hold Person, Striking before they can act, Glitterdust, and a bunch of other tricks should allow you to do this pretty easily.
Poison of course would do a lot. Just taking the Master of Poisons feat is enough... now you can use Minor Creation to summon up huge volumes of Black Lotus Poison (you'll need to make the first dose yourself as a seed, but then you should be fine). Poison your weapons and now you're doing 3d6 con damage with every strike (Fort DC 20 negates). From here, enchant those quickrazors with the Assassination mod so that they improve your sneak attack and add their bonus to poison save DCs, and then cast Greater Magic Weapon or use a Tooth of Leraje to increase the bonus on your weapon. With the tooth, the DC is 25. Not bad, and you can poison one weapon per round (and you can start combat with both poisoned).
Another option is to dip Swordsage, as the Factotum 3 ability would apply to all of those Mighty Throw type manuevers, plus Shadow Jaunt and Cloak of Deception are just so useful. So's Burning Blade on a TWF character... as long as the enemies aren't fire immune.
Feycraft Quickrazors would let you be dex based without needing Weapon Finesse.
Personally, I'd just go Factotum 10 for your situation, leaving out the Swordsage (but maybe adding in the Darkstalker feat, it's just so useful) and having a basic battle strategy where I'd close on the enemy in the surprise round (don't worry about going first, with Int to intitiative you should have no trouble doing this). Then I'd full attack on someone, hitting them with two poison shots... possibly positioned to strike a second target in case the first one drops from poison. Remember, Cunning Insight applies to the Black Lotus Poison too, so with an Int of 24 you're doing 3d6+7 con damage or an average of 17... this could easily kill enemies fast. It's only for one attack, btw, not the whole round. Anyway, don't forget you can re-poison midway through with a swift action (thanks Master of Poisons) and then get three poison hits. Now use Cunning Surge and Arcane Dilitant to fire off a Grease or Glitterdust on the remaining enemies to keep them flat footed and debuffed.
That tactic would use 5-6 inspiration points in the first round of combat (depending on how many people you landed poison on, you should really use Cunning Insight every time poison lands), but likely kill one or two enemies and leave the rest pretty helpless. Then you just run around finishing people off.
And don't forget, if you think there's a Dragon to fight, Shivering Touch + Spectral Hand + Cunning Insight + Cunning Breach + Cunning Surge = dead dragon in the surprise round with virtually no chance of survival. Fun!
JaronK