d=(1/2)at^2, a~32ft/s^2, t=6s, (1/2)at^2~576 feet, discounting air resistance, by the way (for the first round).
And terminal velocity for a skydiver is about 180 ft/s or almost 1100 ft/round. So for terminal velocity to be 50ft/s, gravity would have to be about 0.28gEarth (since terminal velocity is proportional to g).
So dropping down 10' would take you 1.5 seconds in D&D-world as opposed to the 0.8s it takes now. (At this speed, air resistance is negligible.)
Yeah, physics and fantasy -- the designers went with simple rather than correct.