...except that because you know the way gravity works (-9.8m/s*s) and, if you set a constant dt, you can compensate accordingly.
For example, a projectile traverses a parabolic arc. If your character were to jump along this arc, naturally, trying to numerically approximate this will give an error. If you use the integrated function (the parabola) instead, you'll get a correct result.