The earth is going around the sun pretty fast, and you need to counteract that speed to get to the sun.

But when you’re leaving you can use the earths orbital velocity to give you a boost.