Setting Startup Applications in Gnome

To edit applications you want to start with Gnome, run

gnome-session-properties

There is also an option to remember the apps that were running on last log off / shutdown.