Leveling up in Borderlands 2 permanently increases the amount of health you have and the amount of damage you deal. It also immediately gives you full health and shields.
Starting at level 5, Leveling Up also gives you a skill point which you can use on one of your skill trees, to make your character more powerful.
