The game is Toejam & Earl. Falling off the end of a level sends you to the previous level, unless you fall through a hole in that map, then you fall to the next level, and so on.

There’s also a secret place where you can fall off in level one to go to the secret zero level.