When running an app, you can minimize it by simply tapping the Home icon. Getting back to it is not just one click on the taskbar like the way you do in Windows. But the Android way is pretty straightforward too.
Note 1: You can clear the recent apps from the list by swiping them sideways one by one.
Note 2: On Android 2.x, touch and hold the Home button to reveal recent apps.