Taking all cards may sound attractive, but you may only build 1 tower of each type. The slower the number on the cards in each tower decreases, the higher it gets. So by taking too many cards at the beginning of the game, you can get in your own way quite a bit. Play smart and make sure that as many towers as possible have a tower top with the number '0'. Your towers are then worth twice as many points.