Limestone was quarried one of two ways it was either obtained from the surface rock, or else they tunneled and found the rock they needed. It is known that they possessed excellent copper tools such as saws and chisels which were capable of cutting any kind of limestone. Chisels and wedges were the tools of choice, the chisels were used for cutting the rock away from the sides, and the wedges were then used to detach the base for the block. In tunnel quarrying a shaft was cut between the roof and the rock to be detached, this was done to allow a man to get behind the rock by chipping at it vertically. On two sides two other men made splits down the two sides so that they could remove it from where it was. Wedges were then inserted into the holes that were made and driven down in to achieve a split in the rock, wet wooden wedges were also used in this procedure because they would swell up when the got wet and would crack the rock that way. This put them in a very tight spot to work.
In surface quarrying the same exact method was used except that they had more of an advantage because it gave them more room to move around, but the rock that they got from open mine quarrying was not as fine a grade of limestone as the kind that they could find buried in the earth.
Quarrying of the harder stones such as granite was a more labor intensive task, they had to use a hard greenish stone called dolerite, and pounded around the base of the stone to try to detach it from its base. In order to get to the higher quality rock they would light fires on the granite to get it to a certain temperature. Cold water would then be thrown on it to cool it fast this would cause the outer layers to crack and fall off leaving the harder rock from the inside for them to use.
But how did they move the huge rocks? They most likely used manpower to pull the rock up onto large barges that would take it close to where it needed to go then it would be pulled inch by inch onto a large sled like contraption that would be pulled. Large amounts of water were poured on the ground in front of the sled in order to ensure that there was less friction.
For more information see:
http://www.duke.edu/~jpw5/quarries/home.html