if you go into your catalog, than categories, select the product you want to limit, you will find an option "Product Qty Maximum:"

If you set this to "1" the customer should only be allowed to buy one of this specific product...