I'm not sure I follow what you're getting at, but if the size prices are different for each variety then it becomes a far more complex process in that you will need different size options for each variety, so instead of 3 size values, you are going to need 9 as you can't have dependent attributes.

If that's the case, you are better off having each variety as a product, applying just the size option to each