There is a setting on the Attributes on whether they should be used to calculate the base price ...

The default is to use the lowest value on the Attribute Groups to make the calculation ... if that is not obtaining the price you want, then you can use the setting to mask the prices that you do not want to be included in calculating the price ...