You can change the price by clicking on the Attribute you don't want used in calculating the Base Price and click the setting for NO:
Include in Base Price
When Priced by Attributes