I checked mine and it only has one wire going to each terminal. The red from the starter solenoid and the black from a ground point on the transmission case.
Be sure you have the red wire attached to the + terminal on the battery. On mine that is the front terminal. The whirring sound may be the starter spinning backwards if you have the wrong polarity.