Got the starter out (this wasn't very fun). The starter is well hidden under the back of the intake manifold, and required some slight acrobatics of the arms and a little coaxing with some 'liquid wrench' but it finally came out. Here's the starter motor on the floor:
Here's a picture of what I broke when trying to remove the existing wire end from the solenoid:
The black plastic that retains the bolt just snapped in half. I also got the radiator drained and pulled it out of the car.
I got to looking at the fuel hookups and the carburetor setup. It looks like this engine is fitted with the Pierburg 1B3 Carburetor. There is a little evaporator tank between the fuel pump and the carburetor inlet. I'm pretty sure the nozzle at the top of this thing is where the fuel return line attaches, and the nozzle on the fuel pump is where the fuel supply line attaches.
Here's what I'm talking about:
The white plastic is the top of the fuel vapor separator. The brass nozzle is the top of the fuel pump.
Well, now I'm just waiting for the new parts to arrive to get things going again.