That sounds more like a full voltage regulator. A resistor simply burns off a certain amount of voltage dictated by the amperage of the circuit and resistance of the resistor.
D!ngo, from what I understand about how servos work, creep occurs because of the minute resistance difference between two equally-rated resistors. You might install two 500 ohm resistors in place of the potentiometer, but they might actually test at 490 and 510 ohms. They test well within the 5% tolerance most resistors have, but that small difference tells the servo to creep just a little bit. The best way to go around replacing the potentiometer with resistors would be to use very precise resistors, like 1% or 2%, and match two out of the bag as close as possible with meter.
To the original question, a resistor inline with the winch should work exactly like you are thinking, D!ngo. If the resistor reduced the unwanted voltage to an amount too low to move the motor, that would stop winch creep. It would likely have to be a decently high ohm, and that might affect the speed of your winch, but it should also stop the creep.
However, overall I would just follow mikemcE's recommendation and use a Heyok controller. It'll make everything nice and simple.