If setting the vertical offset to be a positive value, then you can extrude your form upwards (positive z), while a negative offset, moves the extrude downwards (negative z).

The origo of the extrude is dependent upon whether you have chosen Feature to Follow or not.