No

form.setScript

is for attaching a Client Script to a Form. Your button click handler could just use

nlapiRequestURL

to dispatch a request to a Suitelet