WAU Manager (Windows Automatic Updates Manager) is a fully featured replacement for the built in Windows Updating interface. This tool gives you full control of the Windows Updates, such as when and how they are installed, and has full uninstall and maintenance support for Windows updates.
Given the circumstances and the system integration nature of this app, I haven't fully tested WAU Manager's portability -- something I may still do at a later time but, given its proven usefulness, I didn't want to forego this post.
Further word of warning: many Carifred.com utility are available as naked executables, which may make downloading difficult in restricted network environments. YMMV.
WAU Manager current release is v3.3.1.0 (no date, no changelog?) and can be downloaded from the link above.