If you dislike that achy, bloated feeling that other HTML editors can give your computer, KompoZer and its portable edition might be the freeware cure you're looking for. An open-source Web-development tool built on the NVU architecture, KompoZer aims to improve upon the NVU's bugginess.
It does a fairly admirable job of that, while not being bloatware. Major editing buttons live on the top three-tier toolbar, including a one-click Publishing icon as well as one-clicks for Image insertion and Table and Form creation. Font tweaks like Size and Style live in toolbars just below that, making for easy HTML editing. A Site Manager, including File tree, is anchored on the left, although it can be collapsed, and the WYSIWYG standard means that KompoZer can compete more than adequately with other, better-known editors. "Professional" users might find the lack of polish unappealing, but it tested bug-free for me. Your mileage may vary.