The 'byte map brush' window is activated by selecting the 'Tools→8-bit brush' option in the menu or by viewing a byte map, and then clicking on the 'edit active map layer' toolbar icon shown below:
Left-clicking and dragging the mouse around on the byte map will apply the setting from this window.