The 'RGB map brush' window is activated by selecting the 'Tools→RGB brush' option in the menu or by viewing a RGB map layer (e.g. light map, texture or other custom 24-bit map), and then clicking on the 'edit active map layer' toolbar icon shown below:
Left-clicking and dragging the mouse around on the RGB map will apply the setting from this window.