You can use rich text image plugin.
Enable Plugins using below settings
rtePlugins - add image node

uiSettings/cui/inline set image#imageProps in toolbar property

Once you can see the plugin, drag and drop the image from assets selector to RTE, the plugin will be activated and add alt text using the plugin.
Note: You can't add an image using the plugin, you have to drag the image from the asset selector.