WordPress does not have an interface for adding featured images to category archives. We can set these images via CSS though.
Simply replace the wordpress string with the slug of the category archive and update the URL to the image on your server. Repeat this process for each category.