I did have some plastic light cable lying around, so I went ahead and modified my ovms modules.
Now one can clearly see the blinking LED of the cellular modem.
I drew a line on each side when holding the top case above the led (bottom and left when ovms is readable), drilled a hole, a bit of heat glue and done in less than 2 minutes:
Something went wrong with the image upload.