Is it bad to use icy hot cream or external analgesic balm while you're pregnant?

Topical treatments are normal fine. Check the product label to be sure, as long as it does not specify not for use while pregnant or nursing you should be fine.