It should be fine but using warm, soapy water with a sponge would be better.
I would recommend vinegar and baking soda over soap. Especially in a Formicarium setting, there are many crevices that soap can still reside in, which becomes toxic to ants.
Go to the ant, you sluggard; consider its ways and be wise! It has no commander, no overseer or ruler, yet it stores its provisions in summer and gathers its food at harvest. -Proverbs 6: 6-8
My Nationwide Ant Shop Here I have PPQ-526 permits to ship Lasius nationwide!
Attention Ant-Keepers in South Dakota! Join the SoDak(Society Of Dakotan Ant Keepers)
My Lasius sp. Journal
My Micro Ants Journal