They live in the dirt!!! ;)
Yes, they live in the dirt, but DE is ground much finer than the size of most dirt. Food-grade DE is a known eye and lung irritant. http://npic.orst.edu/factsheets/degen.html
It is perfectly safe, except you should try to keep it out of the eyes and lungs. I am...