Yeah, it's not just the fecal matter you have to worry about. When the let is stirred up there is a powder/dust that can be harmful for you. (and lucky!! I wish I had a kitten.... MySO doesn't like cats...)
I would definitely move it. I have mine in the bathroom.
I would move it to the nearest bathroom or room nearby. You shouldnt take the risk since the kitten kicks up the sand if it uses the box.