Buy some fly strips.
Also, put some water in a ziploc bag, fill about 1/2 full. Tie a knot in the bag, and hang them where those things are bad. It works for flies, I bet it'll work for whatever it is you have. This doesn't kill them, it scares them away.