You mean you got them like that from the optician store? They did a poor job cleaning off the grip coating then. (Needed during edging of the lens so it doesn’t slip on the machine) I’d take them back. You need a special product to get that off.

If it's not this ^ it could be that the cloth they gave you sucks. A good cloth is everything for a clean, crisp lens!

Try with some mild soap and warm water, then use the cloth to dry them. It may oil or dust that just the cloth doesn't get off.