Yeah you can do that.
They also make wire wheels for angle grinders too if you need to work on bigger stuff.
Assume the grinding wheel is suspect if you're picking that up from a garage sale, you dont want to have stone in you from it exploding at high rpm.