A crookes's radiometer has 4 vanes suspended inside a glass bulb as you've described (see this nice picture). Inside the bulb there is a good vacuum. When you shine a light on the vanes in the radiometer, they spin - in bright sunlight they can spin at several thousand RPMs!
The vacuum is important to the radiometer's success. If there is no vacuum (that is, if the bulb is full of air), the vanes do not spin because there is too much drag. If there is a near-perfect vacuum, the vanes do not spin unless they are held in a frictionless way. If the vanes have a frictionless support and the vacuum is complete, then photons bouncing off the silver side of the vanes push the vanes and they rotate. However, this force is exceedingly small.
If there is a good but incomplete vacuum, then a different effect called thermal transpiration occurs along the edges of the vanes, as described on this page. The effect looks as though the light is pushing against the black faces. The black side of the vane moves away from the light.
Here is the definitive link on how radiometers work:
Two other useful links: