Start with the force due to the entire solid Earth. Then subtract off the force due to the removed smaller sphere, using a different origin for its center.