Quince rust is a fungus disease caused by Gymnosporangium clavipes. The fungus infects fruit, but not leaves, of most apple cultivars. It infects both leaves and fruit of hawthorn. More information, complete with images and a table of cultivar resistance/susceptibility, can be found in this article, Quince Rust of Apple.
Answer provided by Alan R. Biggs, West Virginia University.