Most existing works on resource allocation in cooperative OFDMA systems have focused on homogeneous users with same service and demand. In this paper, we focus on resource allocation in a service differentiated cooperative OFDMA system where each user has a different QoS requirement. We investigate joint power allocation, relay selection and subcarrier assignment to maximize overall system rates with consideration of QoS guarantees and service support. By introducing QoS price, this combinatorial problem with exponential complexity is converted into a convex one, and a two-level dual-primal decomposition based QoS-aware resource allocation (QARA) algorithm is proposed to tackle the problem. Simulation results reveal that our proposed algorithm significantly outperforms previous works in terms of both services support and QoS satisfaction.