The Fine Grain Scalability (FGS) technique used in SVC codec encodes and decodes the quantization error of QBL (quality base layer) along the cyclic scanning path. The FGS technique provides the scalability property to the compressed bit stream. However, the cyclic scanning procedure of FGS method may require a huge computing time. In this paper, we propose a fast FGS decoding scheme, which has a lower decoding complexity without sacrificing image quality.