To use the voluntary electromyogram (EMG) as a control signal of the EMG controlled functional electrical stimulator (FES), it is required to reduce the stimulation artifact and non-voluntary contribution (M-wave). In this study, a Gram-Schmidt (GS) prediction error filter (PEF) that can effectively eliminates the M-wave from voluntary EMG is presented. Also, the presented GS PEF is implemented on the field the programmable gate array (FPGA) for real-time processing and the performance is tested with simulated and real signals. Experimental results showed that GS-PEF was effective in reducing M-wave and preserving voluntary EMG.