Low signal power and susceptibility to interference cause difficulties for traditional global navigation satellite system (GNSS) receivers in tracking weak signals. Extending coherent integration time is a common approach for enhancing signal gain. However, coherent integration time cannot be indefinitely increased owing to navigation bit sign transition, receiver dynamics, and clock noises. This study proposes a cross-correlation phase combining (CPC) algorithm suitable for distributed multi-antenna receivers to improve carrier-tracking performance in weak GNSS signal conditions. This algorithm cross-correlates each antenna’s intermediate frequency (IF) signal and local carrier to detect the phase differences. Subsequently, the IF signals are weighted to achieve phase alignment and coherently combined. The carrier-to-noise ratio (CNR) and carrier phase equation of the combined signal were derived for the CPC algorithm. Global positioning system (GPS) signals received by distributed antenna array with six elements were used to validate the performance of the algorithm. The results demonstrated that the CPC algorithm could effectively achieve signal phase alignment at 32 dB-Hz, resulting in a combined-signal CNR enhancement of 6 dB. The phase-tracking error variance was reduced by 72% at 30 dB-Hz compared with that of a single-antenna signal. The algorithm exhibited low phased array calibration requirements, overcoming the limitations associated with coherent integration time and effectively enhancing tracking performance in weak-signal environments.