In inter-data center networks where high transmission capacity and spectral efficiency are required, a 16QAM format is deployed. On the other hand, in intra-data center networks, a PAM4 format is deployed to meet the demand for a simple and low-cost transceiver configuration. For a seamless and effective connection of such heterogeneous networks without using optical-electrical-optical conversion, an all-optical modulation format conversion technique is required. In this paper, we propose an all-optical PAM4 to 16QAM modulation format conversion using nonlinear optical loop mirror. The successful conversion operation from 2 × 26.6-Gbaud PAM4 signals to a 100-Gbps class 16QAM signal is verified by numerical simulation. Compared with an ideal 16QAM signal, the power penalty of the converted 16QAM signal can be kept within 0.51dB.