TRT television broadcaster said on Sunday that the overnight military operation kicked off when ground troops supported by warplanes entered Syrian territory to evacuate the troops.
The tomb was located just over the border near the Kurdish town of Kobani, which was recently liberated from ISIL grip.
Media reports also said one soldier was killed during the offensive that also moved the tomb into Turkey.
The army later released a statement saying the soldier lost his life in an "accident" en route to the tomb.
Around 40 soldiers, including 20 elite troops from the Turkish special forces, are said to have been guarding the tomb of Suleyman Shah, the grandfather of Osman I, founder of the Ottoman Empire. Reports said 700 elite Turkish troops were involved in the offensive.