We had the same issue even though we had the same servers set in our ntp.conf file and the hosts they were running on were the same processor and had the same time. We ended up having to create a cron job to force a sync every hour as after 4-5 days they would be off by about 10 minutes.
-Eric