The Duke of Sussex believed he had only a limited amount of time to make a difference until George became older and would often compare himself with his uncle Prince Andrew, a source has claimed