I suspect this is simply asking too much of human driver. The human brain is not wired to be constantly alert without any ongoing stimulus. If someone else is doing the cognitive load, it is extremely difficult not too get bored and 'drift off'.