Ye olde is a fake ancient English prefix and is pronounced The old.
The reason for this confusion is the Old English letter thorn which was abbreviated by y because it looked very similar.
It was always pronounced The.
Even in ye goodde olde time.