Have you checked to see if the wheel is rubbing the inside of the wheel well? Doesn't quite sound like a CV joint, but don't rule that out either.
Are you getting any feedback through the steering wheel when it happens?
"I am the Juan, don't weigh a ton
Don't need a gun to get respect up on the streets."