At the moment I'm not suggesting there is issue on hardware side.So, I don't think any error into Hardware Side as it was working fine with Internal Flash Memory with same Hardware.
I am just suggesting check of following things to help analysis this problem:
1) did power enable input of the PHY gets a valid signal
2) did transactions on SMI interface are well-formed.