I have never taken too kindly to "fashion advice." Either I'm wearing something ugly, and I don't care what anyone thinks of it because it's probably cozy, or I'm wearing something that I think looks good, and still don't care if anyone objects, because it's not their style, it's mine. If someone disagrees with me about what looks good, then by all means, vote with your wardrobe.
On almost every occasion which I have been given advice on what to wear, I rejected it forthrightly. People do not believe that X matches with Y if they do not have the acumen to see the way they go together. This happened to me recently at the convenience store. One of the clerks told me I needed a different tie with my shirt. The patterns were not exact replicas of one another, but they were close enough that the tie seemed rather subtle, yet provided enough contrast with the shirt to make it visible. I thought it was a rather clever getup. It's all a matter of taste.
In some situations, it is appropriate to expect a certain outfit; for example, formal wear at a ball. Even then, there are tiny ways to rebel. You can tuck a Tom and Jerry handkerchief into your pocket, or wear one of those off-beat trinity knots. It might make you look like a neckbeard to some people, but since when has it been worthwhile to take such asperity to heart? Never.