If you just want to hit some of the major tourist attractions, like the Empire State Building and Times Square, then three days might be enough. But if you want to explore different neighborhoods and really get a feel for the city, you might need more time.