I would say that we should visualize the data first, getting a sense of it. How many attributes it contains? What are the ranges of the attributes? What is the data type for each attribute (ordinal, categorical, ratio, interval)? How might they be related? What are the predictors and how about the response(s)? These are typically the first thing I'd like to know when investigating a data set that I have no previous knowledge of.