Outliers

Outliers can pull modeled regression relationships away from their best fit, biasing regression coefficients.

If an outlier is an error, it should be corrected or removed from analysis. If an outlier reflects valid data, you may want to run your analysis with and without the outlier to see how much it is influencing your results.