# Regression Analysis

Statistical analysis demands arise almost in any case where a given dataset is investigated, in scientific research as well as industrial projects. A number of procedures, techniques, mathematical models and computer codes have been proposed, However, they can be grouped in four simple steps: data preprocessing, variables distributions, pairwise correlations, and multivariate modeling. The data preprocessing -or cleaning- although a critical problem of any further step, is often skipped, influencing all the consequent calculations and conclusions. The variables distributions, aim to identify how the data are dispersed among intervals, their type (categorical, binary, continuous), the minimum and maximum values, as well as the existence and handling of outliers. Pairwise correlations and measures of effect size is also a vastly important step, as it can reveal strong patterns of association among the involved variables.

Regression analysis is a statistical modeling technique used to investigate the correlations between a dependent variable and one or more independent variables. It illuminates the effect of a change in each of the independent variables xi to the dependent variable Y, while the other independent variables remain constant. In linear regression, the requirement of the model produced is that the dependent variable is a linear combination of the independent variables. This is not always computationally efficient, thus more complex models like nonlinear regression,  artificial neural networks, and machine learning algorithms can be investigated, depending on the assumptions of the applied mathematical model. However in these cases, the problem of overfitting arises, thus special care should be given to the validation of the model (test set) as well as the investigation of the regression residuals.

Topics

Descriptive statistics: min, max, median, percentiles, variance. Distributions, fitting and outliers. Correlation coefficients, covariance, chi2 test. Analysis of variance & Effect size. Time-series, smoothing, moving statistics, predictions.

Regression Analysis: Data preparation, Normalization, Outliers. Coefficients, p-value, residuals, heteroscedasticity, bias. Importance vs Significance. Test sets, Ensemble models & Stepwise regression. Logistic & Nonlinear Regression. Conceptual Interpretation

Who Should Attend

• professionals who work on data analytics, predictions, and relevant topics
• researchers which want to analyze scientific databases
• anyone interested to understand the underlying theory of regression analysis

Course Benefits

• understand the fundamental assumptions of regression analysis
• hands-on experience, with industrial and academic test cases

Course Instructors: Dr. Nikolaos Bakas

Personalize this course