{"id":1529,"date":"2018-12-31T12:41:05","date_gmt":"2018-12-31T12:41:05","guid":{"rendered":"https:\/\/marriott-stats.com\/nigels-blog\/?p=1529"},"modified":"2023-02-06T00:50:40","modified_gmt":"2023-02-06T00:50:40","slug":"stats-training-materials-multivariate-analysis","status":"publish","type":"post","link":"https:\/\/marriott-stats.com\/nigels-blog\/stats-training-materials-multivariate-analysis\/","title":{"rendered":"Stats Training Materials – Multivariate Analysis"},"content":{"rendered":"

If I were to remark to you that “the weather is very nice today” or “I didn’t like that person”, it is unlikely that I would have made such statements based on a single variable.\u00a0 It is more likely that a combination of variables were evaluated to arrive at these statements.\u00a0 When we analysis datasets with multiple variables, we are undertaking Multivariate Statistical Analysis<\/strong>.<\/p>\n

Multivariate Analysis comes in two flavours :-<\/p>\n

    \n
  1. Analysis of Correlations between Multiple Variables<\/strong> – Known as R-Analysis – Informally known as reducing the dimensionality<\/strong> of your dataset.<\/li>\n
  2. Analysis of Distance between Many Objects<\/strong> – Known as Q-Analysis – Informally known as mapping, clustering or segmentation<\/strong> of your dataset.<\/li>\n<\/ol>\n

    <\/p>\n

    At bottom, all multivariate analysis is exploratory analysis of high-dimensional data.\u00a0 There is very little in the way of formal modelling or hypothesis testing.\u00a0 What we are trying to do is find a suitable way to visualise and make sense our data that exists in multi-dimensional space.\u00a0 Often, we seek to reduce (or project) our n-dimensional data into a 2-dimensional chart or table that can be displayed on a screen and a variety of methods exist to help us do this.\u00a0 This is why I like to say that multivariate analysis is more art rather than science but if you have strong statistical thinking skills, you will be able to be more scientific in your interpretation of the data.<\/p>\n

    I have written the following blog posts using multivariate analysis methods and I hope you find these useful resources for learning more.<\/p>\n

    \n

    A. Principal Components Analysis (PCA)<\/strong><\/span><\/h4>\n

    PCA is a mainstay of R-Analysis, the task of reducing your n-dimensional dataset to fewer (ideally 2 dimensions).\u00a0 As I said before, our weather is an inherently multivariate dataset and over the course of these 4 blogs, I use UK seasonal weather data from the Met Office to explain how PCA works.\u00a0 Please note, the sections on PCA are preceded by some seasonal trend analysis so please skip past these to get to the PCA part which starts in the section headed “How many dimensions …<\/em>“.<\/p>\n

      \n
    1. What is a component?<\/a><\/li>\n
    2. What are the advantages of principal components?<\/a><\/li>\n
    3. Can PCA predict our summer weather?<\/a><\/li>\n
    4. Sometimes PCA tells us nothing<\/a><\/li>\n<\/ol>\n

      Note all of these posts also the explain the concept of Standardisation (aka Z-Scores).\u00a0 This is an important concept to know about in multivariate analysis so it worth reading the start of these posts to find out more.<\/p>\n

      Finally, there is a related method to PCA known as Factor Analysis.\u00a0 I am not a big fan of Factor Analysis but it has a lot of similarities to PCA.\u00a0 Please note that software packages will sometimes use Factor Analysis as a generic heading that includes PCA.<\/p>\n

       <\/p>\n

      \n

      B. Multiple Correspondence Analysis (MCA)<\/strong><\/span><\/h4>\n

      PCA can only be used if your variables are all numerical.\u00a0 When we have categorical variables and we want to reduce the dimensionality of a categorical dataset, we need to use MCA instead.\u00a0 This method is not widely available in software packages but it produces similar outputs to PCA.<\/p>\n

      As yet I have not written any posts using MCA.<\/p>\n

       <\/p>\n

      \n

      C. Multi-Dimensional Scaling (MDS)<\/strong><\/span><\/h4>\n

      The most basic method of mapping data so as to assess how far apart objects are from each other is MDS.\u00a0 The idea is relatively simple to explain and the following posts made use of MDS.<\/p>\n

        \n
      1. Who has more in common?\u00a0 Leave & Trump voters or Remain & Clinton voters?<\/a><\/li>\n<\/ol>\n

         <\/p>\n

        \n

        D. Cluster Analysis (K-Means and AHC)<\/strong><\/span><\/h4>\n

        Cluster analysis is the mainstay of segmentation, the task of splitting a sample of objects into distinct groups.\u00a0 The two main methods are Agglomerative Hierarchal Clustering (AHC)<\/a> and K-Means Clustering<\/a>.\u00a0 Both methods can only be used with numerical datasets.<\/p>\n

        I have published the following on Cluster Analysis<\/p>\n

          \n
        1. A presentation given to EXISTA<\/a> about how to segment customer databases.<\/a><\/li>\n<\/ol>\n

           <\/p>\n

          \n

          E. Manual Clustering<\/strong><\/span><\/h4>\n

          It might seem that when you have complex data, you need complex statistical methods to make sense of its multivariate nature.\u00a0 Sometimes though, clusters can be found with a bit of statistical thinking and common sense.\u00a0 It can be a good idea to start a cluster analysis using manual methods before proceeding to the more complex methods.\u00a0 This is especially the case when your data consists of a lot of binary variables.<\/p>\n

          I have written the following posts which use manual clustering.<\/p>\n

            \n
          1. Find your way out of the Brexit Maze in 9 days!<\/a><\/li>\n
          2. How to predict by-elections in the Brexit era<\/a>\u00a0– repeated in this YouTube clip<\/a><\/li>\n<\/ol>\n

            The first post was referred to in the Robert Peston show<\/a> on ITV on 20th March 2019 (clip starts 34:40 in<\/a>).\u00a0 Apparently it made me “geek of the week!”<\/p>\n

            \n

            F. Classification Modellin<\/span>g<\/strong><\/span><\/h4>\n

            Classification often makes use of clustering methods but the goal of classification is usually prediction i.e. given what we know about a certain object, can we predict which category they will end up in?\u00a0 A method not mentioned so far that plays a large part in classification modelling is Discriminant Analysis<\/a> which includes an important method of multivariate analysis known as Canonical Variate Analysis (CVA).<\/p>\n

            As yet, I have not written any posts on Classification Models.<\/p>\n

             <\/p>\n

            \n

            If you would like to book a training course in Multivariate Analysis, then please contact me<\/a>.<\/p>\n

            I can recommend the following book “Multivariate Statistical Analysis – A Conceptual Introduction”<\/a> by Sam Kachigan.\u00a0 This does a very job of keeping the maths to a minimum and focusing on the key concepts instead.<\/p>\n

            For more information about my other training courses in statistics, please visit my Statistical Training homepage<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

            If I were to remark to you that “the weather is very nice today” or “I didn’t like that person”, it is unlikely that I would have made such statements based on a single variable.\u00a0 It is more likely that a combination of variables were evaluated to arrive at these statements.\u00a0 When we analysis datasets […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[7],"tags":[48,72,31,51,93,94,52],"class_list":{"0":"post-1529","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-stats-training","7":"tag-multivariate-data","8":"tag-principal-components-analysis","9":"tag-segmentation","10":"tag-standardisation","11":"tag-statistical-training","12":"tag-teaching-materials","13":"tag-z-scores","14":"entry","15":"override"},"_links":{"self":[{"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/posts\/1529","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/comments?post=1529"}],"version-history":[{"count":8,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/posts\/1529\/revisions"}],"predecessor-version":[{"id":4890,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/posts\/1529\/revisions\/4890"}],"wp:attachment":[{"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/media?parent=1529"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/categories?post=1529"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/tags?post=1529"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}