{"id":671,"date":"2017-06-25T15:06:12","date_gmt":"2017-06-25T14:06:12","guid":{"rendered":"https:\/\/marriott-stats.com\/nigels-blog\/?p=671"},"modified":"2019-02-09T10:32:00","modified_gmt":"2019-02-09T10:32:00","slug":"uk-weather-trends-1-spring-2017","status":"publish","type":"post","link":"https:\/\/marriott-stats.com\/nigels-blog\/uk-weather-trends-1-spring-2017\/","title":{"rendered":"UK Weather Trends #1 &#8211; Spring 2017"},"content":{"rendered":"<p>Meteorologists define spring in the UK to be the period from March to May so spring is now over and we are officially in summer.\u00a0 I have decided to create a series of posts which I will publish at the end of each season showing how that season compares to the weather record.\u00a0 The 2017 spring turned out to be the 2nd warmest on record.<\/p>\n<p><!--more--><\/p>\n<p>Analysis of trends is a key skill that all statisticians and analysts need to have.\u00a0 Indeed I run a training course on <a href=\"https:\/\/marriott-stats.com\/identifying-trends-in-data-making-forecasts\/\">Identifying Trends &amp; Making Forecasts <\/a>as I have learned over my 25 years as a professional statistician that skills in this area are nowhere near where they should be.\u00a0 By publishing this series of posts about trends in weather and other fields, I hope you will learn something you will be able to apply elsewhere.<\/p>\n<p>As my <a href=\"https:\/\/marriott-stats.com\/nigels-blog\/uk-weather-tracker-latest\/\">weather tracker series <\/a>shows, weather cannot be thought of as a univariate data set.\u00a0 We define weather as a combination of temperature, sunshine and rainfall which makes weather a multivariate data set.\u00a0 There are many ways of displaying multivariate data but one of the first questions that has to be asked is how do we compare 3 variables that use 3 different numerical scales i.e. degrees Celsius, hours and millimetres?\u00a0 The answer is to convert the scales of all 3 variables into a new common scale using a procedure known as STANDARDISATION.<\/p>\n<p>Standardisation works as follows.\u00a0 For each year within each variable, we first subtract the average for that variable to get the difference from the average.\u00a0 Then we divide by the standard deviation of that variable.\u00a0 For example, if the average spring temperature over the last 50 years is 7.6 degrees Celsius and the standard deviation is 0.8 degrees Celsius, then the STANDARDISED spring temperature for 2017 will be +1.9 since the actual average 24 hour UK spring temperature was 9.1 degrees Celsius i.e. (9.1 &#8211; 7.6)\/0.8 = +1.9.<\/p>\n<p>Notice that by dividing by the standard deviation, we convert the scale of any variable to a scale which measures the variable as Number of Standard Deviations Above\/Below the Mean value.\u00a0 So spring 2017 was almost 2 standard deviations above the average.\u00a0 If you are familiar with the properties of the <a href=\"https:\/\/en.wikipedia.org\/wiki\/Normal_distribution\">Normal Distribution<\/a>, you will know that if your variable follows a normal distribution, then 95% of the data points will lie within +\/- 2 standard deviations of the mean and 5% of the data points will lie without +\/- 2 standard deviations of the mean.\u00a0 So our +1.9 for the STANDARDISED spring temperature for 2017 does suggest that 2017 was unusual (but not exceptional) and indeed spring 2017 was the 2nd warmest on record beaten only by 2011 as shown in the chart below.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-665 alignnone\" src=\"https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR1-300x145.png\" alt=\"\" width=\"854\" height=\"413\" srcset=\"https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR1-300x145.png 300w, https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR1-768x370.png 768w, https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR1-450x217.png 450w, https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR1.png 1158w\" sizes=\"auto, (max-width: 854px) 100vw, 854px\" \/><\/p>\n<p>Standardised variables (also known as Z-SCORES) aid interpretation of data in many ways.\u00a0 If the standardised value is positive, it means that the value is above your average or expected value.\u00a0 If it is negative, then the value is below your expected value.\u00a0 The chart above suggests that our spring temperatures have been following a rough 25 year cycle e.g.<\/p>\n<ul>\n<li>From 1910 to 1935 (roughly), UK springs were colder than average.<\/li>\n<li>1936 to 1961, UK springs were average.<\/li>\n<li>1962 to 1987, UK springs were colder than average.<\/li>\n<li>1998 to 2017, UK springs were warmer than average.<\/li>\n<\/ul>\n<p>If the original variable is approximately normal in its distribution then the vertical scale gives us an idea of how typical or atypical each year is.\u00a0 Z-Scores in the range -1 to +1 are considered typical values and completely unremarkable.\u00a0 Z-scores in the ranges -2 to -1 and +1 to +2 are considered to be uncommon values but still entirely plausible and such values should not cause us concern.\u00a0 When Z-Scores get into the ranges -3 to -2 and +2 to +3, we should start paying closer attention and asking ourselves if something has changed especially if we get a sequence of successive points in these ranges.\u00a0 Finally, if the Z-scores are less than -3 or greater than +3, that is normally regarded as a clear call to action.\u00a0\u00a0There are in fact many ways of interpreting Z-Scores and\u00a0what I have said so far\u00a0merely a gives an overview of the most basic interpretations.\u00a0 A whole field of study known as <a href=\"https:\/\/en.wikipedia.org\/wiki\/Statistical_process_control\">Statistical Process Control (SPC) <\/a>is dedicated to building and interpreting such charts (known as a CONTROL CHART).<\/p>\n<p>One point to clarify when calculating the z-scores for the weather variables is over what timeframe should the average and standard deviation be based on.\u00a0 I have decided to go with a rolling 50-year average and standard deviation so since we are in 2017, these values will be calculated on the 1967 to 2016 timeframe.\u00a0 My reason for using this timeframe is that it seems like a good timeframe for the concept of &#8220;living memory&#8221; i.e. we evaluate the most recent weather in terms of our\u00a0experience &amp; memory and\u00a0being a child of the 70&#8217;s I can still remember some of the weather of the late 70&#8217;s.<\/p>\n<p>I said earlier that if we have multivariate data sets then standardising variables allows us to compare multiple variables of differing scales.\u00a0 The next two charts show the z-scores for spring sunshine and rainfall in the UK.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-666 alignnone\" src=\"https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR2-300x144.png\" alt=\"\" width=\"852\" height=\"409\" srcset=\"https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR2-300x144.png 300w, https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR2-768x369.png 768w, https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR2-1024x493.png 1024w, https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR2-450x216.png 450w, https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR2.png 1160w\" sizes=\"auto, (max-width: 852px) 100vw, 852px\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\" wp-image-667 alignnone\" src=\"https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR3-300x144.png\" alt=\"\" width=\"850\" height=\"408\" srcset=\"https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR3-300x144.png 300w, https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR3-768x369.png 768w, https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR3-1024x492.png 1024w, https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR3-450x216.png 450w, https:\/\/marriott-stats.com\/nigels-blog\/wp-content\/uploads\/2017\/06\/UKweatherTracker2017SPR3.png 1158w\" sizes=\"auto, (max-width: 850px) 100vw, 850px\" \/><\/p>\n<p>The z-score for spring sunshine in 2017 was +1.3 so this is well above average but completely within normal range of expectations.\u00a0 The z-score for rainfall was -0.8 so spring 2017 was drier than normal but completely unremarkable in terms of rainfall.\u00a0 When we combine these two values with +1.9 for temperature, I think it is fair to conclude that spring 2017 was definitely a pleasant one!<\/p>\n<p>What I have covered here in this post is simply some of the basics of analysing time series data.\u00a0\u00a0 When I analyse the summer of 2017 at the beginning of September, I will add more features to these charts which will allow us to gain a greater insight into our weather.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Meteorologists define spring in the UK to be the period from March to May so spring is now over and we are officially in summer.\u00a0 I have decided to create a series of posts which I will publish at the end of each season showing how that season compares to the weather record.\u00a0 The 2017 [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":665,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[90],"tags":[48,40,51,46,34,47,52],"class_list":{"0":"post-671","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-archive","8":"tag-multivariate-data","9":"tag-presenting-data","10":"tag-standardisation","11":"tag-trend-analysis","12":"tag-weather","13":"tag-weather-trends","14":"tag-z-scores","15":"entry","16":"override"},"_links":{"self":[{"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/posts\/671","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/comments?post=671"}],"version-history":[{"count":6,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/posts\/671\/revisions"}],"predecessor-version":[{"id":677,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/posts\/671\/revisions\/677"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/media\/665"}],"wp:attachment":[{"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/media?parent=671"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/categories?post=671"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/tags?post=671"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}