{"id":90,"date":"2017-02-19T11:57:44","date_gmt":"2017-02-19T11:57:44","guid":{"rendered":"https:\/\/marriott-stats.com\/nigels-blog\/?p=90"},"modified":"2021-04-07T14:54:19","modified_gmt":"2021-04-07T13:54:19","slug":"by-election-forecasting-model-1-how-to-predict-outcomes-in-the-brexit-era","status":"publish","type":"post","link":"https:\/\/marriott-stats.com\/nigels-blog\/by-election-forecasting-model-1-how-to-predict-outcomes-in-the-brexit-era\/","title":{"rendered":"By-Elections #1 – How to predict outcomes in the Brexit era"},"content":{"rendered":"

Since the UK voted to leave the EU on 23<\/span>rd<\/span><\/sup> June 2016, there have been 3 contested parliamentary by-elections (Witney, Richmond Park, Sleaford & North Hykeham) and one uncontested by-election (Batley & Spen which was the late Jo Cox\u2019s seat).<\/span>\u00a0 <\/span>Many commentators have analysed these results to see how the referendum result has impacted on parliamentary voting intentions.\u00a0 Whatever voter dynamics are\u00a0revealed, it is reasonable to assume that they\u00a0are likely to influence future by-elections.<\/span>\u00a0 <\/span>In late\u00a0October 2016 just after the Witney result, I realised it could be possible to build a by-election model by combining two sources of data.<\/span><\/p>\n

    \n
  1. My own estimates of the Leave & Remain votes in each of the 650 parliamentary constituencies where I calculated that <\/span>400 out of 650 seats voted Leave<\/span><\/a>.<\/span><\/li>\n
  2. My interpretation of the <\/span>Lord Ashcroft \u201cexit poll\u201d<\/span><\/a> carried out on 21<\/span>st<\/span><\/sup> to 23<\/span>rd<\/span><\/sup> June 2016 and published immediately after the results were announced.<\/span>\u00a0<\/span><\/li>\n<\/ol>\n

    At the time, I described <\/span>my by-election modelling approach in a youtube clip<\/span><\/a> and that is worth listening to.<\/span>\u00a0 <\/span>I have made some changes to my model since then so this post is the most up to date version of my model.<\/span>\u00a0<\/span>I will illustrate the basic principle using the Witney by-election (David Cameron\u2019s former seat) of 20<\/span>th<\/span><\/sup> October 2016 where the top line numbers are:<\/span><\/p>\n

    \"\"The first two rows show the general election results & turnout for 2010 & 2015.<\/span>\u00a0 <\/span>The EU 2016 row shows the actual turnout in Witney was 7 points higher than the General Election in 2015 which tells us there were people who voted in 2016 but not in 2015.<\/span>\u00a0 <\/span>I have recast the 2015 results into what would have been the vote shares had these additional voters been able to tick a box in 2015 which said \u201cNone of the above but I will vote in the referendum in 2016\u201d as shown by the Non-GE black column.<\/span>\u00a0 <\/span><\/p>\n

    This is important to do because in any future election or by-election, these Non-GE voters may be inspired to vote having not done so in 2015.<\/span>\u00a0 <\/span>For the sake of completeness, I have assumed that if people did not vote in either the referendum or the General Election then they will never vote in any future by\u00a0election.<\/span><\/p>\n

    We then have the Remain & Leave vote shares of 54% & 46% respectively in the next two rows.<\/span>\u00a0 <\/span>In the case of Witney, these are actual results since the results were declared for West Oxon district council which happens to be the same geographical area as the Witney seat.<\/span>\u00a0 <\/span>We now have actual data for 172 of the 650 seats in the UK and so for some by-elections, I do not need to estimate these figures but for most by-elections I will use my <\/span>Leave vote share model<\/span><\/a> to make these estimates.<\/span><\/p>\n

    I have split the Leave & Remain votes by political party in 2015 including the Non-GE voters.<\/span>\u00a0 <\/span>So of the 55% (after allowing for Non-GE voters) who voted Conservative in 2015, I estimate a small majority voted Remain with a 28:27 split.<\/span>\u00a0 <\/span>These splits are derived from the Ashcroft \u201cexit poll\u201d where he found that Conservative voters split 58:42 Leave in the referendum based on the UK result of 52:48 Leave.<\/span>\u00a0 <\/span>Using those party splits as a starting point, I have then adjusted the proportions equally across all parties until I end up with numbers that reconcile with the known 54:46 remain vote in Witney. <\/span><\/p>\n

    The question for any by-election in the post-Brexit era\u00a0is how will these voting segments behave in any future election?<\/span>\u00a0 <\/span>Will Conservative Remainers switch to the Lib Dems?<\/span>\u00a0 <\/span>Will Lib Dem Leavers switch to the Conservatives?<\/span>\u00a0 <\/span>I am sure you can imagine many possible scenarios and there is a danger that you end up picking scenarios that fit your narrative.<\/span>\u00a0 <\/span>To avoid this bias and add some rigour, I paid particular attention to question 24 of the Ashcroft \u201cexit poll\u201d and my interpretation of this question was that Leave & Remain voters can be split into 5 Voter Segme\"\"<\/span>nts within each party.<\/span><\/p>\n

      \n
    1. REMAIN Pro-EU<\/span> <\/strong>–<\/span> Someone who believes in the ideal of the European Union and will fight to stay in.<\/span>\u00a0\u00a0 <\/span>An Anti-Brexit party will surely appeal to such people<\/span><\/li>\n
    2. REMAIN Best of Both<\/span> <\/strong>–\u00a0Someone who likes being in the EU but wants to stay out of the Euro and other integrationist policies.<\/span>\u00a0\u00a0Un<\/span>likely to be enthusiastic about the EU but will listen to an Anti-Brexit party if the leaving process runs into big problems.<\/span><\/li>\n
    3. REMAIN Economic Risks<\/span> <\/strong>–<\/span> Someone who doesn\u2019t like the EU and agrees with Leave regarding sovereignty\/immigration issues but doesn\u2019t want to take the economic risk of leaving the EU.<\/span>\u00a0 <\/span>Very much \u201cdevil you know\u201d but are most likely to accept the referendum result and will only listen to an Anti-Brexit party if their economic fears come to fruition otherwise they will be unimpressed with an Anti-Brexit party that appears to be defying the democratic will of the people.<\/span><\/li>\n
    4. LEAVE Potential Begret<\/span> <\/strong>–<\/span>\u00a0<\/span>Someone who accepts there are economic risks in leaving but voted leave on sovereignty\/immigration grounds.<\/span>\u00a0 <\/span>Can be persuaded to switch if economic outcomes are worse than they expected.<\/span><\/li>\n
    5. LEAVE Brexiteer<\/strong><\/span> – Someone who believes that life will be better outside the EU regardless of any initial uncertainty and is not going to change their mind.<\/span><\/li>\n<\/ol>\n

      The chart shows the size of each segment based on my reading of the Ashcroft \u201cexit poll\u201d. Note the Economic Risks segment is larger and the Pro-EU segment is smaller among Conservative Remainers compared to L\"\"<\/span><\/span>abour and Lib Dem Remainers.<\/span><\/p>\n

      Using this chart I can allocate each parties\u2019 remain and leave voters into the 5 referendum segments which results in additional rows to the table I have already shown.<\/span>\u00a0 <\/span>For Non-GE voters, there is a clear correlation between Leave voting and increased turnout so these voters are assumed to be disproportionately Leave.<\/span><\/p>\n

      The end result is that I have now split Witney into 35 voting segments.<\/span>\u00a0 <\/span>A number of these are tiny such as UKIP Remainers (almost an oxymoron!) but doing this allows\u00a0me to identify the largest segments which are likely to be key in any by-election.<\/span>\u00a0 <\/span>In Witney, the largest segment is Conservative Brexiteer which accounts 23% of 2016 voters followed by Conservative Economic Risks with 15%.<\/span><\/p>\n

      To arrive at a forecast for a by-election we have to answer these questions.<\/span>\u00a0<\/span><\/p>\n

        \n
      1. What % of each segment will bother to vote in a by-election?<\/strong> <\/span>\n
          \n
        • On average, by-election turnout tends to be around 2\/3 of that seen in a General Election but it can be lower.<\/span><\/li>\n
        • For non-GE voters, turnout will probably be much lower than for the parties since these voters didn\u2019t vote in the General Election so will they be motivated to vote in a by-election?<\/span><\/li>\n<\/ul>\n<\/li>\n
        • For each segment that votes, will they remain loyal to their 2015 party or will they switch to another party?<\/span><\/strong>\n
            \n
          • If they do switch, to which party will they switch to and in what proportion?<\/span><\/li>\n<\/ul>\n<\/li>\n
          • Are there any national trends in addition to local switching that we should add or subtract?<\/span><\/strong><\/li>\n<\/ol>\n

            By now, I am sure you will be thinking that you could come up with pretty much any figure you want and you would be right to say so.<\/span>\u00a0 <\/span>So the way to get around any potential\u00a0cherry picking, I have devised hundreds of potential scenarios (528 to be precise) and by examining the\u00a0distribution of outcomes generated by these scenarios, I can draw conclusions.<\/span>\u00a0 For example, i<\/span>f all scenarios point to a Conservative win say, then it doesn\u2019t matter too much scenario is the correct one.\u00a0 Alternatively, you may find half the scenarios point to a Labour win and the other half point to a UKIP.\u00a0 At that point, you can seek to identify what are the common factors behind Labour victories, what are the common factors behind UKIP victories and then compare and contrast the specific factors that drive the differing outcomes.\u00a0 With this information, you can then choose to give more weight to some factors than others if you think that is worth doing.<\/span><\/p>\n

            For by elections that have already taken place,\u00a0my approach is different.<\/span>\u00a0 <\/span>This time, I want to identify the scenarios that best explain the actual results.<\/span>\u00a0 <\/span>With 3 by-elections, this gives\u00a0me the chance to see if there is any consistency in the best fit scenarios that could be used to predict future by-elections.<\/span>\u00a0 <\/span>It turns out that there is some consistency.<\/span><\/p>\n

            Witney 20<\/span>th<\/span><\/sup><\/strong> October 2016 \u2013 Conservative Remain seat<\/strong>\"\"<\/span><\/p>\n

            I have colour coded each of the 35 voting segments to indicate where I think the votes went and t<\/span>he following scenario generates a forecast close to the final result.<\/span>\u00a0 <\/span>All is consistent with my reading of the political mood at the time.<\/span><\/p>\n

              \n
            1. Turnout is higher among Lib Dem & Labour voters<\/span><\/li>\n
            2. Non-GE voters did not vote<\/span><\/li>\n
            3. No additional national swing is needed.<\/span><\/span><\/li>\n
            4. All Pro-EU\u00a0voters defect to the Lib Dems<\/span><\/li>\n
            5. Half of the Potential Bregret\u00a0voters defect to the Lib Dems<\/span><\/li>\n
            6. All Conservative Best of Both voters defect to the Lib Dems<\/span><\/li>\n
            7. All Lib Dem\u00a0Brexiteer voters defect to the Conservatives<\/span><\/li>\n<\/ol>\n

              This scenario does tend to overestimate the UKIP vote but since UKIP got less than 10% of the vote in 2015, I am not so bothered about getting the smaller parties correct.<\/span>\u00a0 <\/span>The main thing is to find the scenarios that best fit the larger parties.<\/span><\/p>\n

              Richmond Park\u00a01st<\/span><\/strong> December 2016 \u2013 Conservative Remain seat<\/strong>\"\"<\/span><\/p>\n

              In this by-election, Zac Goldsmith actually stood as an independent Conservative candidate.<\/span>\u00a0 <\/span>Both UKIP and the Greens decided not to stand.<\/span>\u00a0 <\/span>Richmond Park was one of the strongest Remain seats in the country coming in at #36 out of 650.<\/span>\u00a0 <\/span>Among Conservative seats it was the 4<\/span>th<\/span><\/sup> most Remain seat with the other 3 also in South West London.<\/span><\/p>\n

              By now, the political mood had started to change following the strong showing by the Lib Dems in Witney and so the following scenarios appear to be consistent with\u00a0my perceptions\u00a0at the time.<\/span>\u00a0 <\/span>Those statements coloured in blue bold also apply to Witney, other statements differ from Witney.<\/span><\/p>\n

                \n
              1. Turnout is broadly similar among the parties<\/span><\/li>\n
              2. Turnout among Non-GE voters is 1\/3 that of the main parties<\/span><\/li>\n
              3. There is an additional national swing away from Labour of 2% which is split between the Conservatives & Lib Dems.<\/span><\/span><\/li>\n
              4. All Pro-EU voters defect to the Lib Dems<\/span><\/strong><\/li>\n
              5. Half of the Potential Bregret voters defect to the Lib Dems<\/span><\/strong><\/li>\n
              6. All Conservative <\/span><\/strong>& Labour<\/span> Best of Both voters defect to the Lib Dems<\/span><\/strong><\/span><\/li>\n
              7. All Lib Dem\u00a0Brexiteer voters defect to the Conservatives<\/span><\/strong><\/span><\/li>\n<\/ol>\n

                So in two Conservative Remain seats in the London\/South East area, some similarity of scenarios is now apparent.<\/span><\/p>\n

                Sleaford & North Hykeham,\u00a08th<\/span>\u00a0December 2016 \u2013 Conservative Leave Seat<\/span>\"\"<\/span><\/strong><\/p>\n

                This by-election was the first since the referendum to take place in a Leave seat.<\/span>\u00a0 <\/span>Compared to Richmond Park though, turnout was considerably lower and an Independent candidate made a strong showing.<\/span>\u00a0 <\/span>This time, the following scenarios apply with those in blue common to both Richmond Park & Witney and those in red common to Richmond Park.<\/span><\/p>\n

                  \n
                1. Turnout is higher among Lib Dem voters<\/span><\/li>\n
                2. Turnout among Non-GE voters is 1\/3 that of the main parties<\/span><\/strong><\/li>\n
                3. There is an additional national swing away from Labour of 2% which is split between the Conservatives & Lib Dems.<\/b><\/span><\/li>\n
                4. All Pro-EU voters defect to the Lib Dems<\/span><\/strong><\/li>\n
                5. All Lib Dem\u00a0Brexiteer voters defect to the Conservatives<\/span><\/strong><\/li>\n<\/ol>\n

                  Unlike Richmond Park, there was little evidence of Potential Bregret & Best of Both switching to the Lib Dems.<\/span>\u00a0 <\/span>Whether this was because the Lib Dems focused on Richmond Park or because the seat was a Leave area or because it was outside the London\/South East area is unclear.<\/span>\u00a0 <\/span><\/p>\n

                  Two assumptions do now seem to be solid ones, namely that all Pro-EU voters have swung behind the Lib Dems but the Lib Dems have lost their Brexiteers to the Conservatives.<\/span>\u00a0 <\/span>Six weeks on from Witney, it now appears that Non-GE voters are starting to turn out to some degree and that there is a small national swing away from Labour that needs to be taken into account.<\/span>\u00a0 <\/span>Going forward, my by-election forecasts will tend to favour these scenarios.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

                  Since the UK voted to leave the EU on 23rd June 2016, there have been 3 contested parliamentary by-elections (Witney, Richmond Park, Sleaford & North Hykeham) and one uncontested by-election (Batley & Spen which was the late Jo Cox\u2019s seat).\u00a0 Many commentators have analysed these results to see how the referendum result has impacted on […]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[2,6,3],"tags":[23,20,21,24,25,22,26],"class_list":{"0":"post-90","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-elections","7":"category-forecasting","8":"category-polling","9":"tag-brexit","10":"tag-by-elections","11":"tag-election-forecasting","12":"tag-eu-referendum","13":"tag-forecasting-model","14":"tag-lord-ashcroft-poll","15":"tag-scenario-modelling","16":"entry","17":"override"},"_links":{"self":[{"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/posts\/90","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/comments?post=90"}],"version-history":[{"count":11,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/posts\/90\/revisions"}],"predecessor-version":[{"id":3733,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/posts\/90\/revisions\/3733"}],"wp:attachment":[{"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/media?parent=90"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/categories?post=90"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/marriott-stats.com\/nigels-blog\/wp-json\/wp\/v2\/tags?post=90"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}