1 About

1.1 Report circulation:

  • Public - this report is intended to accompany the data release.

1.2 License

This work is made available under the Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) License.

This means you are free to:

  • Share — copy and redistribute the material in any medium or format
  • Adapt — remix, transform, and build upon the material for any purpose, even commercially.

Under the following terms:

  • Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.
  • No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.

Notices:

  • You do not have to comply with the license for elements of the material in the public domain or where your use is permitted by an applicable exception or limitation.
  • No warranties are given. The license may not give you all of the permissions necessary for your intended use. For example, other rights such as publicity, privacy, or moral rights may limit how you use the material. #YMMV

For the avoidance of doubt and explanation of terms please refer to the full license notice and legal code.

1.3 Citation

If you wish to use any of the material from this report please cite as:

  • Anderson, B. (2019) GREENGrid Household Electricity Demand Data Test: Imputed total power demand using: circuitsToSum_v1.1. Centre for Sustainability, University of Otago: Dunedin.

This work is (c) 2019 the University of Otago

1.4 History

1.5 Requirements:

This report uses the safe version of the grid spy 1 minute data which has been processed using the code in https://github.com/CfSOtago/GREENGridData/tree/master/dataProcessing/gridSpy.

1.6 Support

This work was supported by:

2 Introduction

The NZ GREEN Grid household electricity demand study recruited a sample of c 25 households in each of two regions of New Zealand (Stephenson et al. 2017). The first sample was recruited in early 2014 and the second in early 2015. Research data includes:

  • 1 minute electricity power (W) data was collected for each dwelling circuit using GridSpy monitors on each power circuit (and the incoming power). The power values represent mean(W) over the minute preceeding the observation timestamp;
  • Dwelling & appliance surveys;
  • Occupant time-use diaries (focused on energy use).

NB: Version 1 of the data package does not include the time-use diaries.

This report provides summary analysis of the imputed total demand for each household. The imputation was done using:

3 Load data

## Date in ISO8601 format; converting timezone from UTC to "Pacific/Auckland".
Table 3.1: First few rows of grid spy data
hhID linkID dateTime_orig TZ_orig r_dateTime circuit powerW r_dateTime_nz
rf_01 rf_01 2014-01-06 16:03 date NZ 2014-01-06T03:03:00Z imputedTotalDemand_circuitsToSum_v1.1 474.17 2014-01-06 16:03:00
rf_01 rf_01 2014-01-06 16:04 date NZ 2014-01-06T03:04:00Z imputedTotalDemand_circuitsToSum_v1.1 474.17 2014-01-06 16:04:00
rf_01 rf_01 2014-03-07 15:56 date NZ 2014-03-07T02:56:00Z imputedTotalDemand_circuitsToSum_v1.1 477.02 2014-03-07 15:56:00
rf_01 rf_01 2014-03-07 15:57 date NZ 2014-03-07T02:57:00Z imputedTotalDemand_circuitsToSum_v1.1 482.72 2014-03-07 15:57:00
rf_01 rf_01 2014-03-07 15:58 date NZ 2014-03-07T02:58:00Z imputedTotalDemand_circuitsToSum_v1.1 567.70 2014-03-07 15:58:00
rf_01 rf_01 2014-03-07 15:59 date NZ 2014-03-07T02:59:00Z imputedTotalDemand_circuitsToSum_v1.1 570.54 2014-03-07 15:59:00

Table 3.1 shows the first few rows of the Grid Spy 1 minute power data. Table 3.2 shows a summary of the Grid Spy 1 minute power data (for more detail see Section 7.1).

Table 3.2: Summary of grid spy data
hhID linkID dateTime_orig TZ_orig r_dateTime circuit powerW r_dateTime_nz obsTimeHMS obsTimeHalfHour
Length:53528631 Length:53528631 Length:53528631 Length:53528631 Length:53528631 Length:53528631 Min. :-12407.5 Min. :2014-01-06 16:03:00 Length:53528631 Length:53528631
Class :character Class :character Class :character Class :character Class :character Class :character 1st Qu.: 209.3 1st Qu.:2015-06-12 21:04:00 Class1:hms Class1:hms
Mode :character Mode :character Mode :character Mode :character Mode :character Mode :character Median : 417.1 Median :2016-03-18 19:23:00 Class2:difftime Class2:difftime
NA NA NA NA NA NA Mean : 873.0 Mean :2016-05-03 08:31:09 Mode :numeric Mode :numeric
NA NA NA NA NA NA 3rd Qu.: 1139.0 3rd Qu.:2017-03-17 18:38:00 NA NA
NA NA NA NA NA NA Max. : 15593.2 Max. :2018-08-01 23:59:00 NA NA

Note that:

  • r_dateTime_orig is the correct dateTime of each observation in original recorded time
  • r_dateTime is stored as UTC and so you may get strange results until you use lubridate to tell R to use tz = “Pacific/Auckland” with this variable;
  • there can be 0 or negative Wh observations.

Table 3.3 shows the summaries for each household as imputed using circuitsToSum_v1.1. Note that the presence of a PV inverter may only be known from the appliance summary and/or the household data.

The number of households excluded will depend on the circuits file used:

  • v1.0:
    • no PV
    • no -ve values (?)
  • v1.1:
    • no exclusions
Table 3.3: Summary of monitored households (NA indicates data not included in circuitsToSum_v1.1)
linkID hasHhData hasApplianceSummary pvInverter energyStorage notes nObs minW maxW Circuit 1 Circuit 2 Circuit 3
rf_01 No No Not known Not known 851716 0.00 13560.50 mains$1634
rf_02 No No Not known Not known 581156 -330.38 10204.00 Mains$1575
rf_06 Yes No Not known Not known 1883074 -1436.21 10804.38 Hot Water - Controlled$2248 Incomer - Uncontrolled$2249
rf_07 Yes No Not known Not known 2010201 -263.00 9508.46 Incomer 1 - Uncontrolled$2726 Incomer 2 - Uncontrolled$2725
rf_08 Yes No Not known Not known 1548193 35.14 11973.94 Incomer - Uncontrolled$2093 Hot Water - Controlled$2094
rf_09 Yes No Not known Not known 527883 -16.00 8586.00 Incomer 1 - Uncont - Inc Hob$2729 Incomer 2 - Uncont - Inc Oven$2730
rf_10 Yes Yes No No 1822053 27.68 9860.26 Incomer - All$2599
rf_11 Yes Yes No No 2127141 14.00 11855.49 Incomer - Uncontrolled$2585 Hot Water Cpbd Heater- Cont$2586 Spa - Uncontrolled$2587
rf_12 Yes No Not known Not known 398134 -406.00 10439.03 Incomer 1 - Hot Water - Cont$2626 Incomer 2 - Uncontrolled$2625 Incomer 3 - Uncontrolled$2627
rf_13 Yes Yes No No 2179995 92.46 11580.60 Incomer - Uncontrolled$2209
rf_14 Yes Yes No No 1783337 -1758.08 9894.88 Incomer 1 - Uncont inc Stove$2718 Incomer 2 - Uncont inc Oven$2717 Hot Water - Controlled$2719
rf_15a Yes No Not known Not known Disconnected 15/01/2015. Re-used NA NA NA NA NA NA
rf_15b Yes No Not known Not known Re-user. Then disconnected 02/04/2016 390846 -1062.00 10536.10 Incomer 1$3956 Incomer 2$3955
rf_16 Yes No Not known Not known 372306 -262.00 8691.89 Incomer 1 - Uncont inc Oven$2681 Incomer 2 - Uncont inc Stove$2680 Hot Water - Controlled$2679
rf_17a Yes No Not known Not known Unusual & specialist energy tech configuration. Disconnected 28/03/2016. Re-used. 959929 -1084.72 9041.53 Incomer 1 - Uncont - inc Hob$2152 Incomer 2 - Uncont - inc Oven$2151 Hot Water - Controlled$2150
rf_17b Yes No Not known Not known Re-user 272150 32.17 6495.37 Incomer 1 - inc Top Oven$5620 Incomer 2 - inc Bottom Oven$5621
rf_18 Yes No Not known Not known 540446 -1842.66 13079.07 Incomer 1 - Uncontrolled$2128 Incomer 2 - Uncontrolled$2130 Hot Water - Controlled$2129
rf_19 Yes Yes yes No 2109122 -12407.52 7363.92 Incomer 1 - All$2738 Incomer 2 - All$2737
rf_20 Yes No Not known Not known 543382 -1273.19 9739.43 Incomer 1 - Uncontrolled$2112 Incomer 2 - Uncontrolled$2111 Hot Water - Controlled$2110
rf_21 Yes Yes No No 1010258 31.00 7990.10 Incomer - All$2748
rf_22 Yes Yes No No 1885333 47.92 11535.40 Incomer - Uncontrolled$2237 Hot Water - Controlled$2236
rf_23 Yes Yes yes yes 2181070 -1871.83 11015.80 Incomer - Uncontrolled$2082 Hot Water - Controlled (HEMS)$2081
rf_24 Yes Yes yes No 2107577 -7542.61 9929.11 Incomer - Uncontrolled$2101 Hot Water - Controlled$2102
rf_25 Yes Yes No No 706148 0.00 11814.74 Incomer 1 - Uncontrolled $2763 Incomer 2 - Uncontrolled $2762
rf_26 Yes Yes No No 1938549 -482.36 9366.50 Incomer 1 - All$2703 Incomer 2 - All$2704
rf_27 Yes Yes No No 908658 58.00 9569.40 Incomer - Uncontrolled$2824 Hot Water - Controlled$2825
rf_28 Yes Yes yes No 86311 -3366.52 7960.34 Incomer - All$4221
rf_29 Yes Yes No No 1749695 76.85 12011.87 Incomer - Uncontrolled$4181 Hot Water - Controlled$4184
rf_30 Yes Yes No No 743770 30.00 8706.07 Incomer - All$4239
rf_31 Yes Yes No No 1760227 24.00 10547.60 Incomer - All$4199
rf_32 Yes Yes No No 541109 0.00 8274.91 Incomer - All$4193
rf_33 Yes Yes No No 1601314 63.47 9654.25 Incomer - Uncontrolled$4143 Hot Water - Controlled$4144
rf_34 Yes Yes No No 730613 0.00 13043.50 Incomer - All$4225
rf_35 Yes Yes No No 781977 -622.00 10373.54 Incomer - Uncontrolled$4126 Hot Water - Uncontrolled$4125
rf_36 Yes Yes No No 1605647 0.00 14826.00 Incomer - All$4148
rf_37 Yes Yes No No 1763330 51.00 9365.54 Incomer -Uncontrolled$4136 Hot Water - Controlled$4135
rf_38 Yes Yes No No very large number of circuits 886482 -179.00 9455.19 Incomer - Uncontrolled$4177 Hot Water - Controlled$4178
rf_39 Yes Yes No No 1537301 -199.00 15593.20 Incomer - Uncontrolled$4248 Hot Water (2 elements)$4247
rf_40 Yes Yes No No 348217 24.00 12527.77 Incomer - Uncontrolled$4168 Hot Water - Controlled$4167
rf_41 Yes Yes No No 1372961 54.83 12857.00 Incomer - All$4192
rf_42 Yes Yes No No 975198 33.61 12383.70 Incomer - All$4132
rf_43 Yes No Not known Not known 296190 0.00 6687.53 Incomer - All$4213
rf_44 Yes Yes No No 1762049 32.00 12165.12 Incomer - Uncontrolled$4156 Hot Water - Controlled$4155
rf_45 Yes Yes No No 819601 23.90 10385.13 Incomer - Uncontrolled$4157 Hot Water - Controlled$4158
rf_46 Yes Yes No No 1939634 92.00 12979.28 Incomer - Uncontrolled$4230 Hot Water - Controlled$4231
rf_47 Yes Yes No No 588348 21.00 11171.30 Incomer - All$4170

4 Test 0 and -ve power value incidence

Figure 4.1 shows the incidence of -ve overall imputed power values by linkID (household) and date. As we can see they tend to be concentrated in a few households.

## Warning: Removed 21 rows containing missing values (geom_tile).