Skip to content

Latest commit

 

History

History
263 lines (221 loc) · 12.2 KB

refit-dataset.md

File metadata and controls

263 lines (221 loc) · 12.2 KB

REFIT: Electrical Load Measurements dataset

The REFIT Electrical Load Measurements dataset includes cleaned electrical consumption data in Watts for 20 households at aggregate and appliance level, timestamped and sampled at 8 second intervals. This dataset is intended to be used for research into energy conservation and advanced energy services, ranging from non-intrusive appliance load monitoring, demand response measures, tailored energy and retrofit advice, appliance usage analysis, consumption and time-use statistics and smart home/building automation.

Collection of this dataset was supported by the Engineering and Physical Sciences Research Council (EPSRC) via the project entitled Personalised Retrofit Decision Support Tools for UK Homes using Smart Home Technology (REFIT), which is a collaboration among the Universities of Strathclyde, Loughborough and East Anglia. The dataset includes data from 20 households from the Loughborough area over the period 2013 - 2015. Additional information about REFIT is available from https://www.refitsmarthomes.org.

When using this dataset please cite the following paper in Scientific Data, http://dx.doi.org/10.1038/sdata.2016.122

Measurements available out-of-the-box

Contextual features

  • DateTime Timestamp information (YYYY-MM-DD HH:mm:ss) in local time.
  • UNIX TIMESTAMP timestamp given in UTC time.

Domain specific features

  • Aggregate: Measurement of active power in the household (in watts)
  • Appliance1, Appliance2, Appliance3, ..., Appliance9: Measurement(s) of active power for particular appliance (in watts)

Per-household data out-of-the-box

Contextual features

  • House: Anonymized integer identifier of a hosehold.
  • Occupancy: Number of residents of the househod.
  • Construction Year: Estimated years when household was built. Value can be an explicit year, year range, or dash for unknown.
  • Appliances Owned: Number of appliances present in the household
  • Type: Text describing type of a household
  • Size: Size of a household give in number bedrooms.

Notes on the cleaned variant

This version of the dataset has been cleaned in the following ways:

  • Timestamp duplicates have been merged.
  • IAM (Individual Appliance Monitor) readings set to 0 Watts if above 4000 Watts (above the rated limit of the sensor).
  • Each IAM has been processed to ensure that it only shows readings for one appliance, where possible.
  • The ReadMe file has been updated with information about monitored appliance changes.
  • NaN values have been forward filled (< 2 minute gaps) or zeroed (> 2 minute gaps).

NAMING SCHEMEs

Each of the houses is labelled, House 1 - House 21 (skipping House 14), each house has 10 power sensors comprising a current clamp for the household aggregate and 9 Individual Appliance Monitors (IAMs). Only active power in Watts is collected at ~6-8 second interval. The subset of all appliances in a household that was monitored reflects the document from DECC of the largest consumers in UK households, https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/274778/9_Domestic_appliances__cooking_and_cooling_equipment.pdf

FILE FORMAT

The file format is CSV (comma separated values) and is laid out as follows; DateTime (YYYY-MM-DD HH:mm:ss), UNIX TIMESTAMP (UCT), Aggregate, Appliance1, Appliance2, Appliance3, ... , Appliance9 Additionally data was only recorded when there was a change in load; this data has been forward filled with the last actual value recored unless the gap is greater than 2 minutes in which case it was filled with 0. The sensors are also not synchronised as our collection script polled every 6-8 seconds; the sensor may have updated anywhere in the last 6-8 seconds. The CSV files have more rows than Excel is able to display at one time and should therefore be opened using a program such as Matlab or other data processing application.

MISSING DATA

During the course of the study there are a few periods of missing data (notably February 2014). Outages were due to a number of factors, including household internet failure, hardware failures, network routing issues.

DATA CLEANING

All of the data has been cleaned to forward fill NaN values and remove values which exceed 4000 Watts on the IAM datastreams as this is above the maximum possible power draw.

APPLIANCE LIST

The following list shows the appliances that were known to be monitored at the beginning of the study period. Although occupants were asked not to remove or switch appliances monitored by the IAMs, we cannot guarantee this to be the case. It should also be noted that Television and Computer Site's may consist of multiple appliances, e.g. Television, SkyBox, DvD Player, Computer, Speakers, etc. Where Computer/Television Site's have the list of appliances known these are located in the notes section for that house. The notes section also contains additional information about additional appliances or changes which may have occurred. Please make sure to read this as it highlights important changes.

House 1
0.Aggregate, 1.Fridge, 2.Chest Freezer, 3.Upright Freezer, 4.Tumble Dryer,
5.Washing Machine, 6.Dishwasher, 7.Computer Site, 8.Television Site, 9.Electric Heater
    !NOTES
        0. October 2014, numerous light bulbs changed to LEDs.
        7.a Desktop Computer
        7.b Computer Monitor

House 2
0.Aggregate, 1.Fridge-Freezer, 2.Washing Machine, 3.Dishwasher, 4.Television,
5.Microwave, 6.Toaster, 7.Hi-Fi, 8.Kettle, 9.Oven Extractor Fan
    !NOTES

House 3
0.Aggregate, 1.Toaster, 2.Fridge-Freezer, 3.Freezer, 4.Tumble Dryer,
5.Dishwasher, 6.Washing Machine, 7.Television, 8.Microwave, 9.Kettle
    !NOTES

House 4
0.Aggregate, 1.Fridge, 2.Freezer, 3.Fridge-Freezer, 4.Washing Machine (1),
5.Washing Machine (2), 6.Computer Site, 7.Television Site, 8.Microwave, 9.Kettle
    !NOTES
        6.a Desktop Computer
        6.b Computer Monitor
        6.c Scanner
        6.d Printer
        6.e Router
        6. Change in signature 01/02/2015
        7.a Television
        7.b DVD Player
        7.c VHS Player
        7. Change in signature 19/12/2014

House 5
0.Aggregate, 1.Fridge-Freezer, 2.Tumble Dryer 3.Washing Machine, 4.Dishwasher,
5.Computer Site, 6.Television Site, 7.Combination Microwave, 8.Kettle, 9.Toaster
    !NOTES
        2. Dehumidifier added on 21/11/2014
        5.a Desktop Computer
        5.b Computer Monitor
        5.c Printer
        5.d Speakers
        5. Change in signature 27/01/2015
        6.a Television w/DVD Player
        6.b Set-top Box
        6.c Games Console

House 6
0.Aggregate, 1.Freezer (Utility Room), 2.Washing Machine, 3.Dishwasher, 4.MJY Computer,
5.Television Site, 6.Microwave, 7.Kettle, 8.Toaster, 9.PGM Computer
    !NOTES
        4.a Desktop Computer
        4.b Computer Monitor
        4.c Computer Monitor
        4.d Printer
        5.a Television
        5.b Set-top Box
        5.c PC
        5.d DVD Player
        9.a Desktop Computer
        9.b Computer Monitor
        9.c Printer
        9.d Shredder

House 7
0.Aggregate, 1.Fridge, 2.Freezer (Garage), 3.Freezer, 4.Tumble Dryer,
5.Washing Machine, 6.Dishwasher, 7.Television Site, 8.Toaster, 9.Kettle
    !NOTES
        3. Change in signature 24/11/13
        6. Change in signature 20/05/14
        7.a Television
        7.b Speakers
        7.c Telephone

House 8
0.Aggregate, 1.Fridge, 2.Freezer, 3.Dryer, 4.Washing Machine,
5.Toaster, 6.Computer, 7.Television Site, 8.Microwave, 9.Kettle
    !NOTES
        1. Change in Fridge Nov 6th
        5.a Toaster
        5.b DAB Radio
        7.a Television
        7.b DVD Player
        7.c VHS Player
        7.d Sound Bar

House 9
0.Aggregate, 1.Fridge-Freezer, 2.Washer Dryer, 3.Washing Machine, 4.Dishwasher,
5.Television Site, 6.Microwave, 7.Kettle, 8.Hi-Fi, 9.Electric Heater
    !NOTES
        5.a Television
        5.b Sky Box
        5.c DVD Player

House 10
0.Aggregate, 1.Magimix (Blender), 2.Freezer, 3.Chest Freezer (In Garage), 4.Fridge-Freezer,
5.Washing Machine, 6.Dishwasher, 7.Television Site, 8.Microwave, 9. Kenwood KMix
    !NOTES
        1. Changed from Fridge to Blender on 17/06/2014
        2. Changed from Freezer to Toaster on 25/06/2014.
        3. Post April 2015, included a second Freezer (both located in Garage)
        4. Changed from Whirlpool ART 500-9/G/1 to AEG SKZ71800F0 March 2015 (Both Fridge-Freezer)
        7.a. TV
        7.b. DVD Player
        7.c. Set-top Box
        7.d. Router
        7.e. Network storage External power supply
        7.f. Laptop external power supply

House 11
0.Aggregate, 1.Fridge, 2.Fridge-Freezer, 3.Washing Machine, 4.Dishwasher,
5.Computer Site, 6.Microwave, 7.Kettle, 8.Router, 9.Hi-Fi
    !NOTES
        0. Aggregate is affected by Solar Panels.
        4. Possible dishwasher replacement

House 12
0.Aggregate, 1.Fridge-Freezer, 2.Television Site(Lounge), 3.Microwave, 4.Kettle,
5.Toaster, 6.Television Site(Bedroom), 7.Not Used, 8.Not Used, 9.Not Used
    !NOTES

House 13
0.Aggregate, 1.Television Site, 2.Unknown, 3.Washing Machine, 4.Dishwasher,
5.Tumble Dryer, 6.Television Site, 7.Computer Site, 8.Microwave, 9.Kettle
    !NOTES
        1.a Television
        1.b Xbox
        1.c Wii
        2. Has a device attached which was not recorded.
        5. Signature changes with no mention of devices attached.
        6.a Television
        6.b Computer
        6.c Current Cost
        7.a Laptop Dock
        7.b Camera System (July-Aug 2014)

House 15
0.Aggregate, 1.Fridge-Freezer, 2.Tumble Dryer, 3.Washing Machine, 4.Dishwasher,
5.Computer Site, 6.Television Site, 7.Microwave, 8.Kettle , 9.Toaster
    !NOTES
        5.a Desktop Computer
        5.b Printer
        6.a Television
        6.b Xbox
        6.c Set-top Box

House 16
0.Aggregate, 1.Fridge-Freezer (1), 2.Fridge-Freezer (2), 3.Electric Heater (1)?, 4.Electric Heater (2), 5.Washing Machine, 6.Dishwasher, 7.Computer Site, 8.Television Site, 9.Dehumidifier/Heater
    !NOTES
        8.a Television
        8.b DVD/Blue-ray Player
        8.c Wii
        8.d Speakers

House 17
0.Aggregate, 1.Freezer (Garage), 2.Fridge-Freezer, 3.Tumble Dryer (Garage), 4.Washing Machine, 5.Computer Site, 6.Television Site, 7.Microwave, 8.Kettle, 9.Plug Site (Bedroom)
    !NOTES
        1. Was replaced 1 month before recording stopped with smaller capacity Freezer.
        2. Was replaced mid May 2015.
        5.a Desktop
        5.b Computer Monitor
        5.c Computer Monitor
        5.d Printer
        8.a Kettle
        8.b Toaster & Misc (Occasionally plugged in)
        9.a Television
        9.b Laptop
        9.c Hair Dryer
        9.d Phone Charger

House 18
0.Aggregate, 1.Fridge(garage), 2.Freezer(garage), 3.Fridge-Freezer,
4.Washer Dryer(garage), 5.Washing Machine, 6.Dishwasher, 7.Desktop Computer,
8.Television Site, 9.Microwave
    !NOTES
        8.a Television
        8.b DVD Player
        8.c Sky Box
        8.d Speakers
        8.e Lamp
        8.f HiFi

House 19
0.Aggregate, 1.Fridge & Freezer, 2.Washing Machine, 3.Television Site, 4.Microwave, 5.Kettle, 6.Toaster, 7.Bread-maker, 8.Lamp (80Watts), 9.Hi-Fi
    !NOTES
        1. This plug has a fridge AND a freezer attached on the same IAM
        3.a Television
        3.b DVD Player

House 20
0.Aggregate, 1.Fridge, 2.Freezer, 3.Tumble Dryer, 4.Washing Machine, 5.Dishwasher, 6.Computer Site, 7.Television Site, 8.Microwave, 9.Kettle
    !NOTES

House 21
0.Aggregate, 1.Fridge-Freezer, 2.Tumble Dryer, 3.Washing Machine,
4.Dishwasher, 5.Food Mixer, 6.Television, 7.Kettle/Toaster, 8.Vivarium, 9.Pond Pump
    !NOTES
        House 21 Aggregate is affected by Solar Panels.