Home Monitoring Upgrade

I’ve been monitoring stats from my meter, weather and hotwater tank for over two years now (see http://blog.v-s-f.co.uk/2015/04/home-monitoring-home-made-reborn/) and the application now needs an upgrade.

I now want to log more data from the weather station (temperature and humidity). This should be as simple as adding two new columns to the HSQLDB, changing the application to write in to the two new fields and adding two new fields to the service definition, but it’s not quite that straight forward…

The old app uses an out dated version of Mule on Tomcat in Docker and it’s far too heavy weight for what it needs to be. Therefore it’s time to give it a revamp.

It’s also occured to me recently that instead of storing the data in five separate tables (one for generation, upload info, hotwater, meter and weather data), why not store it in one table. This saves a significant amount of space as there are four less records per minute and it makes adding new columns for additional data sources relatively quick. The HSQLDB that I’ve been using for a while now is over 400M!

So the first task, which is possibly the biggest, is to migrate the data from the five tables in HSQLDB to a single table and then stop using HSQLDB and migrate to MySQL. Why MySQL – it’s actually quite a performant database, it’s free and easy to get running.

Home Monitoring (home made) – Reborn

I’d previously shared on my blog the home made monitoring application I’d built to aggregate pv, meter and weather data – see: http://blog.v-s-f.co.uk/2014/03/home-monitoring-home-made-overview/.

Over the last few months I re-wrote the app to not only output the data to PVOutput every minute, but store that same data into an HSQLDB on my server. The new code base uses less Java than the previous version and moves a lot of the aggregation into Mule flows. I also took the opportunity to try out Git Hub, so the code is all available online here: https://github.com/vls29/aggregator

So far it’s been running very stable since the start of January and the refactoring enables new data sources to be added very quickly, e.g. Mains Voltage as can be seen below on the graph as a purple line starting above 3000W:

mains-voltage

(link to my system on PVOutput: http://pvoutput.org/intraday.jsp?id=4836&sid=4409)

… but solar panels don’t work in the winter!

I’ve had my solar panels since October 2011 (details about my system can be found on this post) and I’m always telling people how good they are. When I tell people about my solar panels, I get one question – “how much do they generate” and the second is a statement that always makes me want to bang my head against a brick wall – “… but solar panels don’t work in the winter!” Don’t they??

When I first started telling people they should buy solar panels, all I could them was how much electricity they would generate and potentially cut from their bill, but since then I’ve added monitoring to the system which uploads the data to the internet. After the person I’m talking to has used the infamous statement about not producing electricity in the winter, I then proceed to show them the stats from my solar panels.

In the UK, winter solstice is a day between 20th and 23rd December and for more than a week each side of winter solstice, there are less than 8 hours of sunshine in a day. It’s quite literally the worst generation time of the year for solar panels in the UK – especially combined with the weather that you can get at that time of year… But when the sun does shine in the winter, you can get very good solar output days!

This December gone, I checked my system from work during lunch (as I do most days! sad, yes I know…) and noticed the solar panels had heated the hot water. To heat the hot water, there has to be enough energy generated by the solar panels to not only cover the house’ standby usage (350 ish W/h), any additional power being used by family members and also the 1kW/h immersion.

What’s more impressive is that the date was 16th December!
(the red block indicates the immersion is switched on)
16dec15

In fact we even had brief solar water heating on the 19th and 20th but they aren’t as visually impressive…
19dec1420dec14

But what all three of those charts show is that solar panels do work in the winter. They can even generate enough electricity to cause a surplus and power devices around the home!

It is true that the panels do not generate as much electricity during the winter, due to the angle of the sun in the sky and the length of the day, but we still generate in the order of 100kW/h of electricity each December.
last12monthsapr15

And on a perfect day, it’s possible to generate 9kW/h.
6dec14