After 5 years it’s time to replace my Drobo with a Drobo (FS ->5N2)

I have been using a Drobo FS file store for over 5 years.  I purchased back in 2011/2012 and started out with 2 x 2TB hard disks (Which at the time seemed a huge amount).  Over the years I’ve added drives and replaced drives both because of failure and upgraded.  I’ve got from 2TB to 4TB, to 10 TB to it’s current state of 13.54 TB.

Screen Shot 2017 08 26 at 13 44 37

In all this time I’ve lost no data and managed to survive 2 drive failures. Obviously the reasons for buying a Drobo vs the likes of Synology or QNAP are well documented.  Whilst I would have  had to buy a QNAP system and 4 match 2TB disks all in one go, with the Drobo I’ve been able to buy disks at the time I needed them.  I checked the receipt recently and when I first bought the system my 2TB drives were just over £250 each.  Fast forward 5 years, and a decent 4TB drive is now just over £100.  This flexibility is just too convenient and leads to a near complacency.

So why am I changing?

Firstly, I’m moving to another Drobo and secondly I’m not replacing but augmenting.  My plan is to add one of the new 5N2s with 3 x Segate 10TB Ironwolf Pros and a 240GB m.sata accelerator SSD.  In due course I’ll likely migrate most of the FS data onto the new 5N2, but I will have a period where I run them side by side.  I’ve still not fully decided if I’ll sell on the FS and move over wholesale.  Certainly moving 15 TB (the contents of my FS & some USB attached drives on my server) will take a good few days to move- so I’ll maybe put that decision off until later in the year.

What’s new in 5N2

I’d looked at both the D810N (the 8 bay SMB system) and the 5N2 which, when I began my decision making, was very new.  I decided to go for the 5N2, after considering the facts and realising that the 5N2 would give me 40TB usable storage for under £2200 at today’s prices (and hopefully less as drives drop in cost).  Secondly the SSD acceleration and tiered storage is now available in the 5 bay format, which should make for much greater disk performance.

Drobo 5N2 m.SATA Accelerator.jpg

Coupled with the new dual gigabit network ports, and the latest generation Seagate Ironwolf drives with their 210MB read speeds, and I hope the whole system should be way more flexible and give me the capacity I need for the next 4 or 5 years.

Drobo 5N2 dual gigabit

Glasgow – Bars, Cafes and Restaurant – WiFi for the workers – I – League Table

I’m happy to see that Wireless internet is becoming prevalent in a lot of business in Glasgow.  I’m not talking about crappy 2 or 3 meg services, but useful speeds 20+ Meg.  I’m starting a league table for these.

Redmond’s of Dennistoun (currently #1)

304 Duke St, Glasgow G31 1RZ

Down: 93.2

Up: 13.7

Redmonds of Dennistoun - broadband

Redmonds of Dennistoun

 

 

 

 

 

 

 

 

 

 

St Lukes

Calton, 17 Bain St, Glasgow G40 2JZ (currently #2)

Down: 27.9

Up: 13.6

St Lukes, Gallowgate

St Lukes, Gallowgate

 

Automation in a whole new light

I’ve had most of my media automated for a while now.  I’ve been a big proponent of Plex for many years, and with every new release it’s a tool that gets better and better.  For sometime now I’ve wanted to automate more of my house.  For good or bad as much as Apple have been pushing HomeKit, the reality is the Ecosystem is still very much North American based.  Whilst that’s changing, we have to live in the present, so what’s available for a UK household? – I set out to find out.  

The most visible of HomeKit compatible product is the Philips Hue lighting system.  I’d tried Hue sometime back and was unsuccessful due to “my GU-10 fittings” not being standard (standards, gotta love a standard!).  Apple have started to launch in store demos of the HomeKit product lines, with a lovely demo of Hue, and whilst in town a few weekends ago, I decided to give it another go.  I knew that nothing had changed with my downlighter in my house (which has a 134 for anyone keeping count) so I had to go a different route.  I picked up a 3 bulb + hub starter kit and started there.  I decided to focus on my main open-plan living room, which has my living room, kitchen, dining room and office space.  I popped a bulb into my standing lamp in my winter garden, and one into the large table lamp at the centre of the room.  The bridge was installed in my AV cupboard on my main switch and software setup was about as easy as you could expect, simply a case of downloading the hue app, finding the bridge and pairing the lights.  I won’t go into too much detail of the setting up of rooms and lamps, suffice to say, it’s probably easier to think of your room as areas if you have open planning living like I do.  Whilst I was at it I decided to go ahead and lay out the 2 bedrooms, hall, 2 bathrooms and utility room just to be safe.

With the lights in, I was able to turn the lamps off individually, change their colour, brightness and turn them off.  As a proof of concept I bonded them into a single room and was able to turn the “room” on and off.  Separating them again into their respective rooms again, I started to look at the more advanced things.  A light you can switch on and off, bit 1800s, a lamp you can dim well thats definitely in the 1900s, light changing – OK 2000s maybe, but I want more, I want automation.  So next stop was to dive into the HomeKit App, the sync between the hue App and Home app can be a bit temperamental, but I found all the lights and rooms declared.  The interface of Home shows who has more UI dollars, especially nice is the use of force touch to jump into individual lamps.  So home and hue thus far did similar things nothing to impressive, but as the great man said “there is one more thing”.  Jump out of home, and say to Siri “Turn all the lights off” and bang – we’re definitely now bang up to date.  There’s something really next gen about talking to your house!  Next up to play with scenes, again easily setup in Home app (I chose to do this in Home as I’ve read numerous reviewers comment that it’s a bit flakey to call up hue app created scenes from Siri).  I setup a couple of scenes “Early Evening”, “Orange Night”, “Watch sports” and “Watch a Movie”.  In each scene you can choose the lamps you want to be part of the scene, and then set their colour and brightness.  I made sure that each of my initial test scenes were very different with plenty of brightness changes and colours.  Once saved, as is typical for an Apple product- things just worked.  It’s hard to describe the feeling of just saying “Hey Siri- Let’s Watch a Movie” and the whole rooms mood change – it’s some transformeresque shit!

So with all that done, what was stage 2 – turn it up to 11, time to hurt the credit card, and pick up some lightstrips and some additional different sized bulbs.  On top of this I’ve also added Eve Elegato Smart plugs (for dumb lamps that don’t have any compatible Hue bulbs) and some Hue Switches.  All in my total bill of materials for the now complete Living Area is:

1 x Philips Hue Colour Wireless Bulbs Starter Kit – E27 = £135

3 x Hue Lightstrip Plus 2M kits = £195

3 x Hue Lightstrip Plus 1M extensions = £60

1 x Philips – Hue White Ambience E14 Candle Lamp = £30

1 x Elgato Eve Energy Plug £45

3 x Philips Hue Dim Switch £60

1 x Philips Hue Motion Sensor £35

Total Room cost: £560

Whilst this is not an insignificant amount of money it’s worth pointing out a couple of things.  Firstly the room includes the one time cost of the Hue bridge which inflates the headline number.  Secondly it would be entirely possible to remove the Eve plug and the motion detector (even the dimmer switches) but these are more to aid the automation.  Finally this room is huge, and in fact is 4 different spaces.  

I’ve priced up what I believe each bedroom will cost me:

2 x Philips – Hue Colour Ambiance Wireless B22 LED Light Bulb £100

1 x Hue Lightstrip Plus 2M kits = £65

1 x Philips Hue Dim Switch £20

Total room cost: £185

Whilst I was at it I priced out the hall:

1 x Philips Hue LivingColors Bloom £65

1 x Philips Hue Dim Switch £20

Total room cost £85

And that will complete my initial design/build for the lighting.  I’ll be doing this over the next few months.

I’ve already tied the gateway into the Apple TV which means the Home App (and Siri) work when away from home, and will be tuning the colouring scenes, automation and routines over this weekend.  

Future integrations:

I’m looking at moving over to Nest thermometer, Smoke alarm and maybe further out some form of video surveillance. For now though, I’m just going to go watch some sports “Hey Siri Let’s watch sports”…..

#happyGeek

Making the web come to you rather than you going to it – RSS with Feedly

For sometime now I’ve found myself feeling overwhelmed by the sheer amount of information from sites, twitter and social networks.  There’s too much noise, too many articles, and too many chances to easily miss something.  I realised after taking an audit of my daily browsing history that I visit much the same sites in sequence.

I’d used RSS some time ago but not had it stick.  I decided the best course of action was to take a look at the best RSS readers on the market, figure out what I needed and design, test and utilise a new workflow.

My hard requirements were that due to the fact that I work across 3 Macs, an iPad Pro and an iPhone the selected solution must fufill the following:

  • Allow me to utilise synchronisation across all devices, across starred, read and new articles
  • Poll regularly and use rich notifications
  • Allow automations (via IFTTT or AppleScript)

I quickly learned that as well as the application of choice, there was a further decision to make, namely the syndication provider.  In order to get the simple syncing across of devices I decided to go with Feedly due to good reviews and wide set of sites covered.  Furthermore, my logic was that if I built my RSS configuration in Feedly, I was free to move between different reader tools, and utilise my content in other ways (perhaps on an Apple TV or such in future).

Feedly

Feedly

I started by signing up for Feedly (with a Feedly account) – I’ve moved away from SSO via Google and Facebook due to some really bad security breaches on my old Facebook account this year.  Once setup, I installed the Safari plug in (for easier configuration) and added a few basic sites and categories to my feed.  When I was happy with this, it was time to move onto the RSS setup. I ended up setting on Reeder 3 for OSX and Reeder for iOS, both from the same developer, the Feedly account is simply entered on both, and bang within a few minutes all was synced.  I set my feeds to refresh on the Macs every 5 minutes, and on the iOS devices every 15 (to get a better battery life).

With everything setup I tried it out.  I found it fastest to get through the big morning glut of mail on my Mac.  Simply using arrow keys to quickly fly through the list, down for next, up for previous, right arrow to see the article itself and left to cycle back.  My work flow is pretty simple, I star things I might want to share , review or blog on later, and by using the starred view column I keep articles I want to reread via starring. The strangest feeling is the fact that I can check all my sources in 5 minutes rather than the original 60.  At first that feels like somehow I am being cheated, but I think in actual fact what I’m seeing is the time saving.  I now quickly scan my task bar for the Reeder 3 icon which shows the number of articles, and quickly skip through these between calls or work.

Feedly Running

Feedly Running

I’m pretty happy with the solution, and it certainly has freed me up greatly.  I really like how pages with YouTube videos from video channels are also included and how I can access those videos from within the tool – it’s very neat!  So give it a go, stop being a slave to your web browser and make the web deliver to you.

How to utilise a gig – Project 2: Rip and replace the router

RouterGraphics

The second thing you do after you get used to the sheer speed of a gig symmetric service is start to wonder why you can only hit 850/900 mbit regularly on most speed tests.  Shortly after that you wonder why you struggle to max out a torrent beyond 30meg/sec.  This was the strange set of events that led me to do a bit of a deep dive and find an unexpected gem.

So yeah, I went from 15-> 820meg speed tests, and yet the geek in me wondered, where had those other 180 meg gone?  Now, I give you that at these speeds its a purely theoretical, intellectual exercise, but nonetheless where had that missing 20percent gone.  Research quickly finds that around about 900 meg is realistic with overhead on any gig service, so we’re hunting 80-100 meg.  A bit of fishing around reveals that the slow torrent speeds are likely as a result of a router that can’t handle the number of connections, that and the fact that most soho routers (ZTE in the case of Hyperoptic) just can’t give you full line speed, port to port all the time.  One of the nice things about the Hyoperoptic service is the fact that it’s basically a RJ-45 jack with DHCP.  Plug in any router and it will come up. So which router?  After several reads on forums, I went for a Ubiquiti Networks ER3-Lite, I’ve loved Vyatta long before it was purchased by Brocade, and the reviews of hardware professed it’s ultra high speed, with low overhead, indeed you can offload most of the processing to it’s DSPs.

300px-Edgerouter-original-packageI picked mine up at amazon ( link to amazon.co.uk for ER3-Lite) at under £70.  Out the box it’s a pretty sturdy wee beast.  Once I’d ordered I started googling, and found two fantastic videos on setup , the best one is probably this one .

The device is pretty simple to setup if you understand networking in anyway, plug a cable into the eth0 port, you’ll get a dynamic IP (if not just set your ip in the 192.168.1.0/24 range) then http to the routers IP: 192.168.1.1.   Once in run the setup assistant (shown in the video) there’s various different ways to configure the 3 network ports on the device.  I went for WAN+2LAN, this makes eth0 the LAN1, eth1 the WAN and eth2 the WAN2.  I have a subnet for my lab so will eventually use this segregation to router VPN traffic in.

Performance once configured is pretty breathtaking.  I only tweaked the MTU on the LAN  port (eth0) as my home switch supports Jumbo Frames:

Heres a wee graphic of it doing a quick 861, though I can regularly burst 920-970 depending on time of day and location of end server.  In short- buy it!

output

How to utilise a gig – Project 1: Home Media Server [Part 1] – Hardware and Software

Before reading this article, I should admit that I’ve had the Plex server for a number of years.  The additional features afforded by the Gigabit WAN link are primarily for sharing media  outwit the local network, with family and on remote devices (Apple TVs in the case of this article).

So as I wrote in my last article, the next few weeks will chronicle some of the services that you can enable using the higher speeds afforded by gigabit connectivity.  This first article is a how-to on setting up a Media server.

So let’s take a look at some of the background as to what you might want a media server for, what facilities it can offer, what we need to buy and costs of software.  At basic a media server is a computing box, window, linux or OSX based, which runs dedicated media server software, and allows connected devices such as set top boxes, tablets, phones or Smart TVs to connect to it.  The media is loaded onto the servers storage, and when browsing to the device via app/plugin the service behaves much like your own personal Netflix.  The key difference is you have the actual media files, ripped/downloaded etc and have full control.. The more feature rich implementations also offer facilities for playlists, programme art etc.

So how do we do this?

Software/Media Centre Platform

The first question is the media server software that we are going to use. There’s plenty on the market.  Two of the most popular are XBMC and Plex, and whilst the applications come from a similar root, they achieve their aim in very different ways.

XBMC is very much a media player whereas Plex can be best thought of a client-server model, where you run a server with your media (this could even be your laptop) and then use a client on end devices (Apple TV/ Roku / Xbox One / SmartTVs).  Whilst XBMC is more configurable, and xxl_plex-logo-1200-80more feature rich, it is definitely not as stable, or s well supported as Plex.
The company behind Plex also offer paid subscriptions which make sharing your server remotely over the web, and various out tasks more easily achieved.  It’s for this reason that I moved to Plex some  years ago, and don’t miss XBMC or it’s stability/complexity issues.

Because of this approach we are going to dedicate a box to the task of running the media server, our Plex server will house all our media, and run the software to power the endpoints which in our case will run Plex client on  Apple TV4s.

Hardware

So with our software chosen, the next consideration is the “box” on which we’ll run our Plex Media server.  Your choices here are much more various.

Mac Mini in hands

2012+ Mac Mini- it’s really this small

My box of choice is unsurprisingly a Mac, and whilst I am frequently accused of bias when it comes to hardwire in this case the selection is justified.  The Mac Mini (2012-) is one of the smallest, neatest and feature rich boxes that you can use as a media server.  It can be specified up to quad core i7 processors, 16GB of RAM and can have multiple 1gigabit networking ports.  On top of that it comes with built in wifi, and runs a fan less design.

Front and back of boxes, small but plenty of expansion options!

Front and back of boxes, small but plenty of expansion options!

As you can see by the pictures on the left here, it’s really small, with a one piece design.  Even nicer is the fact that there’s no bulky power supply – just a simple infinity connector.  On the back you’ll find a multitude of ports to connect network cables, USB3.0 and thunderbolt devices, meaning you are spoilt for choice on how to about adding storage as your media server grows, be that network or direct attached disks.

New the boxes range in price from £400-1000  depending on the specification.  The i5 processor versions are dual core, whereas the i7 versions offer quad core processing.  Memory wise all the boxes will take 16GB RAM, and given the prices of RAM these days, a bump to 16GB should be the first thing you do.   The box can take internal drives, and there are various options to install 2 disks, more on that later.

I’d recommend shopping around on eBay or Gumtree, just as an example I found these two example:

Gumtree – 2012 i5 2.5Ghz with 4GB RAM for only £295

Ebay 2013 i5 2.3Ghz with 8GB RAM for only £349

Either of these boxes will be ideal, and the memory upgrade is now under £60 for 16GB and can be found here at crucial.com.

So that’s us got our hardware for around £350.  One wee note, if you are planning to run the server headless (if you want to pop it into a cupboard and hide it away) then due to a quirk on a lot of Intel based boxes, you’ll want to buy one of these HDMI dongles.  What does this dongle do? – Not to get to in depth, if your Mac (or PC) detects that it doesn’t have a monitor plugged in, it will not enable hardware acceleration of graphics, this results in f_cked up image display when you remotely access the box. Just know if you want it headless order one of these dongles.

Installing PLEX

First give your Mac Mini a fixed IP address.  You can do this easily by going into the control panel.  This means you’ll easily be able to troubleshoot if you have any errors further down the line.

If you’ve used a Mac before, installing Plex is exactly the same as any other Mac application. Head on over to Plex’s site and download the latest Media Server software.  You’ll get a DMG which you want to copy onto your Server box and install.  You’ll know that it’s installed as you’ll get an icon that look like a right pointing arrow in the top bar of your Mac (next to the clock).

There’s a few good housekeeping tasks – such as setting power management to keep the disks spinning for an hour, and disable any auto sleep functions.  I also tend to set the Plex Application to start open on startup (just in the case you should loose power).  If you only have a single user login for the server, then you can also set the box to login automatically (not the most secure but manageable).

A decent Mac Mini (post 2012) with 16GB RAM and Core i5 or above will happily serve a large household – I have managed to run 16 1080p streams to end devices, and transcode (will be explained later) to multiple iPads and the server still wasn’t running at anything close to 100percent CPU.  Better yet, because we’re using OSX we can add server functions and have this box perform other tasks for us.

In Part 2 of this walk through we’ll configure Plex, import Media and view the library from a client.

 

Things to do with high-speed net – connected home

So still loving the new service, but as I said in my last post, I’m now interested in exploring and sharing some of the new facilities that high speed connectivity can offer.  I’ll start with a couple of housekeeping points

  1. From my selfish perspective, I’m referring and qualifying all these “what you can do” articles on the Hyperoptic product that I am lucky enough to have.
  2. Many of the outcomes will be repeatable on other products (Infinity / Virgin cable etc) however results may vary.
  3. The biggest differences are likely to come from the asymmetric nature of many of the competing services – you’ll need to check how the differences of your particular service affects the outcome.
  4. You’re going to want 40+ meg on the downstream and a minimum of 10 meg on the upstream to even bother with most of these services.
  5. 1meg upstreams need not apply!

So – first things first, what about using all this super cool goodness to build a kickass media server.  I’ll be going over the basics of that in the next article!

Well it’s here – Hyperoptic and it’s immense

If you’ve read the blog for any amount of time, or even if you have stumbled onto it recently, then you’ll know that a big project in my life has been trying to improve the poor state of broadband provision in the budding in which I live.  As I’ve already touched on, I don’t live in the boonies, in a new city (with aluminium cables) or really a place that has any excuse to have poor broadband provision.  Even with this said, and given the fact I live in central Glasgow ( a very large city) I am unable to get anything beyond 17Megabit from BT.  Taking matters into my own hands I petitioned our residents association in the building and have successfully had Gigabit broadband (ultra band?) fitted from Hyperoptic.  First fit was in December, and Fibre was brought in late January.  On Wednesday ( 30th March) – we went live, and oh boy!

Here’s a speed test from 9.00AM on Thursday.  I was interested to see if there were any contention issues at peak – and hitting 750mbit a second down and 880 up is very close to perfect.  In fact even at these peak times I’m able to run these tests time after time (10 in fact) and hit the same results.

Screen Shot 2016-03-31 at 09.23.52

 

 

 

 

 

Better than that, at off-peak times (3am) I have managed to hit at 940mbit down / 970 mbit up – incredible.

So that’s the headline figures out the way, so now what?  And that’s a good question.  Things to cross off-

  • iPlayer, Netflix and Amazon are all instant, as in YouTube 4K.
  • Downloads are as fast as the server can give you (50mbit – 100mbit on the better ones).
  • Content Distribution Network (CDN) backed services are ridiculous (hard to measure) – for fun downloading an album or playlist from Apple Music to have offline is nearly instant!
  • There’s no slow down EVER!
  • Zero Packet Loss (eat that Sky!)

I’ll be doing some other experiments with this amazing new service in due course, VPN, site to site, Plex serving.  That to come, I’m off to download more of the web! 🙂

 

 

Journey to Gig/Gig broadband with Hyperoptic

I live in the centre of a major Scottish city, which has according to wikipedia has an urban population of 1.75 million people.  That’s no small number of people.  I just assumed when I bought my place, that being in a large new development that when infinity began rolling out that it’d be available pretty much after launch.  Well thanks to the mystery of BT Planning, I’ve sat for the last 5 years and watched as promised date after promised date has slipped.

Late in 2014 it became abundantly clear that BT had no interest in enabling us, all the vague excuses piled up and I realised it was going to have to be a DIY approach for our building.  First the facts- our building is just over 7 years old, is a steel frame building with inbuilt ducting and services and false ceilings.  All these things make it super easy to install services.  Secondly, the location and pricing of the building means that there’s a lot of young professionals, and home workers (i.e. a captive market).  To me it made no logical sense that the building hadn’t been enabled (I’ve actually come to get information that makes me believe it’s not a technical reason but a planning/political reason holding us back).

So i began my search, which in all honesty I was expecting to be fruitless.  I mean- if BT the largest telecoms group in the country can’t get us cable who can!  My first port of call was Virgin, where I reached out and got positive noises from they cable my street team.  I registered my interest, had a few neighbours do the same, and had good conversations with one of their outreach managers on twitter.  After 6 months though we had no committal, no in person engagement and weren’t going anywhere.

Frustrated I looked at the market again and came across Hyperoptic – a company which on paper our building was purpose made.  I have to confess that due to travel I didn’t make the first approach, but a neighbour picked up the baton and made the initial contact.  I got re-involved in summer of 2015, after which time I assumed the role of Hyperoptic Champion for the building, and pushed the project.  I started by joining our residents association, primarily for a single task (i.e. getting the fibre fitted) and began to work with the excellent John McCabe at Hyperoptic.  Our residents association really lacked social media skills, a domain name and a Facebook forum later I had the ability to outreach to folk and begin campaigning.

I started by speaking to neighbours I new in person, however it’s a big development so I probably only knew 20percent of the folks in the development. Hyperoptic require residents to register interest on their page, and have a very transparent tracker.  To assist I was sent marketing flyers and materials, which allowed me to do a mail drop.  I took the basic materials, and made them a bit more personal by branding and explaining a few things on an accompanying letter.  I mail dropped them in early September, and by the end of that same month we were showing the adequate number of registrations to move forward.

Hyperoptic were true to their word and surveyed the building, reporting back that they’d be able to fit the service with no issues.  The only fly in the ointment was the lack of service hatches in the ceilings outside the units. Hyperoptic offered a solution of installing these hatches and picking up the cost. (The truth being that we should have had these in anyway).  As is typical we had the doubters who though that these small hatches would “spoil the look” but to be frank I never accepted that given that we have smoke detectors, lights and so forth already there.  Anyway, a vote sent out by the factor saw no significant objection and we were green light to get the way leave signed to get Hyperoptic in and fitting.

The internal cabling is high quality Cat6e, I’m not 100percent sure of the switch infrastructure but effectively the fitted network should be able to support 10gigs and beyond (technology permitting).  Cabinets were installed in the basement levels where the switches are housed, and cat6E cabling was run first below in the carparks, and then up through the 3 blocks of the building (10 storeys).  The install is first class, to the point where in a straw poll of folks visiting my house I said- do you notice anything? – to which the answer was – what?

Fibre install has been a bit of a bear, with the contracts (BT) wasting dates, and making delays, however we have the fibre into the basement, and jointing is to go ahead.   I’m already confident this service will have massive benefits to our residents.  To go from a 14meg internet connection which is beginning to struggle to support multiple over the top media services, to a symmetric 1gig service is going to be a huge change, and I’m going to blog about how it affects the day to day of what and how we utilise media.   Stay tuned for more articles.