Archive for the ‘RAID’ Category

Fitting and AOC-USAS-L8i in a PCIe slot (UIO to PCIe)

One of the recent server upgrades called for the purchase of raid controller cards. I use software raid in Linux for its versatility and the L8i controllers can perform in hba (Host Bus Adapter) mode. These cards ship with Supermicro’s IT mode firmware which essentially lets all of the drives show up independently in linux.

Before I could see all that, I needed to get these cards into my case. Don’t be too upset when you first try to slide this card into your case and mobo (I have a Norco 4220 and Gigabyte EP45-UD3P) they will not fit at all. It appears as if the bracket is off on the Y axis by about a quarter inch, this is because these cards are UIO form factor.

Establishing my frame of reference

Establishing my frame of reference

This can easily be resolved with some longer screws and nylon spacers. Be sure to use the original brackets as buying new brackets was really hard to figure out (If anyone knows the exact bracket for this then please let me know).

Using quarter inch nylon spacers for number ten machine screws (need to verify)

Using quarter inch nylon spacers for number ten machine screws (need to verify)

We used two spacers on each of the ‘posts’, it appeared that this resolved the issue as we got a good solid fit for both of the cards.

RAID Monitoring with MDADM, Email using SSMTP and Google Apps

Recently I performed a large upgrade to my raid file-server, the information being stored is much more critical at this point in time and I have chosen to step up the game in four ways:

  1. Move from on-board Intel controller to dual LSI L8i 8channel hba controllers
  2. Move from raid5 to raid6
  3. Install an APC UPS and monitor it with apcupsd
  4. System monitoring with email alerts via mdadm and Google SMTP

Software raid tool mdadm has monitoring functionality that is easily configured through the /etc/mdadm/mdadm.conf file. You simply need to specify an email address under the MAILADDR property. I would suggest to leave this as root, because with ssmtp you are going to set the email address for everything routed to root.

The difficult part of getting email setup is configuring a MTA (Mail Transfer Agent). I searched for quite a while on how to get this setup. My initial impression was that I would have to host my own via postfix or some other alternative. I was happy to find that I could use a much more lightweight solution with ssmtp and an email I created from my google apps account.

Install ssmtp

sudo apt-get install ssmtp

Configure ssmtp via its config file /etc/ssmtp/ssmtp.conf

# Config file for sSMTP sendmail
#
# The person who gets all mail for userids < 1000
# Make this empty to disable rewriting.
root=serveremailaddress@yourgoogleappsdomain.tld

# The place where the mail goes. The actual machine name is required no
# MX records are consulted. Commonly mailhosts are named mail.domain.com
mailhub=smtp.gmail.com:587

# Where will the mail seem to come from?
#rewriteDomain=

# The full hostname
hostname=servername.yourgoogleappsdomain.tld

# Are users allowed to set their own From: address?
# YES – Allow the user to specify their own From: address
# NO – Use the system generated From: address
#FromLineOverride=YES

UseSTARTTLS=YES
UseTLS=YES
AuthUser=serveremailaddress@yourgoogleappsdomain.tld
AuthPass=password

Now for a test of ssmtp, create a test file with some text in it. My test file was called ‘test’:

ssmtp youremail@yourgoogleappsdomain.tld < test

Test mdadm

sudo mdadm –monitor –scan –test

Everything should be set to go now, hopefully you wont ever need to be notified of a failure.

Known Issue

Using ssmtp with Google’s smtp is great, however if you use special characters in your email password ssmtp will not be able to authenticate. I ran into this and saw the following error:

ssmtp: Authorization failed (454 4.7.0 Cannot authenticate due to temporary system problem. Try again later. 14sm88672bwz.5)

This was promptly resolved by my choosing a password without special characters.

RAID gets Revisited (TLER and the WDTLER utility)

I have a friend that I talk about computer parts and prices with non stop, he spends a lot of time down in the trenches with enthusiasts and keeps his finger close to prices on almost all PC components. Recently he let me know that 500GiB Western Digital hard drives (WDC500AAKS) were going used for about $50. My original array was built out of 6 of these drives, and brand new 1TiB drives are hovering around $100. So a couple of fedex boxes later I am the new proud owner of some 1TiB drives.

I have heard horror stories about these drives regarding RAID arrays, with them dropping out for no reason and causing the array to degrade and rebuild. Looking a little further, in particular the newegg reviews, I found that by enabling TLER (Time-Limited Error Recovery) all of the issues with RAID on these drives are solved. In fact one of the only major differences between the Caviar line of HDDs from Western Digital and the RE line is this TLER feature. Lucky for the poor college kids in the computing crowd Western Digital makes a tool named WDTLER that will enable or disable TLER on Western Digital HDDs.

TLER exists because there are sometimes conflicts in whether the error handling should be undertaken by the HDD or the RAID controller, if TLER is not enabled the drive can be marked as unusable and cause significant performance degradation. With TLER enabled the HDD will wait for the RAID controller to resolve errors up to the amount of time that has been set. In my case Ihave set the drives to their recommended RAID times of 7 seconds.

(more…)

Install (Set up) RAID with MDADM (Software Raid)

I am obsessed with disk space, and with that comes and obsession with redundancy. It is a fact that the hard disk drives you purchase will only work for a variable amount of time. Now this might be such a long time that you will upgrade/replace and never have a drive failure, but if you have ever had an unexpected drive failure and lost information then you know how terrible of an experience it is.

I need about 1.5 TiB to be comfortable with the amount of current bits I have, but I had a couple of WD 500AAKS in a machine alread and figured that I would max out the sata ports on a motherboard and use that machine as a dedicated file silo.

For my purposes I have chosen to run RAID 5 so that I can take maximum advantage of my 5 drives storage space and still have a redundant parity.

(more…)