«608 »
  • Post
  • Reply
DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

balakadaka posted:

Just a general "how dumb is this idea" question:

am I nuts for wanting to build a 2.5" 4-bay NAS, putting in 4x WD Blue or Blacks and setting to RAID 10?

I'd like to do a mix of iSCSI targets for a VM lab, and also have DLNA for some media. I like the idea of a smaller array to someday build one out of SSD's (but is still too rich for me now)
Would it work? Sure. Is there a reason you're looking at RAID 10 instead of RAID 5, though? 10 would give you a drive's less usable space, and (in theory) be slower at writes, while only being a bit faster on reads, and doesn't really give you substantially better fault-protection, either.

nickhimself
Jul 16, 2007

I GIVE YOU MY INFO YOU LOG IN AND PUT IN BUILD I PAY YOU 3 BLESSINGS


Don Lapre posted:

Now run an xbmc SQL database off the synology, and sickbeard, and sabnzbd, and...

Question about sabnzbd, though maybe it isn't applicable. Pretty much everything I'm seeing that discusses usenet groups says you need a monthly service to use for group accessing. Is that right? I mean, if doing that is the difference between a $120~ cable bill and a $45~ internet bill + $whatever usenet runs me the benefit is still there; I just want to make sure I'm going the right route before I do anything.

I will say though, even now as it stands, this NAS has been so amazing. That little android system I got for my bedroom tv streams in xbmc from the network well enough to make it worth its price. It immediately worked with my wireless Logitech KB+M system too, so that was icing on the cake. Sure, it could be a little faster or better but for 53 dollars, it works and hasn't crashed or lost connection during playback. Can't say the same for that Roku HD system that ran me $100 or whatever it cost last year.

deimos
Nov 30, 2006

Forget it man this bat is whack, it's got poobrain!


balakadaka posted:

Just a general "how dumb is this idea" question:

am I nuts for wanting to build a 2.5" 4-bay NAS, putting in 4x WD Blue or Blacks and setting to RAID 10?

I'd like to do a mix of iSCSI targets for a VM lab, and also have DLNA for some media. I like the idea of a smaller array to someday build one out of SSD's (but is still too rich for me now)

If you're going this way, I'd use 7K4000 (4TB) deskstars, those things are slightly slower (small file read is faster, small file write is considerably slower) but are also slightly cheaper than the equivalent WD Black. If you can manage it, you can use ZFS to add redundancy instead of losing half your storage to RAID 10.

Or hell, if you can deal with a remote chance of losing it all to an FS failure you can run btrfs. Anecdotally I've not once had an issue with btrfs, even having unplugged my port multiplying enclosure during operation a few times. It's not row-of-nines ready, but for my usage (something similar to yours) it seems perfectly capable.

DrDork posted:

Would it work? Sure. Is there a reason you're looking at RAID 10 instead of RAID 5, though? 10 would give you a drive's less usable space, and (in theory) be slower at writes, while only being a bit faster on reads, and doesn't really give you substantially better fault-protection, either.

RAID 5 is slower at both reads (RAID 10 = theoretical 4x speed) and writes (RAID 10 = theoretical 2x speed), unless you have an amazing controller in which case it's still slower at reads and could potentially match write speed.

deimos fucked around with this message at 18:00 on Feb 25, 2013

Don Lapre
Mar 28, 2001

If you're having problems you're either holding the phone wrong or you have tiny girl hands.


nickhimself posted:

Question about sabnzbd, though maybe it isn't applicable. Pretty much everything I'm seeing that discusses usenet groups says you need a monthly service to use for group accessing. Is that right? I mean, if doing that is the difference between a $120~ cable bill and a $45~ internet bill + $whatever usenet runs me the benefit is still there; I just want to make sure I'm going the right route before I do anything.

I will say though, even now as it stands, this NAS has been so amazing. That little android system I got for my bedroom tv streams in xbmc from the network well enough to make it worth its price. It immediately worked with my wireless Logitech KB+M system too, so that was icing on the cake. Sure, it could be a little faster or better but for 53 dollars, it works and hasn't crashed or lost connection during playback. Can't say the same for that Roku HD system that ran me $100 or whatever it cost last year.

While its possible your cable provider gives you some usenet access, its unlikely in tyool 2012. Read up on the usenet thread
http://forums.somethingawful.com/sh...hreadid=3409898

Ziploc
Sep 19, 2006
MX-5

How do you choose between the 3 DS4XXX Synology devices?

I would be storing a large amount of photo/video that I've shot and edited. My music, and my ripped movie collection. Maybe eventually using it as a surveillance hub.

I wonder how it would handle video/photo editing using the NAS as a scratch disk or media repository.

I don't mind spending a bit more if it will extend the life/usefulness of the device.

http://www.synology.com/products/co...ompare_show_top

I like the idea of having a 4 bay device as I only see me running out of space in a good hurry shooting to much HD stuff.

Porkchop Express
Dec 24, 2009

Ten million years of absolute power. That's what it takes to be really corrupt.


ClassH posted:

Let us know how this works. I run plex off of my home server but I have a quad core as it sometimes is streaming 1080p movies to multiple places as once and it takes a bit of beef to transcode those.

Well I hadn't planned on doing any transcoding, just streaming stuff that will show up in the nice GUI that Plex has. I won't be watching videos on my iPad or any other device like that.

Don Lapre
Mar 28, 2001

If you're having problems you're either holding the phone wrong or you have tiny girl hands.


Ziploc posted:

How do you choose between the 3 DS4XXX Synology devices?

I would be storing a large amount of photo/video that I've shot and edited. My music, and my ripped movie collection. Maybe eventually using it as a surveillance hub.

I wonder how it would handle video/photo editing using the NAS as a scratch disk or media repository.

I don't mind spending a bit more if it will extend the life/usefulness of the device.

http://www.synology.com/products/co...ompare_show_top

I like the idea of having a 4 bay device as I only see me running out of space in a good hurry shooting to much HD stuff.

A nas probably isn't going to be good as a scratch disk.

I have the DS413j which is the slowest of the 2012 models and it works fine for file storage, streaming to xbmc, running sabnzbd/itunes server/sickbeard/transmission/sql database.

caberham
Mar 18, 2009

by Smythe


Grimey Drawer

Hey guys, I really want to go overkill and just be done with storage. I tried searching for the forums, but does anyone know where I can get tips on setting up a basic home/soho server? I really just want my computer to load games and local edits for photography, all my docs, final pictures, or videos for me, my folks or whatever would be stored in the central repository.

Since I am spending so much money on drives on a mostly media/usenet/server. I want to get some sort of Transcode function (I guess that PLEX?) for different devices and set up a subsonic 3G streaming server. If I'm already opting for a i3 for beefier transcoding, Is it a bad idea to also slap on a LDAP/OpenVPN/Mumble/Random Game in it? Or whatever else services I can think of. I do get access to :alert:1000 Mb/s :alert: home connection, so might as well use it

I'm also really tempted to set up some sort of private version of drop box or some file colloboration with version history like Alfresco


PCPartPicker part list / Price breakdown by merchant / Benchmarks

CPU: Intel Core i3-3220 3.3GHz Dual-Core Processor ($124.71 @ DirectCanada)
Motherboard: ASRock B75 PRO3-M Micro ATX LGA1155 Motherboard ($79.99 @ Newegg Canada)
Memory: Corsair Vengeance 16GB (2 x 8GB) DDR3-1600 Memory ($86.99 @ Newegg Canada)
Storage: Sandisk 64GB 2.5" Solid State Disk ($69.33 @ DirectCanada)
Storage: Western Digital Red 3TB 3.5" 5400RPM Internal Hard Drive ($149.79 @ DirectCanada)
Storage: Western Digital Red 3TB 3.5" 5400RPM Internal Hard Drive ($149.79 @ DirectCanada)
Storage: Western Digital Red 3TB 3.5" 5400RPM Internal Hard Drive ($149.79 @ DirectCanada)
Storage: Western Digital Red 3TB 3.5" 5400RPM Internal Hard Drive ($149.79 @ DirectCanada)
Storage: Western Digital Red 3TB 3.5" 5400RPM Internal Hard Drive ($149.79 @ DirectCanada)
Storage: Western Digital Red 3TB 3.5" 5400RPM Internal Hard Drive ($149.79 @ DirectCanada)
Storage: Western Digital Red 3TB 3.5" 5400RPM Internal Hard Drive ($149.79 @ DirectCanada)
Wired Network Adapter: Intel EXPI9402PT 10/100/1000 Mbps PCI-Express x4 Network Adapter ($164.99 @ Newegg Canada)
Case: Fractal Design Define R4 (Titanium Grey) ATX Mid Tower Case ($109.99 @ Memory Express)
Power Supply: SeaSonic S12II 380W 80 PLUS Bronze Certified ATX12V Power Supply ($59.99 @ Newegg Canada)
Total: $1744.52
(Prices include shipping, taxes, and discounts when available.)
(Generated by PCPartPicker 2013-02-25 12:05 EST-0500)

balakadaka
Jun 30, 2005

robot terrorists WILL kill you

deimos posted:

If you're going this way, I'd use 7K4000 (4TB) deskstars, those things are slightly slower (small file read is faster, small file write is considerably slower) but are also slightly cheaper than the equivalent WD Black. If you can manage it, you can use ZFS to add redundancy instead of losing half your storage to RAID 10.

Or hell, if you can deal with a remote chance of losing it all to an FS failure you can run btrfs. Anecdotally I've not once had an issue with btrfs, even having unplugged my port multiplying enclosure during operation a few times. It's not row-of-nines ready, but for my usage (something similar to yours) it seems perfectly capable.

I kinda want to go 2.5" - I know it won't be as fast as a desktop drive, but the WD Blue 1TB for ~$90 is pretty interesting to me. If I stuff those drives into a Qnap or Synology, can I use ZFS instead of a straight RAID setup? That's undiscovered territory for me, but I don't know if using ZFS I'll get the benefits of RAID 10 speed

evilweasel
Aug 24, 2002
Probation
Can't post for 23 days!


I was going to build a NAS, then realized I've got a giant desktop with four open 3.5" platter spots so I might as well save the money and shove a bunch of platters in there instead.

I'm going to be starting off with 2 3tb Reds, and then adding more as needed. I'm looking to use this as a NAS for serving videos to an HTPC that's elsewhere on the network (with an ivy bridge i3 processor, so it's not short on processor power). I intend to dedicate one of the 3tb drives to parity data, but I'd like to be able to add new hard drives to the mix without much hassle. The data is currently on three 1tb hard drives from my old system, that I'll be moving over to the new drives (the old system is fairly broke at this point, so I'll probably just put them one by one in the new system and copy the files).

What's the best solution for what I'm looking to do? I'm thinking I mostly want a software solution like flexraid, but I'm really not all that clear on the differences between various systems and what's going to be best for my needs.

Don Lapre
Mar 28, 2001

If you're having problems you're either holding the phone wrong or you have tiny girl hands.


evilweasel posted:

I was going to build a NAS, then realized I've got a giant desktop with four open 3.5" platter spots so I might as well save the money and shove a bunch of platters in there instead.


See the deal with this is that everyone now relies on your computer to be up and functional. The nice thing about a dedicated nas is you stick it in a closet and never worry about it.

evilweasel
Aug 24, 2002
Probation
Can't post for 23 days!


Don Lapre posted:

See the deal with this is that everyone now relies on your computer to be up and functional. The nice thing about a dedicated nas is you stick it in a closet and never worry about it.

My desktop computer is basically always up and functional, and I live in an apartment so I don't really have a closet to spare (and "everyone" is me).

caberham
Mar 18, 2009

by Smythe


Grimey Drawer

evilweasel posted:

My desktop computer is basically always up and functional, and I live in an apartment so I don't really have a closet to spare (and "everyone" is me).

Yes, somewhere in the link, somewhere posted 6 Red drives or something. If there is a dummy guide to "Build your goon server" that would be awesome. Looking at http://www.newegg.com/Product/Produ...N82E16817994028 these removable harddrive backplane right now. Yes it's bit of an overkill but I think to start a empty shell and then sticking in some USB nix OS and turning your old drives into a mish mash dump sounds fun.

I also found that lianli does a budget version of the hot swappable backplane (I can stick a 120mm fan!), but without the exterior shell and just the connector for a fraction of the price. It's too bad that most server backplanes are noisy as hell using ramped up 80mm fans Getting 2 of those would solve all my storage concerns For 2 years.

What if I just set up a dumb NAS and stuff it in the closet and then build a separate server for VPN/Transcode/File/Privleges/Etc?

crm
Oct 24, 2004



I've got an old system that I want to overhaul to run as a NAS.

It's an Antec P180
ASUS A8N32-SLI Deluxe
AMD Opteron 165
WD Blue 250GB.
Corsair 650W PSU

The motherboard / cpu still work but they are pretty old.

I'd like at least 9 (preferably 12) TB of space, in at least RAID5.

I don't want to use FreeNAS - I run a bunch of custom stuff that won't install.

Any recommendations?

edit: what's the best linux OS to run this all off of? I don't need all the GUI nonsense that ubunutu provides.

crm fucked around with this message at 19:25 on Feb 25, 2013

yomisei
Mar 18, 2011



Get the Seasonic G-Series 360W instead and don't forget to search for some PATA/SATA->2xSATA power adapters. If you want to save a bit more money, ebay some used Intel Pro 1000 Dual Port or HP NC360T.

caberham posted:

What if I just set up a dumb NAS and stuff it in the closet and then build a separate server for VPN/Transcode/File/Privleges/Etc?

The NAS duty doesn't consume a lot of processing power and only requires case space and sata ports, just integrate it all in one.

There is no dummy guide per se, but what you picked is basically the default (Intel) variant of a modern self-made server with hardware accelerated transcoding.

The Gunslinger
Jul 24, 2004

Do not forget the face of your father.

Fun Shoe

evilweasel posted:

I was going to build a NAS, then realized I've got a giant desktop with four open 3.5" platter spots so I might as well save the money and shove a bunch of platters in there instead.

I'm going to be starting off with 2 3tb Reds, and then adding more as needed. I'm looking to use this as a NAS for serving videos to an HTPC that's elsewhere on the network (with an ivy bridge i3 processor, so it's not short on processor power). I intend to dedicate one of the 3tb drives to parity data, but I'd like to be able to add new hard drives to the mix without much hassle. The data is currently on three 1tb hard drives from my old system, that I'll be moving over to the new drives (the old system is fairly broke at this point, so I'll probably just put them one by one in the new system and copy the files).

What's the best solution for what I'm looking to do? I'm thinking I mostly want a software solution like flexraid, but I'm really not all that clear on the differences between various systems and what's going to be best for my needs.

Since you've ruled out a dedicated NAS device it depends on what your needs are. Is it going to be mostly large, static video files? If so then ZFS stuff is overkill and it doesn't really do single drive expansion so you can go with a snapshot raid setup or the traditional linux mdadm + lvm raid 5 route. The SnapRAID page actually has a pretty good comparison breakdown. My latest file server is running Windows instead of *nix so I tried several of the snapshot raid utilities and some of the USB distro ones before that, of them Flexraid is my favorite in terms of features. SnapRAID will do what you need with some scheduling setup if you don't require storage pooling. FlexRaid and UnRAID both cost money too so there's that.

deimos
Nov 30, 2006

Forget it man this bat is whack, it's got poobrain!


Don Lapre posted:

See the deal with this is that everyone now relies on your computer to be up and functional. The nice thing about a dedicated nas is you stick it in a closet and never worry about it.

My homebrew NAS based on an ITX board lives in my garage (not really a garage, but essentially "outdoors"), runs off a USB stick and stays on 24/7 without issue*, these are way worse conditions temperature and humidity wise than a closet.

*: one issue did happen when I dropped the itx case about 4 feet and it died, but I hardly blame the environment.

Don Lapre
Mar 28, 2001

If you're having problems you're either holding the phone wrong or you have tiny girl hands.


deimos posted:

My homebrew NAS based on an ITX board lives in my garage (not really a garage, but essentially "outdoors"), runs off a USB stick and stays on 24/7 without issue*, these are way worse conditions temperature and humidity wise than a closet.

*: one issue did happen when I dropped the itx case about 4 feet and it died, but I hardly blame the environment.

I was using throw it in the closet as an example of, "you dont ever touch it"

deimos
Nov 30, 2006

Forget it man this bat is whack, it's got poobrain!


Don Lapre posted:

I was using throw it in the closet as an example of, "you dont ever touch it"

Whoops, completely lost the meaning of what you were saying.

Avenging Dentist
Oct 1, 2005

oh my god is that a circular saw that does not go in my mouth aaaaagh

I'm planning on getting a Synology DS413 to act as a media server and for backups, and I think I have things mostly figured out. Am I missing anything? I'd like this to be fairly hands-off/headache-free, since nothing sucks more than realizing that my whole afternoon is going to be devoted to fixing something that broke at random. Specific questions I have below are highlighted with this little asshole:

Goals
  • Media server (for XBMC and Windows/Linux desktops)
  • Local backup target (mainly for Win7 Pro)
  • (future?) NZB/torrent downloader

Plan
  • Hardware
    • Synology DS413
    • 4x WD Red 2TB ( Maybe 3TB would be smarter? I mainly picked 2TB to minimize headaches from rebuilding when a drive dies. Also, should I get a cold spare?)
    • What's a sane RAID config? I'm thinking one of RAID 5, RAID 6, or RAID 10. My main goal is minimizing the amount of work I need to do to fix shit.
    • I probably want a decent UPS to prevent the NAS from getting fucked up due to a power outage. I really just want something that will make sure the NAS has a minute or two of power so it can shut itself down safely. Any ideas?
  • Backup Strategy
    • Backup desktops to the NAS (automatic, weekly)
    • Backup important stuff on the NAS (mainly media files) to other places:
      • Local backup to an external 1TB drive (manual, monthly-ish)
      • Networked backup to Amazon Glacier (automatic weekly/nightly?)
    • Backup really important stuff on desktops (i.e. password databases, SSH keys) to USB sticks and something like Spideroak

Incessant Excess
Aug 15, 2005

Cause of glitch:
Pretentiousness


Don Lapre posted:

I was using throw it in the closet as an example of, "you dont ever touch it"

You can actually throw it in a closet tho, right? Like you don't have to worry about heat or air circulation?

Don Lapre
Mar 28, 2001

If you're having problems you're either holding the phone wrong or you have tiny girl hands.


Biggest Faggot Ever posted:

You can actually throw it in a closet tho, right? Like you don't have to worry about heat or air circulation?

Yes, a closet should be large enough that its not an issue.

deimos
Nov 30, 2006

Forget it man this bat is whack, it's got poobrain!


Avenging Dentist posted:

I probably want a decent UPS to prevent the NAS from getting fucked up due to a power outage. I really just want something that will make sure the NAS has a minute or two of power so it can shut itself down safely. Any ideas?

Literaly anything name-brand (APC) 300 VA or so will do it, just make sure it has a USB connector.

Don Lapre
Mar 28, 2001

If you're having problems you're either holding the phone wrong or you have tiny girl hands.


If you are extra paranoid then turn off write caching.

theperminator
Sep 16, 2009

by Smythe


Fun Shoe

Lesson learnt today: double-check your commands before hitting enter
I tried changing my array from Raid 5 with 3 active drives and 1 spare, accidentally told it to grow to 6 devices...

theperminator fucked around with this message at 04:21 on Feb 26, 2013

necrobobsledder
Mar 21, 2005
Lay down your soul to the gods rock 'n roll

Nap Ghost

Avenging Dentist posted:

Goals
  • (future?) NZB/torrent downloader
The CPU and RAM on NASes tend to be a bit underequipped to handle a lot of torrents, not to mention typically having meh torrent downloaders, I wouldn't plan on using it for heavy downloading but totally fine for a few incidental downloads or light usage overall.

quote:

    ( Maybe 3TB would be smarter? I mainly picked 2TB to minimize headaches from rebuilding when a drive dies. Also, should I get a cold spare?)
  • What's a sane RAID config? I'm thinking one of RAID 5, RAID 6, or RAID 10. My main goal is minimizing the amount of work I need to do to fix shit.
Depending upon anticipated capacity requirements down the road (in 3 years is there a possibility you'll have to store more than n TB? Multiply n by 25% for how much you should buy right now in usable storage) you may need a RAID 6 (performance is not a big concern for you, you're not running VMs) with a cold spare. At minimum, you should consider a RAID5 with hot spare, then a RAID6 with cold spare. That'll bring you up to possibly needing a 6-drive array, which is rather expensive of capacity for NAS devices. 3TB drives are a good value right now and since their platter configurations are newer, they should have lower individual drive failure rates than 2TB drives from, say, 2 years ago.

...and this is why I just built an OpenSolaris box years ago, chucked a bunch of drives at it, and stopped caring... until I had to go do my stupid home Hadoop cluster project.

Don Lapre
Mar 28, 2001

If you're having problems you're either holding the phone wrong or you have tiny girl hands.


necrobobsledder posted:

The CPU and RAM on NASes tend to be a bit underequipped to handle a lot of torrents, not to mention typically having meh torrent downloaders, I wouldn't plan on using it for heavy downloading but totally fine for a few incidental downloads or light usage overall.


A synology can run transmission no sweat.

Avenging Dentist
Oct 1, 2005

oh my god is that a circular saw that does not go in my mouth aaaaagh

necrobobsledder posted:

Depending upon anticipated capacity requirements down the road (in 3 years is there a possibility you'll have to store more than n TB? Multiply n by 25% for how much you should buy right now in usable storage) you may need a RAID 6 (performance is not a big concern for you, you're not running VMs) with a cold spare.

I can't imagine needing more than 4 TB, so my plan was to shoot for 6 TB usable space. That would fit with 4x 3TB drives in RAID 6, though it's a bit galling to spend fully 50% of my space on parity blocks. As a result, I am tempted to build my own system from scratch. However, unless I decide I want more than 4 disks in the near future, I doubt I'd be saving much money (6-bay Synologies are fucking expensive).

At some point (a few years down the line), I probably will build my own NAS, but I just set up an HTPC too, so I already have plenty of dicking around with computers in my near future.

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

Avenging Dentist posted:

At some point (a few years down the line), I probably will build my own NAS, but I just set up an HTPC too, so I already have plenty of dicking around with computers in my near future.
It's still worth considering a roll-your-own. A N40L gets you 4 bays, is pretty close to plug-and-play, and saves you $200+ compared to buying the DS413. And if you're feeling adventurous, you can jam up to 6 drives in there, at massive savings compared to a 6-bay Synology. Unless you're really sold on the Synology OS and can't stand the thought of spending an hour setting your own NAS up, I encourage you to consider other options.

yomisei
Mar 18, 2011


Avenging Dentist posted:

I can't imagine needing more than 4 TB, so my plan was to shoot for 6 TB usable space. That would fit with 4x 3TB drives in RAID 6, though it's a bit galling to spend fully 50% of my space on parity blocks. As a result, I am tempted to build my own system from scratch. However, unless I decide I want more than 4 disks in the near future, I doubt I'd be saving much money (6-bay Synologies are fucking expensive).

At some point (a few years down the line), I probably will build my own NAS, but I just set up an HTPC too, so I already have plenty of dicking around with computers in my near future.

Keep in mind that if you already have a HTPC, given that you can squeeze in the drives space and port wise, you can set up your raid there already.

Gism0
Mar 20, 2003

huuuh?

Finally got around to buying 3 more 3TB disks to complete the upgrade to my raid-z pool (had 2 x 3TB and 3 x 1.5TB up until this point), and today one of the disks I'm going to replace died so it looks like I was just in time! I've replaced the broken drive and am resilvering now. I was thinking about waiting a week or two between swapping the drives just in case two of them die at once, but I might just be adventurous..

Also re-silvering takes a long ass time normally, but now it's going backwards!

An hour ago:
code:
scan: resilver in progress since Tue Feb 26 17:23:45 2013
    267G scanned out of 6.70T at 247M/s, 7h36m to go
    53.4G resilvered, 3.89% done
Now:
code:
scan: resilver in progress since Tue Feb 26 19:15:05 2013
    224G scanned out of 6.70T at 243M/s, 7h46m to go
    44.7G resilvered, 3.26% done
Does the 'since' date changing mean it has restarted the process for some reason?

edit: hm, it's still constantly restarting. The restart time corresponds to loads of errors in kern.log:

code:
Feb 26 22:05:48 Goon kernel: [22799.432312] sd 5:0:0:0: [sdf]  
Feb 26 22:05:48 Goon kernel: [22799.432313] Add. Sense: No additional sense information
Feb 26 22:05:48 Goon kernel: [22799.432314] sd 5:0:0:0: [sdf] CDB: 
Feb 26 22:05:48 Goon kernel: [22799.432315] Write(10): 2a 00 00 5f f7 f8 00 00 c0 00
Feb 26 22:05:48 Goon kernel: [22799.432318] end_request: I/O error, dev sdf, sector 6289400
code:
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   100   100   006    Pre-fail  Always       -       767552
  3 Spin_Up_Time            0x0003   095   095   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       5
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   065   060   030    Pre-fail  Always       -       3241762
  9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       6
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       5
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       1
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   054   052   045    Old_age   Always       -       46 (Min/Max 28/48)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       4
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       5
194 Temperature_Celsius     0x0022   046   048   000    Old_age   Always       -       46 (0 26 0 0 0)
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       18
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       76626511527942
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       1294271152842
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       51605
Guessing this new disk is bad..

Gism0 fucked around with this message at 13:18 on Feb 26, 2013

crm
Oct 24, 2004



crm posted:

I've got an old system that I want to overhaul to run as a NAS.
...

I'd like at least 9 (preferably 12) TB of space, in at least RAID5.

I don't want to use FreeNAS - I run a bunch of custom stuff that won't install.

edit: what's the best linux OS to run this all off of? I don't need all the GUI nonsense that ubunutu provides.

Following up on myself

I'm planning on replacing the guts with ASUS P8B75-V and an i3-3220. (though if there's a better option, I'm all ears)

So the question is OS / raid solution.

How expensive would it be to go pure raid hardware?

What gives me the best options for growing the array? if I wanted to start with 3 x 3TB in RAID5 (or software equivalent) could I add 3 more disks in at a later point?

yomisei
Mar 18, 2011


crm posted:

Following up on myself

I'm planning on replacing the guts with ASUS P8B75-V and an i3-3220. (though if there's a better option, I'm all ears)

So the question is OS / raid solution.

How expensive would it be to go pure raid hardware?

What gives me the best options for growing the array? if I wanted to start with 3 x 3TB in RAID5 (or software equivalent) could I add 3 more disks in at a later point?

If you don't need the hardware transcoding abilities of the i3 GPU, you can downgrade to a Pentium G2120 or Celeron G1610, depending on your performance requirements. A controller card that is usually recommended is the IBM M1015, as it can be flashed extensively and ebayed for cheap. But since you want growing drives, a software raid like mdadm can give you this as you're already focused on Linux.

crm
Oct 24, 2004



yomisei posted:

If you don't need the hardware transcoding abilities of the i3 GPU, you can downgrade to a Pentium G2120 or Celeron G1610, depending on your performance requirements. A controller card that is usually recommended is the IBM M1015, as it can be flashed extensively and ebayed for cheap. But since you want growing drives, a software raid like mdadm can give you this as you're already focused on Linux.

What does mdadm provide over other software solutions (zfs, unpaid, flex raid, etc)?

And with either solution, if some piece of the non-disk hardware / software blows up, what's the chances to recovering from that? Like if the raid card dies or I need to reinstall the is running the software raid?

yomisei
Mar 18, 2011


crm posted:

What does mdadm provide over other software solutions (zfs, unpaid, flex raid, etc)?

I'm not particular invested in the availability of software raids, maybe this satisfies your question. As far as I know adding drives into a running software raid is usally a no-go, except for mdadm as I mentioned (there may be others out there).

crm
Oct 24, 2004



yomisei posted:

I'm not particular invested in the availability of software raids, maybe this satisfies your question. As far as I know adding drives into a running software raid is usally a no-go, except for mdadm as I mentioned (there may be others out there).

Can you add devices to the ZFS pool (or pools to the device?) I'm a little confused on how that works.

FISHMANPET
Mar 3, 2007

Sweet 'N Sour
Can't
Melt
Steel Beams


You can add new vdevs (disks or RAID sets) but you can't change the number of disks in a RAID set (for exampe, you can't turn a 4 disk RAIDZ vdev into a 5 disk RAIDZ vdev).

The Gunslinger
Jul 24, 2004

Do not forget the face of your father.

Fun Shoe

crm posted:

Can you add devices to the ZFS pool (or pools to the device?) I'm a little confused on how that works.

You can create additional vdevs but you can't expand existing ones. You could make another vdev and add that to the pool however. There was an experimental branch working on this but I haven't kept up with it. People should carefully plan out their home fileserver builds when using ZFS as future expansion is more difficult.

Edit: beaten

yomisei
Mar 18, 2011


crm posted:

Can you add devices to the ZFS pool (or pools to the device?) I'm a little confused on how that works.

As FISHMANPET stated, the raid entity (vdev) can't be grown by adding drives to it. Instead you add another vdev to the pool to increase capacity, but you are wasting space in each vdev for parity. Say you start with a 3 drive raid-z1, you gain the space of 2 and one redundancy. Next you add another 3 drive raid-z1 for the same 2 drive space and one redundancy for that particular vdev, but not a double parity for both vdevs, as they are separate. In contrast to this are the 6 drive raid-z1 with a capacity of 5 and parity of 1 or the 6 drive raid-z2 with a capacity of 4 and parity of 2, both better in capacity or parity when set up beforehand.

For the intent of growing a raid by adding drives over time and still keeping the same parity, mdadm is the better choice if you don't know exactly when, if and how you will grow the raid.

crm
Oct 24, 2004



Ok, seems that mdadm is the way to go unless I'm maxing out up front.

Are mdadm / zfs devices recoverable if you have to reinstall / move systems?

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply
«608 »