|
Moore's law says you're going to be wrong. I still remember thinking 100GB was more than I could ever want because who really needs images higher than 800x600 and video higher than 640x480 anyway?
|
![]() |
|
Imagine how my mind blew going from a 20MB hard drive to a 400MB one.
|
![]() |
Good point, but I'm pretty much always out of ports, I use my desktop for everything for the sake of convenience, I'd much rather have like 50TB without extra cards and still have a port or two for SSDs, fewer ports/drives/cables is better. 10TB is a lot of backup space too, not everybody just pools all their drives - I short-stroke part of two of my 7200rpm 5TBs for a steam partition, use another one for all my personal/important stuff to make it trivial to back up, etc.
|
|
![]() |
|
Straker posted:I short-stroke part of two of my 7200rpm 5TBs for a steam partition, use another one for all my personal/important stuff to make it trivial to back up, etc. ![]() Have SSDs not yet been invented on your planet?
|
![]() |
I have a 500GB SSD and also have like over a TB of steam shit installed that doesn't deserve expensive space, what are you talking about? it's still nice having it somewhere it can be read at like 300MB/sec...
|
|
![]() |
|
Straker posted:over a TB of steam shit installed All is clear now.
|
![]() |
this is the packrat thread ![]()
|
|
![]() |
|
Straker posted:this is the packrat thread Heh, I plan on just getting a 1 TB 840 Evo and calling it good. If I end up needing more than 1 TB for windows+steam, then I'll probably just symlink it to another SSD. SSD load speeds are so nice. Here's hoping some of those cyber-monday deals are on storage.
|
![]() |
|
Methylethylaldehyde posted:Heh, I plan on just getting a 1 TB 840 Evo and calling it good. If I end up needing more than 1 TB for windows+steam, then I'll probably just symlink it to another SSD. Steam can install to multiple locations now - I have about 200GB on an old SSD (the games I play currently/the games most affected by SSD speeds) , while the other 1TB+ is on a "slow" drive.
|
![]() |
Origin too, or well, you can choose your SSD, install stuff you want on it, then switch to another folder and the original games will stay wherever you installed them. I do this on my laptop where I have to cope with 250GB + 2TB ![]()
|
|
![]() |
|
I have my stuff on my NAS, which is essentially a RAID-10. Four spindles reduce seek times a damn lot, as does ZFS' caching and prefetcher. iSCSI over Gigabit seems sufficient enough. Some games just don't dig Samba.
Combat Pretzel fucked around with this message at 23:20 on Oct 18, 2014 |
![]() |
|
Today I'm copying 3tb of media from a degraded (1 disk down) raidz2 array of ancient 7200rpm desktop drives to a brand new array of WD Reds. Pray for me, goons
|
![]() |
|
gggiiimmmppp posted:Today I'm copying 3tb of media from a degraded (1 disk down) raidz2 array of ancient 7200rpm desktop drives to a brand new array of WD Reds. Pray for me, goons I would probably have let the array resilver before the copy if I could spare the hardware. I think you'll be fine either way though.
|
![]() |
|
Eh, it's z2. He can take two more disk losses before data loss occurs, and 3TB over a gigabit network is only about 8 hours. It's relatively unlikely anything will go wrong.
|
![]() |
|
G-Prime posted:Eh, it's z2. He can take two more disk losses before data loss occurs, and 3TB over a gigabit network is only about 8 hours. It's relatively unlikely anything will go wrong. The drive that failed was 7+ years old with ~6.5 years powered on according to SMART and the second oldest isn't far behind (remember the first gen 1.5tb seagates that had firmware problems?). The other 3 are relatively young, which is to say they're a newer revision just barely out of warranty. I should be ok but I'm tempting Murphy's law ![]() Once this finishes I'll probably retire the other really old one before it has a chance to fuck me and maybe use the remaining 3 in RAID1 plus a hot spare for iSCSI or local crashplan storage or something. poverty goat fucked around with this message at 23:17 on Oct 19, 2014 |
![]() |
|
gggiiimmmppp posted:Today I'm copying 3tb of media from a degraded (1 disk down) raidz2 array of ancient 7200rpm desktop drives to a brand new array of WD Reds. Pray for me, goons ![]()
|
![]() |
|
Looking for a solid NAS device and some drives to go along with it. I'll be hosting a virtual environment for cert study as well as streaming media. The Synology boxes look pretty popular paired with the WD Red drives.
|
![]() |
|
necrobobsledder posted:Like my investments, I diversify my hard drives. On the topic of drive sourcing, is it worth it to try and get drives from different runs or at least different stores for a new build? In the next month or so I'm planning to get an N54L and fill it with 4x3TB WD Reds in RAID-Z2. It doesn't seem like a big deal to me to set up a degraded array with one missing disk and run for a month or two before adding the last disk in the interest of diversification. Is that a reasonable approach, or more effort than the realistic gains?
|
![]() |
|
I don't think you can even initialize a RAID-Z array in a degraded state, so you'd have to initialize it, then pull a disk, but what's the point of that then? The array in the meantime would be basically worse than a RAID-0 just on the basis wasted time and space on the parity stripes on these disks. Degraded arrays just plain perform worse than when they're operating normally in my experience as well. Diversifying hard disk sources is just about spreading risk around both in terms of locality and temporality, it just makes whatever risks you're taking less likely for these supposedly independent events from occurring clustered together. Note that I've had 4 failures in several years - if I ran degraded fairly often, I'd have lost 33% of my data randomly chosen 4 times now. That's not what you want to risk now in that almost certain event, do you? If it's worth anything, the most I plan to diversify drives going forward is to buy drives from two merchants when building my arrays out and with RAIDZ2 standard because following hard drive prices like I used to is a serious, unenjoyable waste of my time nowadays.
|
![]() |
|
I started with freeNAS but went to ubuntu for a while, since it has ok zfs support now, mostly because there wasn't a virtualbox template for freeNAS back then and I wanted to run a lightweight tinyxp VM with my old fucking portable utorrent 2.2.1 in it so I can keep seeding my back catalog without having to tell a new client where to look for 1000 torrents. It never fucking worked right in the latest virtualbox under ubuntu- I tried both NAT and bridged and I could never get port forwarding to work on more than an intermittent basis, network performance was generally spotty, and I couldn't get it to use the RSS downloader to work for some reason. I've moved back to freeNAS to try the virtualbox template and inside of an hour I've got tinyxp installed and running, with port forwarding, RSS downloader and all working immediately once configured and the basic NAS functionality (ZFS/CIFS) is noticeably faster than in linux. ![]() Now I really need more RAM but if I'm going to spend money on RAM for this machine I need to just replace the 8 gigs I've got with 16 gigs of ECC.
|
![]() |
|
I'm looking to buy a shiny new board with ECC support and tons of RAM, what's the best board for the job?
|
![]() |
|
Define "tons" - which side of 32GB do you want to be on?
|
![]() |
|
IOwnCalculus posted:Define "tons" - which side of 32GB do you want to be on? The 64G side
|
![]() |
|
Grab any of Supermicro's new X10 E5V3 boards, then. If you're fine with single-socket they've got four ATX options, including two with built-in LSI3008 SAS controllers. If you really want to burn a shitload of money they have even more dual-socket options.
|
![]() |
|
necrobobsledder posted:If it's worth anything, the most I plan to diversify drives going forward is to buy drives from two merchants when building my arrays out and with RAIDZ2 standard because following hard drive prices like I used to is a serious, unenjoyable waste of my time nowadays. Yeah that's helpful, thanks. I think I'll go with your approach since RAID-Z2 was the plan anyway. I had a feeling the idea was more of a make-work project than a reasonable precaution. FYI, for initialization, I was thinking of this trick I saw with a sparse file as a dummy drive: https://forums.freenas.org/index.ph...migration.7748/ However, I don't have any personal experience with FreeNAS/ZFS, just spent some time following this thread and reading up.
|
![]() |
|
I might get to build a custom SATA backplane for an in-house IT storage project we're playing with ![]()
|
![]() |
|
I feel like anyone who's looking to buy a E5 v3 and 64GB of DDR4 for a NAS/file server at this point maybe should reconsider their needs and whether it's best served by a self-built NAS... unless it's somebody else's money.
|
![]() |
|
movax posted:I might get to build a custom SATA backplane for an in-house IT storage project we're playing with A backplane that uses a SFF8087 style connector and does the 1->4 breakout on the PCB of the backplane, instead of the cables that fan out themselves. Daisy-chainable power connections, maybe? 12V->5V/3.3V within the backplane so it can be powered by a single six/eight pin PCIe connector?
|
![]() |
|
movax posted:I might get to build a custom SATA backplane for an in-house IT storage project we're playing with You still working at that super awesome place?
|
![]() |
|
IOwnCalculus posted:A backplane that uses a SFF8087 style connector and does the 1->4 breakout on the PCB of the backplane, instead of the cables that fan out themselves. This is what the IT guy asked me for yeah -- he just brought over a Monoprice SFF-8087 to 4x SATA connector and was like "I just want to make this go away ![]() The drives are 5V only (2.5") so I'm thinking of either putting Molex connectors on that get custom harnessed to a PSU with a healthy 5V rail -- don't really want to cram a switching regulator onto the backplane there, maybe in future generations. I suppose I should NC the 3V3 and 12V pins on the backplane, or at least double-check with our drive vendors to see how the drives behave without those rails. Thermopyle posted:You still working at that super awesome place? ![]() ![]()
|
![]() |
|
Sounds like fun. It'd definitely jack up the price but in an ideal world, a SAS expander too. Not that I need one since between my motherboard and M1015 I've got four SFF8087 connectors to play with, plus six native SATA ![]()
|
![]() |
|
Has anyone tried OpenZFS on OS X? It would be great to eliminate the server and go straight to directly attached storage. This may be the mother load.
|
![]() |
|
Newegg has a 5 pack of HGST 4TB NAS drives for $800 in the shell shocker this morning
|
![]() |
|
Speaking of rolling the dice with RAIDZ1... I have now had two disk failures only 2 weeks apart from each other. I have a spare drive onhand thankfully, but it's kind of scary how close together these failures happened. However, I'll note that they were 2 from the same order that I made 4 years ago.
|
![]() |
|
But you have backups right?
|
![]() |
|
I have partial backups consisting of stuff I can't replace easily, so it's not a devastating loss if that were to happen. Still sucks to have to spend the time getting stuff restored from backup anyway.
|
![]() |
|
necrobobsledder posted:I have partial backups consisting of stuff I can't replace easily, so it's not a devastating loss if that were to happen. Still sucks to have to spend the time getting stuff restored from backup anyway. Backups are the only solution for this kind of thing, so having partial or no backups is not an excuse. What kind of raid are you running? Also, how small is your pool that you have no redundancy? This is why I go raidz3 no matter what. I can't possibly have a pool failure unless something insanely catastrophic goes wrong. And even then I have 2 sets of backups
|
![]() |
|
I accept a certain level of risk for data that is not worth protecting for me. I approach storage reliability like how you approach security - spend the dollars in accordance to the liability and probability. I noted RAIDZ1 above and how I'm rotating through disks purchased at different times from different vendors. Much of my array exists for convenience of access on my LAN and because mass cloud storage and processing is far more expensive than I feel like paying, not because I have mostly data that's unique or irreplaceable. In a sense, my disk array is just an L2 cache for the real data of value to me.
|
![]() |
|
For you mini-ITX folks, new Lian Li case that holds 11 drives.![]() Only problem is it's damn near $200.
|
![]() |
|
Ugh that is awesome, but why is there a backplane for only the top two drives? I migrated from Mini-ITX to Micro-ATX so I could fill my home server with 32gb of memory on the cheap. Edit: After some reading, looks like you can add a backplane for the rest of the drive bays. Why the hell not just include that from the get go. Moey fucked around with this message at 18:33 on Oct 23, 2014 |
![]() |