«608 »
  • Post
  • Reply
The Gunslinger
Jul 24, 2004

Do not forget the face of your father.

Fun Shoe

THF13 posted:

One extra thing for anyone using or planning to use CrashPlan as a way to deal with a drive failure I should have mentioned in my original post is that Crashplan doesn't have an option to restore only missing files, so it can be difficult to figure out what specific files were stored on the failed drive and actually need to be restored.

I like drive pool a lot but was thinking about trying flexraid soon so I could get 1 parity disk and mostly avoid that issue.

I really can't recommend FlexRaid anymore. The documentation is very poor and the author is frankly a bit of an asshole on his forum. I've had a few failed parity reconstructions which didn't really give me any confidence in the product. In the past when I tested things were fine but I would really just go with Snapraid or something else these days.

Mr Shiny Pants
Nov 12, 2012


Combat Pretzel posted:

Hmmm, nice.

Interestingly, Samba had the biggest bump in read performance. For that specific metric, on iSCSI it went from 14MB/s to 31MB/s (12MB/s before on FreeNAS), on Samba it went from 12MB/s to 50MB/s. Hope they'll get cracking on SMB Direct in the very near future. That said, this is performance from ARC to the workstation, since Diskmark creates a file filled with zeroes to test on. That was the idea anyway, to maximize performance reading from ARC and L2ARC.

Also, I want to move the NAS eventually to a further place. FDR transceivers and MPO fiber is $$$ :[

Yep, luckily you just need one cable.

Wiggly
Aug 26, 2000

Number one on the ice, number one in my heart

Fun Shoe

Newegg has 6TB HGST NAS drives on sales for $179.99 with code EMCRHCR24. Cheapest price I've seen.

https://www.newegg.com/Product/Prod...N82E16822146118

Knifegrab
Jul 30, 2014

Gadzooks! I'm terrified of this little child who is going to stab me with a knife. I must wrest the knife away from his control and therefore gain the upperhand.


I want to like Crashplan, I really do, but the upload speed is hot garbage. It says its going to take 30 days for me to upload my 3.5 TB backup. THat is ridiculous. Looking into alternatives I guess...

IOwnCalculus
Apr 2, 2003





How much CPU time are you giving it? It defaults to using very little.

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

Knifegrab posted:

I want to like Crashplan, I really do, but the upload speed is hot garbage. It says its going to take 30 days for me to upload my 3.5 TB backup. THat is ridiculous. Looking into alternatives I guess...

Their speeds aren't crazy, but I usually get in the 15-20Mbps range, with spikes much higher (500+Mbps). I think it took me something like 3-4 days to upload 2TB. The upside of shoving it on a headless NAS is you click upload and then just ignore it until it's finished.

I don't think many of the other unlimited-space providers are a whole lot better on transfer speeds, either.

Knifegrab
Jul 30, 2014

Gadzooks! I'm terrified of this little child who is going to stab me with a knife. I must wrest the knife away from his control and therefore gain the upperhand.


IOwnCalculus posted:

How much CPU time are you giving it? It defaults to using very little.

90% all the time. I am getting only 2 Mbps

MagusDraco
Nov 11, 2011

even speedwagon was trolled


Knifegrab posted:

90% all the time. I am getting only 2 Mbps

How much ram. Is it the windows java app which sometimes refuses to go fast at all for no reason so you have to setup a linux VM or something and run it from that. edit: Basically crashplan will sometimes just upload slow for no discernible reason.

Knifegrab
Jul 30, 2014

Gadzooks! I'm terrified of this little child who is going to stab me with a knife. I must wrest the knife away from his control and therefore gain the upperhand.


havenwaters posted:

How much ram. Is it the windows java app which sometimes refuses to go fast at all for no reason so you have to setup a linux VM or something and run it from that. edit: Basically crashplan will sometimes just upload slow for no discernible reason.

16GB, yes on windows. Not willing to setup a linux vm just for a backup plan really...

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

Knifegrab posted:

16GB, yes on windows. Not willing to setup a linux vm just for a backup plan really...

It takes about 10 minutes and unless you're changing 100's of gigs of data monthly, you probably won't need to bother after your initial backup, and can just use the Windows app.

But, yeah, their app is by far the weak point in their service offerings. Then again, I don't know of any other cheap unlimited provider that gets compellingly better transfer speeds, so that may just be part of the trade-off with not having to pay $50/TB/yr like with some of the other services.

Knifegrab
Jul 30, 2014

Gadzooks! I'm terrified of this little child who is going to stab me with a knife. I must wrest the knife away from his control and therefore gain the upperhand.


DrDork posted:

It takes about 10 minutes and unless you're changing 100's of gigs of data monthly, you probably won't need to bother after your initial backup, and can just use the Windows app.

But, yeah, their app is by far the weak point in their service offerings. Then again, I don't know of any other cheap unlimited provider that gets compellingly better transfer speeds, so that may just be part of the trade-off with not having to pay $50/TB/yr like with some of the other services.

Is there a "losers guide" to setting this up? I am the loser.

BoyBlunder
Sep 17, 2008


Knifegrab posted:

16GB, yes on windows. Not willing to setup a linux vm just for a backup plan really...

Docker it

Knifegrab
Jul 30, 2014

Gadzooks! I'm terrified of this little child who is going to stab me with a knife. I must wrest the knife away from his control and therefore gain the upperhand.



https://www.docker.com/docker-windows

?

I'm not actually familiar with docker, is it a plug and go linux vm solution?

Twlight
Feb 18, 2005

I brag about getting free drinks from my boss to make myself feel superior

Fun Shoe

Should I be focusing on a certain brand of drives? The last time I bought a spinning disk was a long time ago, and I've noticed that there are the WD Red drives as well as Seagate "Ironwolf" drives which seem to be focused on the NAS market. From looking around there seems to be good reviews for both, should I just be shooting for price? these are the 2-3tb drives, if that makes a difference?

EssOEss
Oct 23, 2006
128-bit approved

Knifegrab posted:

I want to like Crashplan, I really do, but the upload speed is hot garbage. It says its going to take 30 days for me to upload my 3.5 TB backup. THat is ridiculous. Looking into alternatives I guess...

I can recommend Duplicity - it can max out my 100 Mbps connection no problems when configured to do 15-30 parallel transfers. This is to Backblaze B2 storage.

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

EssOEss posted:

I can recommend Duplicity - it can max out my 100 Mbps connection no problems when configured to do 15-30 parallel transfers. This is to Backblaze B2 storage.

Indeed, there are a number of higher-performing alternatives. However, at $0.005/GB/mo, storing 3.5TB would cost about $200/yr, and if you wanted to pull that back down in the case of a catastrophic failure, it would cost you another $70.

One of the trade-offs for Crashplan and other unlimited storage services is generally reduced performance compared to vendors like Backblaze, Azure, or S3.

Moey
Oct 22, 2010

I LIKE TO MOVE IT


DrDork posted:

One of the trade-offs for Crashplan and other unlimited storage services is generally reduced performance compared to vendors like Backblaze, Azure, or S3.

Backblaze is still cheaper than Crashplan?

Combat Pretzel
Jun 23, 2004

No, seriously... what kurds?!

Oh heh, putting my ConnectX3's into Ethernet mode instead of Infiniband, I get higher throughputs on both iSCSI and Samba.

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

Moey posted:

Backblaze is still cheaper than Crashplan?

Only for small datasets. At $0.005/GB/mo you hit price-parity with CrashPlan's annual plan ($5/mo) at 1TB. Anything over that and you're paying more with Backblaze. Also, you pay to retrieve data with Backblaze, but not with Crashplan, which may or may not matter depending on what all you've got going on.

So for small sets, Backblaze does make sense. Once you start talking TB's, though, the cost of most of the pay-as-you-go services starts getting pretty bad by comparison.

ChiralCondensate
Nov 13, 2007

what is that man doing to his colour palette?


Grimey Drawer

Do y'all wait for all four passes of badblocks?

Moey
Oct 22, 2010

I LIKE TO MOVE IT


DrDork posted:

Backblaze

They are still unlimited for 5/month or 50/year.

Rexxed
May 1, 2010

Dis is amazing!
I gotta try dis!



Twlight posted:

Should I be focusing on a certain brand of drives? The last time I bought a spinning disk was a long time ago, and I've noticed that there are the WD Red drives as well as Seagate "Ironwolf" drives which seem to be focused on the NAS market. From looking around there seems to be good reviews for both, should I just be shooting for price? these are the 2-3tb drives, if that makes a difference?

Only three companies make hard disks. WD, Seagate, and Toshiba. WD owns Hitachi's drive making facility which leads to the HGST branded WD drives. All of the companies have good and bad disks, although I have had more issues with Seagate disks than any other company. HGST and WD Reds are well regarded. I think the jury is still out on the new seagate nas drives but goons have already had issues with some of them.

There's no accurate way to get huge sample sizes of disks to see which ones are good or bad besides large data storage companies posting their numbers. Blackblaze does that, and while their usage of these disks may differ from home use, if a particular disk model has a lot more failures than others, it would be worth avoiding:
https://www.backblaze.com/blog/hard...ark-stats-2016/
https://www.backblaze.com/blog/hard...-rates-q1-2017/

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

Moey posted:

They are still unlimited for 5/month or 50/year.

For the Personal side of the house, yeah. Unsure what those speeds look like, though--the 100mbps speeds were for Backblaze B2.

Twlight
Feb 18, 2005

I brag about getting free drinks from my boss to make myself feel superior

Fun Shoe

Rexxed posted:

Only three companies make hard disks. WD, Seagate, and Toshiba. WD owns Hitachi's drive making facility which leads to the HGST branded WD drives. All of the companies have good and bad disks, although I have had more issues with Seagate disks than any other company. HGST and WD Reds are well regarded. I think the jury is still out on the new seagate nas drives but goons have already had issues with some of them.

There's no accurate way to get huge sample sizes of disks to see which ones are good or bad besides large data storage companies posting their numbers. Blackblaze does that, and while their usage of these disks may differ from home use, if a particular disk model has a lot more failures than others, it would be worth avoiding:
https://www.backblaze.com/blog/hard...ark-stats-2016/
https://www.backblaze.com/blog/hard...-rates-q1-2017/

Thanks ill look this over and wait for a sale.

Ziploc
Sep 19, 2006
MX-5

Finally got time to work on my FreeNAS Coral server that ate it's USB device. So I installed FreeNAS 11.

I swear I saw zfs import successful or something along those lines during text barf on the VGA screen connected to the server during the install.

Went through the FreeNAS 11 setup wizard in the webgui. When it got to the 'ZFS' part it only had 1 option with a load of numbers on it. Figured it was my previous volume. So I selected it. Finished the wizard.

Now, under storage, I see nothing listed. And if I go to import a non-encrypted volume, there's nothing to import. I'm fairly sure I didn't encrypt the volume.

Is my data now gone? Dafuq.

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

If you drop into the CLI and do a zpool import, what do you see? IIRC, the GUI import may not display pools that were not properly detached (which if your server went tits up due to a failed USB, any pools would not have been properly detached); such pools can be force imported by doing zpool import -f tank

Ziploc
Sep 19, 2006
MX-5

I get a whole lotta nada.



So does that mean I have to run the second command you mentioned?

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

Well, that means it's not detecting any pools that haven't been imported yet. If you do "zpool status" does it bring up data on your previously existing pool?

Ziploc
Sep 19, 2006
MX-5

I'm not sure how to interpret this.

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

Ziploc posted:

I'm not sure how to interpret this.



Either scroll up or do "zpool status | less" so it doesn't automatically scroll to the bottom.

What you're seeing in the top section is a bunch of drives, presumably attached to a pool that's been imported. The bottom section is a complete pool data blob, in this case for the freenas-boot pool, which presumably is your boot device.

Ziploc
Sep 19, 2006
MX-5

My bad



I mean, to my very uneducated brain, that looks like my pool. I have no idea what has happened to it.

Doesn't that show it as imported already? I'm a bit confused.

Combat Pretzel
Jun 23, 2004

No, seriously... what kurds?!

Have you rebooted after importing? IIRC that's necessary. --edit: For the FreeNAS frontend to see it.

Ziploc
Sep 19, 2006
MX-5

Rebooted. Still see no entries in the storage section of the webGUI.

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

Post a screenshot of the Storage webGUI? The zpool status printout there says that it has, indeed, picked up and imported a pool named "Volume", so if that's what you'd named it on your old system, the pool should be ok (though last scrubbed in April? Bro...).

Ziploc
Sep 19, 2006
MX-5

DrDork posted:

Post a screenshot of the Storage webGUI? The zpool status printout there says that it has, indeed, picked up and imported a pool named "Volume", so if that's what you'd named it on your old system, the pool should be ok (though last scrubbed in April? Bro...).



Someone mentioned I should export the Volume in the CLI and import it in the GUI. Is this a viable strategy?

https://forums.freenas.org/index.ph...-in-list.42414/

Ziploc fucked around with this message at 21:42 on Jul 23, 2017

G-Prime
Apr 30, 2003

Baby, when it's love,
if it's not rough it isn't fun.


In case anybody missed it, Best Buy has the extremely shuckable 8TB WD EasyStore drives on sale right now for an absurdly low price ($159, lowest I've ever seen for them). They contain a single Red, and people claim they can be RMA'd without the case. I snagged 8, and am currently firing off SMART tests on them. Holy shit they're loud in the external cases.

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

G-Prime posted:

In case anybody missed it, Best Buy has the extremely shuckable 8TB WD EasyStore drives on sale right now for an absurdly low price ($159, lowest I've ever seen for them). They contain a single Red, and people claim they can be RMA'd without the case. I snagged 8, and am currently firing off SMART tests on them. Holy shit they're loud in the external cases.

Even if they wanted the case, you could just keep one or two of the cases shoved in a closet somewhere if you ever happened to need them. Shame they don't have the external dock type deal that a bunch of the Seagates do--then you could use the dock as a ghetto external adapter whenever you needed one for a few minutes.

EL BROMANCE
Jun 10, 2006

COWABUNGA DUDES!



The gods know I have no spending money, dammit.

Internet Explorer
Jun 1, 2005





Oven Wrangler

G-Prime posted:

In case anybody missed it, Best Buy has the extremely shuckable 8TB WD EasyStore drives on sale right now for an absurdly low price ($159, lowest I've ever seen for them). They contain a single Red, and people claim they can be RMA'd without the case. I snagged 8, and am currently firing off SMART tests on them. Holy shit they're loud in the external cases.

Oh man, thank you for posting this. Have been planning on getting a new 6-bay NAS when the price is right, and that is a huge amount of savings versus buying them off Amazon. $600 difference. Thank you, friend!

G-Prime
Apr 30, 2003

Baby, when it's love,
if it's not rough it isn't fun.


Internet Explorer posted:

Oh man, thank you for posting this. Have been planning on getting a new 6-bay NAS when the price is right, and that is a huge amount of savings versus buying them off Amazon. $600 difference. Thank you, friend!

For real. I've been dreading spending between $2000 and $2500 on drives, and then BAM, $1356 for the whole array. This has been awesome. I've seen these come up for $179 in the past, but $159 is too good to pass up.

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply
«608 »