«608 »
  • Post
  • Reply
That Works
Jul 22, 2006


Fun Shoe

I have Verizon FIOS connected to a Linksys AC2200 router. I have a Raspberry Pi Zero running PiHole and PiVPN. I have a file server running UnRaid for usenet stuff and hosting Plex from.

I'd like to be able to host / access some large files (work related DNA-sequencing data mostly) on the UnRaid server. Typically I have transferred these files from sequencing vendors to our computational cluster via sftp. I'd kind of like to run an sftp server off of the NAS but don't know enough about what vulnerabilities that would open me up to as I'm not very experienced. Before I set any of this up I figured I'd ask. I am open to using something besides sftp but would need to be able to use it between linux, mac and windows systems easily.

If sftp can be run securely enough (within reason) any advice on best methods to set that up on UnRaid would be appreciated. Just trying to take advantage of the large storage NAS I have up and running.


*This has all come about because work gives us unlimited google drive storage, but once we've passed data through that even 2x most of it fails md5sum.


Kind of a NAS question, kind of network, I can take it to another thread if necessary.

Crunchy Black
Oct 24, 2017

CASTOR: Uh, it was all fine and you don't remember?
VINDMAN: No, it was bad and I do remember.




re my post last week about not encrypting your pools in FreeNAS...I've just personally had bad luck with FreeNAS itself it seems (probably a result of janky hardware on a college student budget years ago) and there have been several junctures where it might have been a total-loss nightmare if the pools were encrypted. If you're just homelabbing it seems unnecessary to me; using it in prod? Go hog wild.

Smashing Link
Jul 8, 2003

I'll keep chucking bombs at you til you fall off that ledge!

Grimey Drawer

That Works posted:

I have Verizon FIOS connected to a Linksys AC2200 router. I have a Raspberry Pi Zero running PiHole and PiVPN. I have a file server running UnRaid for usenet stuff and hosting Plex from.

I'd like to be able to host / access some large files (work related DNA-sequencing data mostly) on the UnRaid server. Typically I have transferred these files from sequencing vendors to our computational cluster via sftp. I'd kind of like to run an sftp server off of the NAS but don't know enough about what vulnerabilities that would open me up to as I'm not very experienced. Before I set any of this up I figured I'd ask. I a him open to using something besides sftp but would need to be able to use it between linux, mac and windows systems easily.

If sftp can be run securely enough (within reason) any advice on best methods to set that up on UnRaid would be appreciated. Just trying to take advantage of the large storage NAS I have up and running.


*This has all come about because work gives us unlimited google drive storage, but once we've passed data through that even 2x most of it fails md5sum.


Kind of a NAS question, kind of network, I can take it to another thread if necessary.
Not an expert but sftp behind a VPN should be fine.

Queadlunn
Dec 10, 2005

Yak Deculture!


Fallen Rib

Just ordered a Dell R720xd and got enough drives to phase out my aging 8x 2tb array. The 4x 4tb isn't as great as a stack of Easystores but it'll defenitly be better than the 8x array in my current R515.

12x 3.5" bays, 2x 2.5" bays and all of the space inside to stuff drives. So many storage options...

TraderStav
May 19, 2006

It feels like I was standing my entire life and I just sat down



I know that this deal has passed, but I’m looking to consolidate / expand my storage for my main Plex-box which currently has it’s space spread out over three drives totaling ~8TB. Is this a 1x12 or 2x6TB? 5400rpm still good enough for pure storage or should I be looking at 7200?

I assume that $15/TB is a good price, but what should I be looking for in a fair price without a black friday deal? If I was going external I’d be ripping it’s exclosure apart and putting it in the PC.

ChiralCondensate
Nov 13, 2007

what is that man doing to his colour palette?


Grimey Drawer

TraderStav posted:

I know that this deal has passed, but I’m looking to consolidate / expand my storage for my main Plex-box which currently has it’s space spread out over three drives totaling ~8TB. Is this a 1x12 or 2x6TB? 5400rpm still good enough for pure storage or should I be looking at 7200?

I assume that $15/TB is a good price, but what should I be looking for in a fair price without a black friday deal? If I was going external I’d be ripping it’s exclosure apart and putting it in the PC.

Easystores so far are only one drive inside, WD white labels equivalent to reds. The pair I picked up from this deal last night are both WD120EMAZ-11BLFA0, haven't shucked em yet, but that's what smartctl says. Doing badblocks now, takes a while for 12TB!

They're perfect for pure storage, and $15/TB is a good price. The 14TB went to $200 on Black Friday, $14.28/TB, but I didn't want to wait for that price to happen again. (You can also find $10 off $100 for Best Buy if you have an Amex, but I didn't want to wait for that to post and just settled on using my 2% cashback Visa.) I'm also not maxed out on drivebays/controller ports, so didn't mind getting only 12TB.

You can use dealferret to view the pricing history to see how often these deals go up, or slickdeals can send you an email to notify you when a particular deal happens--how I knew to jump on these 12TBs.

ChiralCondensate fucked around with this message at 19:02 on Feb 20, 2020

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

The EasyStores are 1x boxes. I think it's the MyBooks that have some models that do 2x drives. They're generally all 5200/5400/5700RPM, which is still fine for mass storage.

taqueso
Mar 8, 2004









Fun Shoe

Are there any especially good deals for bulk storage sized SSDs? I'd like to make a small array for a car computer where I'm scared to use spinning disks.

TraderStav
May 19, 2006

It feels like I was standing my entire life and I just sat down


Thanks for the feedback about the Easystores, I’ll keep an eye on them. What’s the threshold for $/TB that is worth waiting for? I see that $15/TB is a good enough deal, 12TB Easystore is going for $250 everywhere so that’s just under $21, which I am guessing is ‘not a deal’. Just want to pop on something if it hits a certain level.

Thanks!

H110Hawk
Dec 28, 2006


TraderStav posted:

Thanks for the feedback about the Easystores, I’ll keep an eye on them. What’s the threshold for $/TB that is worth waiting for? I see that $15/TB is a good enough deal, 12TB Easystore is going for $250 everywhere so that’s just under $21, which I am guessing is ‘not a deal’. Just want to pop on something if it hits a certain level.

Thanks!

I tend to bite somewhere in the $15-17/TB range.

wolrah
May 8, 2006
what?


taqueso posted:

Are there any especially good deals for bulk storage sized SSDs? I'd like to make a small array for a car computer where I'm scared to use spinning disks.
Microcenter's in-house brand "Inland" has the best $/GB ratio I've seen in SSDs without going to complete no-name hardware. I wouldn't use them for ultimate performance or reliability applications, but for general purpose computers I love 'em. 1TB for $88.

Atomizer
Jun 24, 2007

Bote McBoteface. so what


TraderStav posted:

I know that this deal has passed, but I’m looking to consolidate / expand my storage for my main Plex-box which currently has it’s space spread out over three drives totaling ~8TB. Is this a 1x12 or 2x6TB? 5400rpm still good enough for pure storage or should I be looking at 7200?

I assume that $15/TB is a good price, but what should I be looking for in a fair price without a black friday deal? If I was going external I’d be ripping it’s exclosure apart and putting it in the PC.

All of the high-capacity consumer HDDs I've seen are around 5.4k RPM, which is fine considering that even at that speed, performance is good due to higher densities.

$15/TB is ballpark "deal range." The sales are generally 6 GB/$100, 8/$130, 10/$160, 12/$180, with better prices occasionally around holidays, or with special discounts (like Rakuten codes, or Prime cash back.)

taqueso posted:

Are there any especially good deals for bulk storage sized SSDs? I'd like to make a small array for a car computer where I'm scared to use spinning disks.

Under $100/TB is the "deal range" for SSDs. What capacity are you looking for? 1 TB, 2 TB, or even higher? What form factor and interface? The Intel 660p (and I guess now the 665p) has been <$200/2 TB, and that's QLC NVMe; the Samsung 860 QVO 2 TB (SATA 2.5") has been $160 via Best Buy "Geek Squad refurbished," and I had just posted the link in the SSD thread but they sold out again. The Adata SU800 2 TB (SATA 2.5") has also been on sale for <$200 on Rakuten with Adata-specific discount codes on generally a monthly basis (although I haven't checked recently.)

Crunchy Black
Oct 24, 2017

CASTOR: Uh, it was all fine and you don't remember?
VINDMAN: No, it was bad and I do remember.




Added a 2nd vdev of 8TB disks to the Z1 today, greatly increasing my breathing room.

scrub complete, no issues. Rock on.

taqueso
Mar 8, 2004









Fun Shoe

wolrah posted:

Microcenter's in-house brand "Inland" has the best $/GB ratio I've seen in SSDs without going to complete no-name hardware. I wouldn't use them for ultimate performance or reliability applications, but for general purpose computers I love 'em. 1TB for $88.

Atomizer posted:

Under $100/TB is the "deal range" for SSDs. What capacity are you looking for? 1 TB, 2 TB, or even higher? What form factor and interface? The Intel 660p (and I guess now the 665p) has been <$200/2 TB, and that's QLC NVMe; the Samsung 860 QVO 2 TB (SATA 2.5") has been $160 via Best Buy "Geek Squad refurbished," and I had just posted the link in the SSD thread but they sold out again. The Adata SU800 2 TB (SATA 2.5") has also been on sale for <$200 on Rakuten with Adata-specific discount codes on generally a monthly basis (although I haven't checked recently.)

Thanks for the info. I'll check out the SSD thread, didn't think to look for one. I'm not quite sure what I'm looking for yet, more trying to get a lay of the land. Something like 4TB usable is probably plenty for a car I think. I'm not in a hurry so I can try to snag a deal in the next while.

Moey
Oct 22, 2010

I LIKE TO MOVE IT


You loading up movies/tv shows for your car?

I have always wanted an in dash carputer.

taqueso
Mar 8, 2004









Fun Shoe

Yeah, plus games and maybe eventually dashcam video. It'll do some DSP and digital crossover work for the audio system. And, hopefully, some kind of dash display/hud.

Moey posted:

I have always wanted an in dash carputer.
I hope it pans out

Atomizer
Jun 24, 2007

Bote McBoteface. so what


I tried setting up a carputer about a decade or so ago. It's a lot of work (picking the right components, getting them to run off 12 V, finding space for everything) and isn't worth it nowadays when you can basically just use a tablet. That'll handle pretty much all of the A/V, mapping, etc. stuff you'd want to do in the car, while remaining portable (so you can just bring it in the house and load up media rather than trying to store 4 TB of movies or whatever on it) and having its own display (another thing you no longer have to mount in the car.) There's little reason to install a computer in a car when you can temporarily utilize one whenever needed.

necrobobsledder
Mar 21, 2005
Lay down your soul to the gods rock 'n roll

Nap Ghost

Behold the new king and queen chassis of home NAS builds

Fractal Design Define 7 XL
Fractal Design Define 7

https://www.gamersnexus.net/hwrevie...e-7-case-review

https://www.youtube.com/watch?v=UXYYZ1_cfZc

Hughlander
May 11, 2005



Can anyone help with this bit of zfs magic?

I have a remote server with some zfs datasets.

I back them up locally with syncoid.

I'd like to have a transient 'live' version of one of those datasets on a different zvol locally.

IE:

/trunk/remote-backup/filesystem
/trunk/remote-backup/filesystem@2020-02-21
/trunkb/livefilesystem

I want to have something that will periodically copy the latest snapshot of /trunk/remote-backup-filesystem over the /trunkb/livefilesystem dataset. And by periodically I mean it can be a command, but it needs to find the latest from syncoid.

I've been doing it manually with arcane shell script commands like:
zfs list -r -t snapshot -o name trunk/remote-backup/filesystem | grep syncoid | tail -1 embeded in a zfs send/receive, but it's not bulletproof. I also want to do it for each dataset in the remote-backup.

Less Fat Luke
May 23, 2003

Just the tip!


Exciting Lemon

necrobobsledder posted:

Behold the new king and queen chassis of home NAS builds

Fractal Design Define 7 XL
Fractal Design Define 7
I am ordering that 7 XL the second I can with all the drive sleds or whatever. 18 drives, awwwwww yeah.

HalloKitty
Sep 30, 2005

Adjust the bass and let the Alpine blast



Argh, why don't they update the sodding Define Mini. A microATX case with these new features and maybe 10 3.5" bays would be perfect

I'm loving the solid top panel on these, but I do think the exhaust grille design is too restrictive. Just leave a big ol' hole and ship a 140mm wire grill with it. I removed all that crap from my define r4 and threw a 120mm wire one on instead, way less obstruction. All these fancy patterns block a shitload of area.

nerox
May 20, 2001


Less Fat Luke posted:

I am ordering that 7 XL the second I can with all the drive sleds or whatever. 18 drives, awwwwww yeah.



I was worried I was abut to have to start pulling smaller drives to replace them making my effective price/tb really go up, with this I can add a lot more space easily.

Heners_UK
Jun 1, 2002


nerox posted:

I was worried I was abut to have to start pulling smaller drives to replace

Glad to know that I'm not the only one that will just shove any size of drive into my server for the extra space, regardless of that drive's size.

I was beginning to think I was sat in a lonely corner because I'd reused 500gb desktop drives I happened to have nothing better to do with

Heners_UK
Jun 1, 2002


Moey posted:

I have always wanted an in dash carputer.

In addition to what others have said about it not being that worth it now, I'd strongly suggest you look at Android Auto/Apple Car Play headunits. In my case I'm about to get a Honda Pilot with what appears to be an Android (native) headunit which not only supports both but also decent music support etc. Planning on filling a USB stick with a bunch of music just in case streaming etc isn't an option at a given time (remember this for later).

That said... you do you

If you do go for it, consider just mounting a tablet style device on your dash. RAM Mounts are the way I'd go as I had one in my old car for almost 10 years and it's been flawless. Power will be some work but there are lots of guides on how to power dashcams that could be used for powering a typical tablet. Thermal management also an issue.

Question starts here: Keeping content updated on it easily may be an issue as you can only really do that when on WiFi, probably at home for large stuff (I know that's not strictly true, but I'm assuming shovelling money into a data plan is undesirable). Anyone got any good strategies for updating semi available storage mediums (be that the USB stick above, or an arbitary tablet/PC).

EDIT: Assume Plex Sync isn't an option and you want to exchange raw files. For Android I'd use FolderSync for this.

Heners_UK fucked around with this message at 18:10 on Feb 21, 2020

Gay Retard
Jun 7, 2003



I can’t imagine my fractal R5 running out of space any time soon with 14 TB drives becoming the norm, but I’ll definitely grab one of those 7 XLs if I need to.

necrobobsledder
Mar 21, 2005
Lay down your soul to the gods rock 'n roll

Nap Ghost

The Define 7 front grille does hurt the airflow as noted by the GamersNexus review. Besides that flaw it’s a reasonable case for a forever build home server chassis. A Node 804 with a micro ATX Xeon D was going to be my go to storage server and stuck at 8-10 drives.

Just not sure what guts to rearrange now and whether I should bother with a new Xeon D 1541 build to make it server grade guts. My current home server appears to have some design flaws that kills drives and parts so I’d rather not wait anymore.

Moey
Oct 22, 2010

I LIKE TO MOVE IT


Yeah, I am past the point in my life for a carputer really in any daily driver.

One day I"ll hopefully have a garage/project car or two, that's when hacking a computer/tablet into the dash will become a reality.

Back to packrattin', anyone run or know how the performance is on a QNAP TS-932X with 4xSSDs for a quick-ish iSCSI datastore?

https://www.qnap.com/en-us/product/ts-932x

Next upgrade for me will be some centralized iSCSI storage for VMs, and this thing could fit the bill.

taqueso
Mar 8, 2004









Fun Shoe

Atomizer posted:

I tried setting up a carputer about a decade or so ago. It's a lot of work (picking the right components, getting them to run off 12 V, finding space for everything) and isn't worth it nowadays when you can basically just use a tablet. That'll handle pretty much all of the A/V, mapping, etc. stuff you'd want to do in the car, while remaining portable (so you can just bring it in the house and load up media rather than trying to store 4 TB of movies or whatever on it) and having its own display (another thing you no longer have to mount in the car.) There's little reason to install a computer in a car when you can temporarily utilize one whenever needed.

The 'lot of work' part is the fun stuff

LRADIKAL
Jun 10, 2001

A Very Useful Person



Fun Shoe

Followup on my JBOD crash...
It seems, so far as though the Synology had written a lot of whole files to each disk, and I'm able to pull them off the remaining drive intact using FastCopy which smartly skips the inaccessible ones. I can't remember if I had one drive then added another or what. Does anyone know how the Synology handles JBOD? Is it on the file level?

In any case I have most of my junk backed up in the first place, and I'm copying back over to my 2x8TB JBOD. Thanks for the tips!

ErIog
Jul 11, 2001



I have a question about Synology. I'm not really a digital packrat myself. Before I got into enterprise IT I helped a small business with their Drobo. For the past 3 years I've only dealt with large enterprise disk arrays. However, the thing about enterprise shit is it's incredibly expensive so I would like to clear out space on our system by archiving non-critical data to much cheaper consumer-grade solutions.

I've done some reading and it seems like Synology is going to be fine here, but I'd be very grateful if someone could reassure me I'm not about to slam my dick in a car door on this. The thing I'm most worried about is the unit itself dying and being SOL.

I read the OP, but it was mostly about home-built solutions you have to janitor with a few mentions that Synology and QNAP exist. So I'd like some good advice here with the understanding that I'm looking for a solution I don't have to janitor too much.

CopperHound
Feb 14, 2012



ErIog posted:

The thing I'm most worried about is the unit itself dying and being SOL.
You should be able to read the drives if you load them all up in a pc: https://www.synology.com/en-global/...tion_using_a_PC

I think a non striped solution might be be more forgiving when it comes to recovery, but I have no idea what your back up plans are for your non-critical archives.

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

Synologies and QNAP only get passing mentions because they: (1) mostly "just work," (2) are considerably more expensive than a DIY, (3) enormously more expensive than repurposing existing / ebay'ed gear. There's nothing fundamentally wrong with them, really.

The biggest worry I'd have about using a Synology would be performance: most of them simply aren't all that fast, especially compared to anything enterprise grade. Multi-user performance, in particular, is going to be considerably slower than advertised, and a total joke compared to something with multiple SSDs shoved into it. That said, the larger ones like the DS2419+ do achieve pretty decent performance for what they are, so if you aren't expecting 50+ people to be using it at once, it'd likely be ok.

But in terms of "will it die on me," the answer is probably not. I might not want to keep it around 7+ years or anything crazy, but some of the larger models have 5 year warranties, so at least you'll be ok that long.

Matt Zerella
Oct 7, 2002


ErIog posted:

I have a question about Synology. I'm not really a digital packrat myself. Before I got into enterprise IT I helped a small business with their Drobo. For the past 3 years I've only dealt with large enterprise disk arrays. However, the thing about enterprise shit is it's incredibly expensive so I would like to clear out space on our system by archiving non-critical data to much cheaper consumer-grade solutions.

I've done some reading and it seems like Synology is going to be fine here, but I'd be very grateful if someone could reassure me I'm not about to slam my dick in a car door on this. The thing I'm most worried about is the unit itself dying and being SOL.

I read the OP, but it was mostly about home-built solutions you have to janitor with a few mentions that Synology and QNAP exist. So I'd like some good advice here with the understanding that I'm looking for a solution I don't have to janitor too much.

Synology is good. But if you're an enterprise storage person then you also know it's not backup.

taqueso
Mar 8, 2004









Fun Shoe

Synology are great for SOHO use. Priced decently (for business stuff), decently built, works decently. They have a pretty good track record for reliability at this point. I think you are on the right track for your use case. If you pick the modern models, you will have plenty of CPU for normal fileserver use. We use a couple synology at work, it's better than the QNAPs we used before for sure, but that was awhile ago so maybe qnap got better

taqueso fucked around with this message at 05:43 on Feb 22, 2020

Zorak of Michigan
Jun 10, 2006

Waiting for his chance

ErIog posted:

I have a question about Synology. I'm not really a digital packrat myself. Before I got into enterprise IT I helped a small business with their Drobo. For the past 3 years I've only dealt with large enterprise disk arrays. However, the thing about enterprise shit is it's incredibly expensive so I would like to clear out space on our system by archiving non-critical data to much cheaper consumer-grade solutions.

I've done some reading and it seems like Synology is going to be fine here, but I'd be very grateful if someone could reassure me I'm not about to slam my dick in a car door on this. The thing I'm most worried about is the unit itself dying and being SOL.

I read the OP, but it was mostly about home-built solutions you have to janitor with a few mentions that Synology and QNAP exist. So I'd like some good advice here with the understanding that I'm looking for a solution I don't have to janitor too much.

This might be a decent use case for TrueNAS. It's more expensive than Synology but cheap by enterprise standards, and has commercial support.

Sniep
Mar 28, 2004

All I needed was that fatty blunt...



King of Breakfast


Fun Shoe

i've used syno at home for like a decade now and it's just great

it's not cheap no but it Just Works and there's no bullshit involved. It's like my ubiquity networking stuff - it's cheap compared to the real pro shit that i have no need for, but better than the prosumerest Netgear garbage with 17 antennas at best buy

Former Human
Oct 15, 2001



GamersNexus isn't too thrilled with Synology since they had two or three units fail within six months of each other.

Smashing Link
Jul 8, 2003

I'll keep chucking bombs at you til you fall off that ledge!

Grimey Drawer

I would like to migrate from my Synology to my Unraid box as my "main" server. Main issue is that I really like Hyperbackup (Synology backup app). Is there something like it for Unraid/linux that has versioning, automatic backups etc., rather than trying to figure out some cron/rsync script with my Synology as the target?

CommieGIR
Aug 22, 2006

If Godzilla can do it, you know I can deliver!

Pillbug

Update Sunday, time to switch off the 11.2 train for FreeNAS, as they EOL'ed it.

DrDork
Dec 29, 2003
commanding officer of the Army of Dorkness

CommieGIR posted:

Update Sunday, time to switch off the 11.2 train for FreeNAS, as they EOL'ed it.

Same boat here. I just moved all my data off my pool onto some external disks so I can expand my pool by another disk and do all the upgrading/rearrangement in one shot. Here's hoping Seagate externals don't fuck me! (yes, my important shit is backed up elsewhere, but there's like 10TB of media that I'd be annoyed to have to reacquire).

My biggest issue so far is figuring out how, exactly, to move my Plex DB off the bizarro-jail from 11.2 onto an actual normal Linux VM that I'm spinning up for my new setup. I'm also trying to pull over all my Transmission stats because I enjoy seeing all those TB of transferred over the years.

  • 1
  • 2
  • 3
  • 4
  • 5
  • Post
  • Reply
«608 »