Yacine, robotics startup founder, sparks hardware planning debate over whether local development requires a custom 100TB NAS

@yacineMTB A few hundred TB if you want to be free

@yacineMTB Currently have 333TB after ZFS redundancy in the garage. However much you get, you will fill it and want more

@yacineMTB there used to be a different way for this...

@yacineMTB not sure how much you'll need but i found a good deal on a used 36 bay chassis and started slowly filling it up with recertified and old drives i own. it'll grow as my/family needs grow. reusing old pc parts and a cheap hba card for now

@yacineMTB Over engineering your YouTube setup

@yacineMTB dingbytes? dingblocks? dingsto? dingrw?

NVMEoF target over used Mellanox HBA. Mix and match - like 10-20 tb nvme, and some spinning SAS for backup or warm storage. NVMEoF works with any block device in Linux. Same with iSCSI. SMB + RDMA only works properly on Windows Server. NVMEoF is very compatible - Starwind has a free client for windows.

@yacineMTB go for it, storage schemes in the cloud is where they make the money, rough lesson last week with a server, when you need more space they force you into bigger machines or nothing.

@yacineMTB Build a new NAS based on these though. I needs more speeds.

i am currently building a nas myself. just got my last molex power cable delivered so i can finish the build this weekend. - jonsbo n5 case - z390 pro4 mobo - 32gb ram (i think it's ddr4?) - rtx 2080 - 4x 18tb hdds in raidz2 - 2x 1tb sata ssds - 1x 126gb boot ssd - 1x 500gb nvme drive - evga 750gq psu

i've got enough sata ports and drive bays to add 4x more 18tb hdds into the raidz2 vdev. seems like a reasonable place to start and then will go from there.

@yacineMTB Buy used enterprise HDD on eBay, 6-8 TB each (or more if you want to spend more). Do ZFS 2x vdev in raidz2. Minimum 12-16 drives total. Also on eBay used Supermicro 3U or 4U chassis with backplane. Cheap. Can do 100TB usable with some reliability+speed for probably around $2k.

@yacineMTB different needs for different speeds

@yacineMTB I had 20TB and it was fine.

@yacineMTB Gross or Net? It’s crazy to not use some level of RAID if you’re going to do that, so you need to divide the total headline number in half probably.

You’re probably better off cobbling together two systems, a fast one with NVME and a slow one with HDDs. Software RAID with btrfs.

@yacineMTB This should be an SNL skit. The procrastinating YouTuber.

@yacineMTB 1 petabyte for starters

maybe 50-100t in hot ssds too🤐😔😔😔

@yacineMTB Just get a good internet connection and delete and re-download data when needed

@yacineMTB I'm going to give you the biggest life hack that saved me several times now. Goodsync on Western digital. Some of the automations I'm running on good sync are while. I kind of want to call their company and ask them, why is it so cheap.

@twinturbomonkey @yacineMTB past work (lotso CAD), very slow motion footage to analyze vibrations and failures, 3d scan point clouds, 3 decades of personal photos and videos, model weights, machine backups, web archives, and of course library of congress level of ebooks, music, movies, and tv shows

@MatthewTavares @yacineMTB Is this where the cloud is stored