I've got to know, what's your farm's power footprint look like? SOMEBODY GET THIS MAN A KILL-A-WATT
I love repurposing hardware though. I wish more setups were like yours than ... well, all the baby-whales
Assuming you want this to connect your SATA drives, you will need this cable.
CableCreation Mini SAS 36Pin (SFF-8087) Male to 4 SATA 7Pin Female Cable, Mini SAS Host/Controller to 4 SATA Target/Backplane, 0.5M / 1.6FT https://www.amazon.com/dp/B013G4EMH8/ref=cm_sw_r_cp_api_glt_fabc_3MXMPD11ATP65NSF1MRR?_encoding=UTF8&psc=1
You can go with a custom solution with a industrial type power supply, distribution block, and a bunch of 2.5mmx5.5mm dc plugs.
Or get some of these
https://www.amazon.com/dp/B08P6513C4/ref=cm_sw_r_cp_apa_glt_fabc_9M92B20SKHB180XN3Q2Q
Price went up $50 since I got it. Might be cheaper without the bundle now.
Edit: Cheaper without the bundle but still $40 more than I got it for unfortunately.
Costco seagate 8tb hard drives. 3 per membership.
Used a lot of memberships.
8tb for 120$
Amazon for the fans https://www.amazon.com/dp/B088GQZ8F5/ref=cm_sw_r_u_apa_glt_fabc_2GQ11SS7DFKT445GTDKK?_encoding=UTF8&psc=1
Amazon for the usb hub https://www.amazon.com/dp/B081DYD25S/ref=cm_sw_r_cp_apa_glt_fabc_6W29GC5NDKBG6DE4D8YD?_encoding=UTF8&psc=1
Homedepot for aluminum and rivets.
Walmart for power strips.
I kept the hard drives intact not to void the warranty or Costco's great return policy ;)
Inland Premium is the only way to go for plotting. Plenty of TBW, and roughly the same speed as any other NVME using the Phison E12 controller.
1 ft extension cables are your friend for powerstrip utilization with wall warts.
AmazonSmile: Cable Matters UL Safety Compliance 6-Pack 16 AWG Heavy Duty Power Extension Cord 1 ft (Power Cord Extension / 3 Prong Extension Cords, NEMA 5-15P to NEMA 5-15R): Electronics
Alright you want to spend $80 be my guest MZHOU PCIe SATA Card 6 Port, with 6 SATA Cables and Low Profile Bracket, 6Gbps SATA 3.0 PCIe Card,Support 6 SATA 3.0 Devices, Built-in Adapter Converter for Desktop PC https://www.amazon.com/dp/B082CP8K1W/ref=cm_sw_r_cp_api_glt_fabc_DE8TY0FYAR1QHESS7V5K?_encoding=UTF8&psc=1
https://www.amazon.com/dp/B07JGT17B8/ref=cm_sw_r_cp_apa_glt_fabc_G7JAAXG81ZYWFZ8GQ99Q?_encoding=UTF8&psc=1 I ordered 5 of those. Using 3.5" drives require an external power source either though the supplied wall adapter or power supply. https://www.amazon.com/dp/B08CDJQY47/ref=cm_sw_r_cp_apa_glt_fabc_58V4HCKGC2TE5AME0S1D Trying these for the other 5 drives to maybe daisy chain them. Plot copying will take longer if I write to more than one at a time but can save me space/money on buying usb hubs
The drives I bought last week have now doubled in price in the UK. 14TB for £500,-1️⃣💽=2️⃣✖️💰
https://www.amazon.co.uk/gp/product/B07Y3KDVZH/
Even then Amazon was cheaper than what you could get on ebay, where you can now find some cheaper, but still ludicrously overpriced.
Technically it is possible, but you will have to find a way for the haverest to access it, since it cannot run natively on a mobile, at least without removing the native operating system. You could try something like LAN Drive to be able to access the phone as a remote storage drive.
1/2 of my 22 drives are external hdd’s are powered already (wd my books etc) but I have a ton of the powered by usb types (wd my passport) too and didn’t want it taking power from a pc that has 3 nvme’s and 4 raided ssd’s plotting and 4 hdd’s internal plus the gpu is mining eth.
Sabrent 16-Port USB 3.0 Data HUB and Charger with Individual switches [90 Watts] (HB-PU16) https://www.amazon.com/dp/B07KHRLSTT/ref=cm_sw_r_cp_api_glt_fabc_J3Z1XBE4MT5GCN082T9T
You should look at SAS. One port can feed an expander card like this, https://www.ebay.com/itm/1PC-Intel-RES2CV240-24-Ports-SAS-SATA-6-0Gbps-RAID-Expander-Card-New-SS-/283347158750?_trksid=p2349624.m46890.l49286
And each of those ports can feed 4 sata drives like this Cable Matters Internal Mini SAS to SATA Cable (SFF-8087 to SATA Forward Breakout) 1.6 Feet https://smile.amazon.com/dp/B018YHS8BS/ref=cm_sw_r_cp_api_glt_fabc_2W4JKK4GXNVAKWXNMHVK
I have a couple of 2 port docks with 2HD's each and they got really hot as well. I ordered this usb fan set and put one fan on each pair, they're super cold now.
https://www.amazon.com/dp/B00JLV4BWC
I'm thinking two sets of them would cover all of your drives and running on low or med might even be enough. In the meantime if you have a deskfan I would point it at your rig.
You don't really need more 'devices' if you can expand your current device. I have this card which gives each of the 4 USB ports it's own controller capable of another 127 'devices'.
Oh sorry, never answered your original question! So half the array is running on a SAS HBA controller. https://www.amazon.com/dp/B001IZBLC2/ref=cm_sw_r_cp_awdb_imm_9YF8PNH2808P912PP7Y0 And the other half is the funniest shit. I used a pcie 1x riser to head from the top rig into the JBOD. In there is has a 8-port sata expander. Both the cards were a lucky find early on. I just started scoping up tons of this kind of shit and lucked out with these two. They were both a bitch to find drivers for, but I eventually googled enough to find it. The psu is a Corsair 1000w not because I needed that much power, but I didn’t want to use too many splitters and this one had plenty of expandable cables. I could actually run up to 24 drives with this beast!
The make sas to sata breakout cables, for example https://www.amazon.com/Cable-Matters-Internal-SFF-8087-Breakout/dp/B018YHS8BS/ref=asc_df_B018YHS8BS/?tag=hyprod-20&linkCode=df0&hvadid=309776868400&hvpos=&hvnetw=g&hvrand=10334552076714521546&hvpone=&hvptwo=&hvqmt=&hvdev=c&hvdvcmdl=&hvlocint=&hvlocphy=9003423&hvtargid=pla-584515086170&psc=1
I was looking into this myself yesterday - you can trim on demand using the Optimize-volume commandlet in powershell. I bet if you incorporated this into your kick off script in between madmax plotting calls it would help. See https://winaero.com/trim-ssd-windows-10/
You should see the USD vs GBP
https://www.xe.com/en/currencyconverter/convert/?Amount=1&From=USD&To=GBP
and that fall is against the Brexit Economy. Pandemic and Brexit a guaranteed long time fail.
I use hard drive sentinel pro. You can set it to scan every minute, preventing disk from sleeping. It monitors disk health and I've saved 18tb of plots by moving them before drive failed, shortly after. Seriously worth getting it https://www.hdsentinel.com/products.php
>Hetzner has changed their TOS and now ALL crypto mining is banned.
It was always banned. Bought a VDS at the beginning of the month and found that cryptos are banned a few hours later by reading the TOS:
>Dedicated Server Service Agreement
>
>We strive to keep our networks operating at the highest possible level,so all of our clients benefit from it. Therefore the following actionsare prohibited:
>
>Operating applications that are used to mine crypto currencies
>
>The scanning of foreign networks or foreign IP addresses
>
>Manually changing the hardware address (MAC)
>
>The use of fake source IPs.
Cancelled it right away.
Yep. You run the node or windows exporter on each server and scrape them all with prometheus (see the prometheus.yml config). Same thing for mtail and/or promtail for logs.
For multiple sites things get a bit complicated, see the prometheus docs.
Yes. If you continue to have problems I suggest you buy https://www.hdsentinel.com/store.php
as it keeps drives awake and you can set it to check drives every minute, preventing them from sleeping. I ended up buying after trial and glad I did. Every farmer should have this as it checks your drives health daily. Just moved over a failing drive, and inly lost 3 plots, compared to whole drive if I'd left it.
UPNP is terrible in implementation and worse for security. Disable UPNP on your router. Doesn't matter if clients have it enabled, if it's disabled on your router, it can't be used. UPNP attempts to setup port forwards for you. Think about that for a moment. Allowing devices or software to configure the firewall of your router. Bad bad bad. See r/qnap if you want to see what can happen. Log into your router and set the port forward yourself. If this is beyond your ability to do, perhaps you shouldn't be farming chia to begin with as port forwards are at the very basic level of networking skill.
Here is an article I briefly skimmed. This sums it up well enough:
On windows total commander can set speeds for normal copy processes once you put them into background, that's a copy mode from that software, just try it :)
On linux I think rsync has a bandwidth flag
RasPi 4 8GB, currently running stock, but I've been plotting with it overclocked to 1.85Ghz. It'll overheat when plotting regardless of clock speeds; you have to have active cooling. I got entirely carried away and added the LP Ice Tower (in Black, with custom Chia-coloured mounting brackets and fan guard no less).
It boots from a Samsung EVO870 500GB, using a StarTech USB3 to SATA adapter. That cable/adapter is from this list of supported Pi/SSD adapters, which is important. If it's not on the list, it won't be running properly/full speed (usual linux bullshit). I have an external Seagate Expansion Desktop 2TB to store the plots. (The Seagate is running quirks mode to force it to usb-storage to reduce bogus disconnects.. usual linux bullshit.)
Looks like HDs are 2.5" to avoid the power brick thing... https://www.amazon.com/dp/B0713WPGLL/ref=cm_sw_r_cp_apa_glt_fabc_6YCMW89D2A6JHDF74VBY
My question will be how reliable is this specific model of WD hard drive?. I never thought to use a 2.5" instead of 3.5" (they feel like more robust) and I'm not sure if the performance will be the same. However, this approach using the the sabrent hub is very clever and clean reducing the space required for the setup.
Yeah a heatsink like that should do the trick. Just make sure you sandwich the nvme drive between a thermal pad (included) on each side when you install it, so both sides will conduct heat to the heatsink. The only tricky park might be fitting it in if the space is crowded but Amazon has a good return policy if it doesn’t fit with your components. There’s always the option of a pci-e m.2 card & heatsink if you have issues with it fitting. I describe the one I had used at the bottom of this comment.
There is also a Sabrent branded heatsink like that one you linked:
Sabrent M.2 2280 SSD Rocket Heatsink (SB-HTSK)
https://www.amazon.com/dp/B07TN2RX2K/
Below is the pci-e card/heatsink I was using, to be clear. The instructions for this one didn’t mention to put the pads on the back of the nvme so I only put one on the front. The fix in my case was to add a pad on the backside of the nvme that was between the card and the nvme drive. so it could conduct heat properly to the heatsink. After that it no longer overheated.
Sabrent NVMe M.2 SSD to PCIe X16/X8/X4 Card with Aluminum Heat Sink (EC-PCIE)
Any regular UPS will provide some backup, probably something with a 850va rating would be a good option, go bigger if you have a lot of drives.
Looks like a rebranded product or common design.
If you do have issues with the fans the heatsink should be large enough to keep pi4 cooled passively with chia, the bearing grind was just a bummer for me since I was using it as a media center.
oh you're right that changes things a lot, looks like you can get that RAM for $35 per 16GB stick and idk how many sticks that server can hold but it would take 8 for $280 to reach 128GB so thats a pretty decent deal.
I'm not trying to discount OPs engineering, it's definitely impressive and obviously works for his needs. But I think the way you mentioned is the better way to go.
Buy a gold rated PSU, some 1 to 5 sata splitters and a multi power supply adapter that automatically turns on the second PSU using a molex connection from the first.
The whole rig to power 50 HDDs is in only about 80 bucks or so and it's a lot like the GPU miners do it. OP is eright that PSUs only offer 20 amps or so on the 5v rail but HDDs only need 1 amp or so on that rail, the rest is 12v
Like I said though, this is just the way I did it and I don't want to discount OP here, so other way you go will work too.
That particular extender is the molded plastic type, notice how the plastic encapsulates the wires where they enter. I haven't seen any on amazon that are fully crimped/terminal pin type, but this one is at least only 1 side molded with the other being terminal pins (so probably higher overall quality than the ketchup and mustard wire cheapies.) https://www.amazon.com/Extension-TeamProfitcom-Female-Extender-Adapter/dp/B08L8WNZGQ/ref=sr_1_8?dchild=1&keywords=sata+extender&qid=1625147733&sr=8-8
Do you have a recommendation for a usb hub? I'm using this one. Rosonway 10 port. Powered USB Hub, Rosonway Aluminum 10 Port USB 3.0 Data Hub with 36W (12V/3A) Power Adapter and Individual On/Off Switches USB Splitter(RSW-A10) https://www.amazon.com/dp/B081DYD25S/ref=cm_sw_r_cp_api_glt_fabc_BF2DDJPMYTSX3YCSZ52G?_encoding=UTF8&psc=1
Circuit breakers are really meant as a last fail-safe on an electrical circuit. I really would recommend not solely relying on one for power protection. If nothing else, regularly tripping circuit breaker can cause it to not operate properly.
A good thing to do is to get a kill-a-watt meter or something that you can monitor the current draw at the outlet because the wall current is always going to be a little higher than what a the pc reports.
I have one of these surge protectors for my home office, different line from my server rack, where I have my workstation, wife's desktop, laptop, other office electronics are connected all on the same circuit. Lets me monitor real time power use so we don't overload anything. The power strip on the server rack has a display showing the amp draw, so I can keep it under the max for the circuit pretty easily.
There are less expensive ones that are not surge protectors and only single outlet monitor if you just want to get an idea of how many watts you're pulling.
Yup, Fans: Pccooler 120mm Fan Moonlight Series 5 in 1 Kit Upgrade,PC-5M120 ARGB LED Computer Case Fan - PWM Cooling Fan - Dual Light Loop Quiet Fan/Multiple Light Modes with Wireless Controller for PC Case https://www.amazon.com/dp/B07QFX1RV1
Usb hub: Sabrent 16-Port USB 3.0 Data HUB and Charger with Individual switches [90 Watts] (HB-PU16) https://www.amazon.com/dp/B07KHRLSTT
Ah, gotcha. I'm buying off of Amazon. Looks like Mean Well is the seller so hopefully no clones: https://www.amazon.ca/gp/product/B0109IMRPS/ref=ppx_yo_dt_b_asin_title_o03_s00?ie=UTF8&psc=1
this but also I zip-tied them all into a tiny milk crate so I can easily secure them and move them around as needed, put them all on a USB hub, and then got them a dedicated power strip for all the wall-warts.
It is indeed watercooled, it's using an all in one kit from corsair. The CPU has a dissipation plate with a pump on top, the pump moves water through the hoses and the liquids gets cooled by the triple slot radiator on the top of the case
The aio is similar to this one https://www.amazon.it/dp/B0829S536D/ref=cm_sw_r_cp_apa_glt_i_D9GCMF23SQEQFSP5ZGJR?_encoding=UTF8&psc=1
What's your budget? The most efficient CPU is the last gen amd epyc cpu. The one with 64 cores 128 threads... I think they are now on 3rd gen.
But here Is a listing for 2gen. https://www.amazon.com/AMD-EPYC-7742-Tetrahexaconta-core-Processor/dp/B07XGB7S36
If you need even more just go for multi cpu server MB with 2-3 slots. You could have 384 cores with that and pare with enough ram and you will be able to do the whole thing in a ram disk.
That would be fast AF but also expensive AF, but I don't know your situation you may be a crypto millioner.
My printer is in pieces right now. Doing a lot of upgrades on it as a side project. I ran it through cura anyway and it looks like 60-80 cents each in PLA, and 3, 4, 5 hours each depending on if you use the recommended settings or not.
/r/printondemand/ might be a good place to try and source this.
Ebay is selling them for $6-$7. You could buy this https://www.amazon.com/Official-Creality-3D-Printer-Source/dp/B07D218NX3, print 52 and throw the printer away and still be at $4 per tray.
Glad you figured it out, just blast the air through those vent slits. I've got a couple of WD externals laying on top of my plotter and have one of these to blow air down them: https://www.amazon.com/gp/product/B00JLV4BWC/ref=ppx_yo_dt_b_asin_title_o00_s00?ie=UTF8&psc=1
Running in a VM with AirVPN. Only has read access to my plots, which was not easy to set up, because hpool wants write access to the plots for some reason. After a bunch of reboots I somehow got the client working without write access to the plots though
Yes! I use this dual TB3 NVMe enclosure configured as a RAID 0 array (benchmarked at 2,500 MB/sec read and write with Blackmagic Disk Speed Test), although I'm sure a single-stick enclosure would work great as long as you don't push the NVMe to its capacity limits.
https://www.amazon.de/gp/product/B082SQT12J/
This one should be able to run 10 at once, just don't plug them it all at once, but instead with a short delay, because the HDD uses more power when spinning up than it does once it is spinning at full speed
Start plotting to them tomorrow, just getting them set up. Seem to have formatted easily. I use this hub it works great!
I was wondering if those 12v distribution psu will work with external drives?
​
I only know of the Asus and Gigabyte quad cards, but they are hard to find for a reasonable price. I've had good luck with single and dual cards on amazon like this one
I'm doing this with 12 14TB USB 3.0 drives right now. My response times are <1s (well under the 30s limit). Here's the hub I'm using:
https://www.amazon.com/dp/B0797NZFYP?psc=1&ref=ppx_yo2_dt_b_product_details
I hate the power buttons, but otherwise it's been pretty solid.
I keep that fan on it and it never gets too warm. Very quiet, efficient little guy —> (Zonsk Flexible Neck Stroller Clip On Fan, Portable Mini USB Fan Battery Operated, Work for Carset, Desktop, Home, Dorm, Office, Outdoor, Indoor (Blue) https://www.amazon.com/dp/B07QN2XCYS/ref=cm_sw_r_cp_api_glt_fabc_3Y7YY7F5FJBD5YTG2R7V?_encoding=UTF8&psc=1)
SAS expanders, a disk shelf typically has 2 ports in and 2 ports out (and a second redundant set that you can not use with SATA drives without help). The expander(s) are inside and part of the backplane.
You can get stand alone expanders like this https://www.amazon.com/HEWLETT-PACKARD-Sas-Expander-Card/dp/B0025ZQ16K/ref=dp_fod_3?pd_rd_i=B0025ZQ16K&psc=1 plug one/two ports from a HBA and get 24 internal drives via 1 to 4 breakout cables or use one or more ports to add more expanders.
SAS works a lot like Ethernet, expanders are basically switches you can daisy chain them together for as many ports as you need. HBA's have limitations 250 and 1000k drives are the typical max for SAS2 HBA's.
I'm using a RAID 0 volume using this Thunderbold dual NVMe enclosure: https://www.amazon.com/gp/product/B08S5JPWR6 (It's got a comically-big power supply for no reason. Also, do not use the included silicone cover during use.)
I haven't re-tested it but I assume it'd do just as well, since I'm still at 85% lifetime left (on each of the two drives) on 178TB written. I did my testing with Blackmagic Disk Test, and I monitor my drives with DriveDx.
You're usually right about that if you use a traditional VPN-provider like NordVPN, but if you purchase a VPS and set up your own VPN with for example WireGuard, you can open any port you want. There are guides on how to do so, one even linked on the Github Wiki:
I'm not getting too fancy -- just each drive by itself shared out over SMB/CIFS. Just added the drives to my Harvester and it goes. Even with 7 Drives & 480+ plots it's still ~1 second to check all the plots.
I went with the Sabrent 5Gig USB Adapters (link) because they're just one giant heatsink and had good review for Linux compatibility.
So far I don't see why people would advise against NAS -- it's honestly better than having a zillion USB drives daisy chained across hubs IMHO
I got 7 PCIe to NVME adapters and they all work no problem. They are cheap chinese garbage ones from amazon. So you shouldn't have an issue. Your motherboard can run 2 NVME's already so just add 2 PCIE adapters.
This is the one I have for example. Note the second slot is SATA nvme so unused.
https://amazon.com/Adapter-advanced-solution-Controller-Expansion/dp/B07JKH5VTL/
So this was an unraid server before, The cards I got we're IBM M1015 LSI 2008 SERVRAID cards. Because UNRAID doesn't like RIAD cards I had to flash the cards to IT mode so they just act as SATA ports essentially. If you're running windows they should work without flashing them. Then just grab some of these cables.
If you're taking the drives out of external hard drive enclosures you might need to either tape some pins or use molex to sata adapters like I did to get the drives to work.
Thanks, that's actually still an okayish price. Even thought with sub 10 tb per hdd you would run out of ports quicker and would have to invest into connectivity hardware.
I wonder if connecting a ton of small (8tb) usb hdds using powered usb hubs like this would work https://www.amazon.de/-/en/RSH-A10/dp/B082SQT12J/ref=sr_1_5?dchild=1&keywords=usb+hub+strom&qid=1620822300&sr=8-5
I can recommend this: https://www.amazon.com/Sabrent-Thunderbolt-Tool-Free-Enclosure-EC-T3DN/dp/B08S5JPWR6
The power connection to the drive seemed a bit unsatisfying but has worked fine. DO NOT use the silicone cover while it's in use (which seems obvious, but I didn't see it mentioned in instructions). I've set mine up as a RAID 0 array, and benchmarked it at 2,500MB/s read and write.
The go-to is like the Rosewell 4U, DIY either stacks on the floor or I think something like the Phanteks drive bays could easily be made into a nice DIY setup somewhere between. Should be able to DIY fit them into almost any case, with some DIY spirit.
I have a 5950X with 128GB Ram.
Have 2 NVMes on my MB, two extra slots through PCIe.
Running 4 Jobs // per NVME (90Min stage) and that ships 3.5TiB / Day, knowing I buffer my "final plots" to Nvmes and move them around through CRON Jobs.
Now those Nvmes are Gen3, CPU runs at 50%. Will try to get some of those.
Tweaking my conf might increase efficiency, but I'd say you can't really expect 10TiB.
As a comparison 3700 with 2 NVMEs and 32Gbs ships around 2TiB/day.
I installed this one last night with 8 8tb seagate hdd and it’s working great. I have another one on the way Rivo PCIe SATA Card, 8 Port with 8 SATA Cable, SATA Controller Expansion Card with Low Profile Bracket, Marvell 9215 Non-Raid, Boot as System Disk, Support 8 SATA 3.0 Devices(SA3014) https://www.amazon.com/dp/B0828FY1B2/ref=cm_sw_r_cp_api_glt_fabc_JNSWACMTVZWC9BDWG33C
Yep, if you've got the right type of open slot for it. You'll most likely need a sata power splitter also.
Then this is for when you want to get really fancy. https://www.amazon.com/dp/B00V7NOJIS/ref=cm_sw_r_cp_apa_glt_fabc_A8ARA730S3FMHP46VA5B?_encoding=UTF8&psc=1
My cases used to my a mess before I discovered these as I've always been a data hoarder and run way to many hard drives.
Some pretty large setups (over 50 disks) have been done with nothing more than buying a few 16-port USB hubs, and plugging in external USB HDDs. You may become entangled in the power adapters and USB cables, and die of starvation, but it would be cheap.
I think a normal progression may be to use internal+external drives to get to 4-8 disks. Then consider shucking everything to get to 20 with a tower case (example) and some extra PCIe SATA cards.
Larger than that you may look at used server that hold 8-12 drives each (like Dell R720xd), or 4u setups that hold 24-45, and start looking at SAS HBAs+expanders to avoid running individual SATA cables. SAS also lets you use cheap used drive shelves (holding 12-24 disks each - Dell SC200/220) and avoid having to buy a new computer for every case.
Once you start looking at used enterprise gear, go to r/homelab and r/datahoarder for advice: I just mentioned a couple samples.
Sata controller. I bought this one:
https://www.amazon.co.uk/gp/product/B00AZ9T3OU/ref=ppx_yo_dt_b_asin_title_o05_s00?ie=UTF8&psc=1
I have all my internal drive running in RAID0 to help with disk speeds.
In my experience the SIL3114-based ones are most reliable. E.g. https://www.amazon.com/Adapter-Converter-Silicon-Sil3114-Chipset/dp/B008BZB29E
The Highpoint HPT374 ones have been least reliable for me.
Exactly. I'm new to this, but I figured something out:
Try buying one of these if you can stomach it: https://www.amazon.com/Sabrent-Rocket-Internal-Performance-SB-RKTQ-2TB/dp/B0829DZH2W/ref=sr_1_5?dchild=1&keywords=2tb%2Bnvme&qid=1619494461&sr=8-5&th=1
This is a 2TB NVME SSD. I don't know if you already have an NVME drive but they're the fastest on the market. A 2TB NVME will be able to plot around 6 plots at a time in parallel since each plot will take up around 300GB of that NVME at a time. Assuming you have a monsterous machine with your 256 GB of RAM, you'll probably be able to pull off around 12 plots a day on a machine like that with just one of those sticks if you enable 4 threads per que.
Hope that helps.
The temp drive needs to be the NVMe one, since it is the fastest. Plotting is bloody murder on SSDs so it is better if it is not an important drive, like your boot drive.
You can plot as a destination to any drive.
I use a cheap walmart ssd 1tb for plotting, so if it burns up, just pop a new one in. I have it set to plot 2 in parallel, doubled the ram, 4 threads. My specs are similar, though your rig is stronger. I use a risen 5 6 core with 64g ram. Plotting this way takes me about 6 hours.
The farm destination harddrive is Western Digital DC HC500 18tb. This is enterprise data center grade because I want it to last. My plan is when I finish filling this up, I will daisy chain another, then another etc etc. Reason I chose this method is because it gives me a way to basically have unlimited amount of drives. How? There are in self powered highemd enclosures with built in hub for daisy chaining. https://www.amazon.com/gp/product/B08VF46H52/ref=ppx_yo_dt_b_asin_title_o00_s00?ie=UTF8&psc=1 Cost a little over 600.00. Not bad since you can move them to other computers and daisy chain the living crap out of them. Only buying them one at a time though, as they are pricey..
You can buy a pci-e adapter for nvme drivers like the link below. Although i would recomend to buy one with thermal sink.
On the Chia plotting basics article Gene says:
>All of that said, for my personal plotting I use a 2017 iMac and a 12TB Western Digital external drive on USB 3.0 for both temporary and final directory and I get a k32 about every 10 hours.
How'd he manage that?
Nah I don't think so. I think you should be fine with a 512GB SSD to do 1 plot. A 1TB should do 2 or 3 I believe. I have this in a 2TB and I just bought another in a 1 TB. On the 2TB NVMe drive I can do 4 plots simultaneously
https://www.amazon.com/dp/B07RCM6DXK/ref=cm_sw_r_cp_apa_glt_fabc_HYBRSZ5PDE7TCPVPK9VV
G-Technology 24TB G-SPEED Shuttle XL Thunderbolt 3 with ev Series Bay Adapters Storage Solution - Transportable, hardware RAID, 8-Bay - 0G05937-1 https://www.amazon.com/dp/B071DYZNXV/ref=cm_sw_r_cp_api_glt_fabc_NW9HYMWRXGBWZ2T6EYMM
I'll try four next time! Do you stagger the plot start?
Have you automated starting new parallel plots?
Went down the rabbit hole and ended up with a Fledging Shell Thunder SSD Enclosure: https://www.amazon.com/gp/product/B07QY9V2KM/
Was looking for a way to connect 6 Seagate Portable 5TB 2.5" HDDs to my Raspberry and found your post.
Can you please share which hubs exactly are you using? Is it available from Amazon? I purchased this one but can't connect more than 2 of these HDDs to it... when trying to connect a 3rd one, I start getting lots of USB errors :-/
TIA!
hmm...talking bladebit.
Using either Samsung 970 Pro NVME 1TB (high sustained consistent write speed around 1400MB/s via Thunderbolt 3 Enclosure) OR Samsung 970 EVO Plus NVME 2TB (also high sustained consistent write speed around 1400MB/s via Thunderbolt 3 Enclosure).
Samsung 970 Pro would have much higher sustained consistent Write speed than Samsung 970 EVO Plus without Thunderbolt 3 enclosure (around 2400 MB/s) but for MacBook we don't have any choice but stick NVME in Thunderbolt 3 Enclosure (Sabrent in my case). But given the Thunderbolt 3 enclosure as a bottleneck to achieve 2400 MBs/s...kinda leaves out the write speed. So I switched to 2x cheaper Samsung 970 EVO Plus nvme.
Writing on the 'final destination' (during Phase 3 in bladebit) is a part of plot creation so you have to factor it and this will slow down the plotting via bladebit (it did in my case). So I had to stick my HDD (for final destination) to a SATA HDD Docking Station which boosted my plotting time for bladebit from 60+ to 46 mins.
​
UPD: now I use SSD (to shave another 6-7 mins off to 37-38 mins) as a final destination and some good man advised to use a simple 'while loop' command (to run in terminal) to automatically transfer plots from SSD to HDD. But this transfer happens after plot is created so it kinda happens in parallel and does not impact plot creation time.
​
UPD#2: testing SSD RAID0 to shave few more mins for Phase 1. But honestly with all the investments it would be more reasonable to buy a Dell Workstation or server (with 2x CPU and 500_GB of RAM) for RAM plotting via bladebit...10ish mins I reckon. So I am on a fence. Don't want to run another machine.
Hope this helps.
First I have to learn to use Linux.. :)
The economy in Turkey is very bad, there is a crisis. Government policies.
They want to implement the export economy model based on high exchange rates. But as a people, we are crushed under it.
I recommend Turkey for your next vacation, my friend. By spending 10 times less than your previous vacations, you will have a 10 times better vacation. (Work part time for 1 week at any McDonald's there, you can have an all-inclusive holiday here for 1 month with the money you earn.)
Turkey is really a beautiful country. Only, managers are dumb.. :)
The hard disk you can see is 9,250 TL. If we divide it by 18.5, it comes to $500. This is the cheapest in Turkey.
>QNAP TL-D800C
I'm curious about the limitations myself... Is it the specs for MAC mini M1 or Thunderbolt 3/4 protocol that limit the daisy chaining up to 5x Thunderbolt devices (like Sabrent 5-bay) per each port?
Via direct connect (to back of MAC m1 mini), I'm curious have you attempted adding 5x then the remaining 3x JBODs on the other Thunderbolt port via daisy-chain?
OR
Via indirect connect (3rd party hub in the middle), I'm wondering if anyone has tested the CalDigit Thunderbolt 4 Element Hub... then connecting 3 rows of 5x JBODs daisy-chained?
I currently only have 1 of the 3 Thunderbolt options daisy-chained out 5x via the CalDigit hub plus 5 Sabrent 5-bays.
Currently, I am using a couple of these dual bays from Orico and they work solid: https://www.amazon.es/ORICO-6239C3-C-EU-CR-GL-Reloj-de-Pulsera/dp/B07X3BTRWP (currently not available)
Alternatively, I found more on Wallapop: https://es.wallapop.com/item/orico-6239c3-c-2-5-3-5-dual-bay-usb3-0-type-c-818051863
I use these (on Amazon) to monitor continuous loads. $17 for two and they can be used for other things when you’re done measuring. They report milliamps, watts, and voltage with a couple second delay along with KWh measured over daily periods. The limitations are you can’t measure surge levels or things pulling more than 15 amps.
Get serveral of these;
https://www.amazon.com/360-Electrical-36051-Outlet-Protector/dp/B00AOR2QZG/
power strips plugged in to power strips
as long as you are only running external HDD's you should not have much to worry about
Thanks, so I purchased the SABRENT Thunderbolt 3 to Dual NVMe M.2 SSD Tool-Free Enclosure. I added 2x Samsung 970pro 1TB SSDs into the enclosure mounting via Apple's software RAID 0. My speeds are still ~60mins or so on the 16TB M1 mini running MadMax. After reviewing the spreadsheet, I'm wondering where the bottle neck might be... any suggestions?
Sabrent USB 3.2 5-Bay 3.5" SATA... https://www.amazon.com/dp/B07Y4F5SCK?ref=ppx_pop_mob_ap_share
I have a lot of these that I need to sell because my main farm is using enterprise JBOD now.
Drives do not disconnect or disappear requiring power cycles with these
Hey guys,
​
I'm starting to prepare raspi's for chia farming.
i've a couple of nvme's and i'm planing to use them for the Chia database.
Is it as easy as i think with just pluging in one of these NVME USB-Adapter with my nvme in it
or do i have to take sth else into consideration?
Those cables give you either a sata or molex power connector depending on what you get.
https://www.amazon.com/CABLEDECONN-SFF-8087-SFF-8482-Connectors-Power/dp/B06XPGGY9L is a example of one with sata power.
Bro, if you add up the costs for all the cables and accessories needed to run that circus, it's probably more than a good used supermicro storage chassis. I've recently seen a 96 bay server go for €400. You'd need sas 4-way cables. Those sell for €10 a piece minimum. Times 24 is €240. You need the power cables. Something like this i think https://www.amazon.nl/Splitter-voedingskabel-Gelrhonr-Conversie-Extension/dp/B08RMPYR1J/ref=mp_s_a_1_5?crid=ONB4H5EE3BZD&keywords=molex+to+sata&qid=1648280597&sprefix=molex+%2Caps%2C103&sr=8-5 19 times that (your power supply probably has some already) is €227,67. Now you're already more expensive than that chassis. And i haven't even mentioned the fact that your power supply probably does not have that many molex connectors so you'd need either more splitter cables or more power supplies. Where do you get controllers with that many ports? Need i go on?
I'd recommend this as a workaround for any secure data you want in physical form, nice to have the self destruct option if in duress
https://www.amazon.com/dp/B01AJNGF4W/ref=twister_B082JXK2TG?_encoding=UTF8&psc=1
I think you'd enjoy learning how to run a RPi in general: it's a cool little device!
But if it's just Windows Updates that are bugging you, there are many tools to take care of them. Lots of people running GPU miners run apps like this, once ... then Windows will never reboot for patches ever again (plus it turns off all the spyware/telemetry bits).
Have fun!
There are several utils that disable the update/spyware/phone-home features in Win10. I use this on mining systems: run it once and Windows will never update (or reboot for an update) again.
You should still periodically update yourself: to make sure you're not open to some horrible vulnerability. But you're an adult, you do you :)
Yes, go park your NFT on Storj, and then pay over time for others to persist it for you. (or for systems like IPFS, pay to host a mirror yourself, forever)
People seem to be willing to run nodes for L1/L2 projects just out of the goodness of their hearts (Bitcoin still needs less than 500GB). But nobody will run storage systems that consume TiB/PiB/EiB for free.
Yikes! Very pretty at least. When I had only 5 or so drives I found these to be helpful:
If you can't set the permissions on the root directory of the NTFS hard drive, perhaps you can create a directory within and set permissions/ownership on that. If you can't change those permissions, either you are not using sudo, or the NTFS drive is not mounted correctly for write.
Also whatever user you have Chia running as (installed with) is what ownership needs to be for the DB directory. You might be logged in as 'pi', but your chia service account might be something else ('chia' in my case).
80 GB free space is going to run out pretty quickly for the database, as it is growing. As well, chia database on HDD (especially on Rpi) will have sync issues during dust storms. Strongly consider an SSD like this one for your DB.
I'll second this. Running a similar setup (rpi4), and had my Chia wallet and sqlite db on HDD. Frequently lost sync during dust storms and had to restart to get it syncing again. Lots of lost time out of sync.
Moved the wallet and DB to this SSD, and it's been solid for 2 weeks now. I had also constantly had 1% stale, that's now consistently 0%.
There are several ways to do it.
I did #2 but planning to do change it to #3 shortly.
I think depending on your max 5V A and 12V A you could probably connect like 50 HDDs to you 1000W PSU if you use a x4 sata power splitter sata Power Splitter if you use these for every original sata Power Plug of your PSU you you’ll theoretically power almost 100 HDDs but I guess you run into other bottlenecks before you reach that number
BAY Direct 2-Pack Add2PSU Multiple Power Supply Adapter (ATX 24Pin to Molex 4Pin) and Daisy Chain Connector-Ethereum Mining ETH Rig Dual Power Supply Connector https://smile.amazon.com/dp/B077VQL5NT/ref=cm_sw_r_cp_api_glt_i_2REWYPR8PEQXHMV73Q1T?_encoding=UTF8&psc=1
I am using this one without issue
https://www.amazon.com/gp/product/B09DYVX5VJ/?th=1
only thing is that you must install the drivers from the included mini-CD for it to work, otherwise only 1 SATA drive is detected