☰
Current Page
Main Menu
Home
Home
Editing
StorageServer
Edit
Preview
h1
h2
h3
Keybinding
default
vim
emacs
Markup
Markdown
Plain Text
Pod
RDoc
reStructuredText
AsciiDoc
BibTeX
Creole
MediaWiki
Org-mode
Textile
Help 1
Help 1
Help 1
Help 2
Help 3
Help 4
Help 5
Help 6
Help 7
Help 8
Autosaved text is available. Click the button to restore it.
Restore Text
--- title: StorageServer --- [[_TOC_]] # Requirements * ACLs * Fault-tolerant RAID * 3+ Terabyte capacity * Data encryption * Data partitioning * User quotas ## Secondary Requirements ### Backup * <http://backuppc.sourceforge.net/index.html> * * * # Configuration * 4-8 Disk RAID6 * dmcrypt * LVM Linux >2.6.17 can resize RAID5 # Data Partitioning * Inherits [MediaCentre.BackEnd][24] requirements * User data (/home) * Backup data (/systems) * Project data (/src) * Multimedia data (/media) * Fast access data (RAID0) # Filesystem * [ext4 vs XFS][26] ## XFS * Very fast * ACLs * Not-resizeable Both XFS and JFS are good candidates. Benchmarking from 2004: <http://linuxgazette.net/102/piszcz.html> "XFS is only safe when you have: a) no write caching on the drive (barrier or nobarrier) b) non-volatile write caching on the drive (barrier or nobarrier) c) volatile write caching and barriers supported and enabled The same conditions hold true for any filesystem that requires I/O ordering guarantees to maintain filesystem consistency..." - [SGI Archive][27] [Opinions on XFS vs JFS][28] XFS important options: * mkfs.xfs -l size=128m (seems to be the default) * nobarrier? * noatime * block size <= page size (Linux limit) (4k on x86_64) ### RAID 5 tuning * [Don't specify su or sw][29], mkfs.xfs does the right thing. * ONLY on LVM or dmraid devices. For dmcrypt or HW raid they need to be specified manually. * <http://www.eecs.harvard.edu/~stein/PAPERS/hotosx-html/> sunit = DM chunk size swidth = sunit × (N-1) N = disks in RAID 5 array ## EXT4 * Resizeable * ACLs * Comparable performance to XFS, better metadata performance * Clear upgrade path to btrfs. (btrfs_convert) * * * # Hardware CPU Power * Buffalo TeraStation uses Freescale MPC8241 PPC @ 266MHz, 128MB RAM * TeraStation has Realtek 8110 ethernet, not Jumbo clean ## Commercial NAS | **Model** | **Bays** | **Price** | **Link** | || | Buffalo Terastation Pro | 4 | ~700 | | | Synology 407e | 4 | £380 | | | Infrant ReadyNAS NV+ | 4 | £500 | | | D-Link DNS-323 | 2 | £150 | [froogle][34] | ## Hardware Raid Adapters | **Model** | **Type** | **Ports** | **Price** | || | Adaptec 2410SA | SATA | 4 | £220 | | HighPoint RocketRAID 1640 | SATA | 4 | | | ICP Vortex 8546RZ | SATA | 4 | | | LSI MegaRAID 150-4 | SATA | 4 | | ## Software Raid Adapters | **Model** | **Type** | **Ports** | **Price** | || | Adaptec 1430SA | PCI-E | 4 | £62 | | Promise SATA300 TX4 | PCI-66 | 4 | £55 | | Promise SATA300 TX4302 | PCI-66 | 2, 2e | £55 | [http://www.span.com/catalog/product\_info.php?products\_id=5090&source=gbaseuk¤cy=GBP][41] ## eSATA adapters * [Tempo-X eSATA 8 ~£210][42] * [4xSATA to Multilane £13][43] * [Multilane to 4xSATA £13][44] ## Disk Enclosures * [Span 8-bay iSCSI: £336][45] * [Span 8-bay eSATA: £100][46] * [1U 4-bay generic: Eclipse £77][47] * [SeriTek 1EN2 £105][48] - hotswap * [Highpoint X4][49] - 4-bay Multilane * [CF-10 series][50] ## Hard Disks * [http://tomshardware.co.uk/2007/05/15/the\_spring\_hard\_drive\_guide_uk/][51] Maxtor: 250=6.5, 320=6.8 WD: 320=5.9, 400=4.8, 500=6.4 Seagate: 400=5.47, 500=6.7 (ST3500641AS), 500=5.95 * | **Model** | **Buffer** | **Capacity** | **Price** | **Warranty** | || | [Samsung HD501LJ][53] | 16 | 500 | 69 (Scan) | 3 | | [WD5000KS][54] | 16 | 500 | 80 (Misco) | 3 | | [Seagate 7200.10 ST3500630AS][55] | 16 | 500 | OEM 87, Dabs 77 | 5 non-OEM | * * * # Notes * For connecting disk enclosures to external controller * eSATA (one per SATA channel) * Infiniband (one per 4 SATA channels) * * * # SAS, eSATA, ML * <http://www.anandtech.com/printarticle.aspx?i=2859> - intro to server storage ## Port Multipliers Support from patched 2.6.22 * <http://home-tj.org/wiki/index.php/Libata-tj-stable> - status * <http://www.avsforum.com/avs-vb/showthread.php?t=869763> * [SATA PM vs SATA ML][56] * <http://www.mail-archive.com/linux-ide@vger.kernel.org/> - Linux-ide mailing list archive * <http://marc.info/?l=linux-ide&m=118825737704343&w=2> - SiI3132 is buggy (Limited to 120MB/sec) * <http://www.amug.org/amug-web/html/amug/reviews/reviews.html> - Loads of reviews of enclosures * <http://www.amug.org/amug-web/html/amug/reviews/articles/addonics/adsa3gpx8-4em/> - SiI3124 beats 120MB/sec * * * # RAID * Calculator: <http://www.ibeast.com/content/tools/RaidCalc/RaidCalc.asp> * <http://articles.techrepublic.com.com/5100-6349-1054944.html> - Guide * <http://www.chemistry.wustl.edu/~gelb/castle_raid.html> - HW vs SW RAID5 * * * # Links <http://tweakers.net/reviews/557/29> - comparison of 9 SATA hardware raid cards <http://www.chemistry.wustl.edu/~gelb/castle_raid.html> - software vs hardware raid (Linux) <http://www.hwb.no/artikkel/15307> <http://www.smallnetbuilder.com/content/view/27840/77/> - build a cheap and fast raid 5 NAS <http://www.terastation.org/wiki/Hacking> <http://www.terastation.org/wiki/Real_NAS> <http://www.cooldrives.com/eidrrerasaii.html> <http://www.span.com/> - Storage array cases [http://tomshardware.co.uk/2007/05/15/the\_spring\_hard\_drive\_guide_uk/][51] <http://marc.info/?l=linux-raid&m=108225929401354&w=2> - thread on 3TB array <http://smartmontools.sourceforge.net/> - watching SMART for signs of failure <http://forums.anandtech.com/messageview.cfm?catid=27&threadid=2047740> - 3-5 TB raid [http://en.wikipedia.org/wiki/Lustre\_%28file\_system%29][59] <http://www.gagme.com/greg/linux/raid-lvm.php> - Linux LVM and RAID [Tom's hardware - entry-level storage components review][60] <http://www.shimari.com/dm-crypt-on-raid/> - dmcrypt on RAID howto [24]: /MediaCentre/BackEnd [26]: http://www.phoronix.com/scan.php?page=article&item=ext4_benchmarks [27]: http://oss.sgi.com/archives/xfs/2006-07/msg00174.html [28]: http://www.dslreports.com/forum/r18913179-Opinions-on-XFS-vs-JFS [29]: http://oss.sgi.com/archives/xfs/2001-11/msg00401.html [34]: http://www.google.co.uk/products?q=DNS-323 [41]: http://www.span.com/catalog/product_info.php?products_id=5090&source=gbaseuk¤cy=GBP [42]: http://www.barefeats.com/hard45.html [43]: http://www.span.com/catalog/product_info.php?products_id=6812 [44]: http://www.span.com/catalog/product_info.php?products_id=6813 [45]: http://www.span.com/catalog/product_info.php?cPath=19_1001_1053&products_id=1452 [46]: http://www.span.com/catalog/product_info.php?cPath=19_1302_1329&products_id=8234 [47]: http://www.eclipsecomputers.com/product.aspx?code=CN-A1000BK&af=50 [48]: http://www.tech.co.uk/computing/upgrades-and-peripherals/storage/accessories/review/firmtek-seritek1en2 [49]: http://www.highpoint-tech.com/USA/x4mac.htm [50]: http://www.cfienclosure.com/10_Series.html [51]: http://tomshardware.co.uk/2007/05/15/the_spring_hard_drive_guide_uk/ [53]: http://www.google.co.uk/products?q=HD501LJ [54]: http://www.google.co.uk/products?q=WD5000KS [55]: http://www.google.co.uk/products?q=ST3500630AS [56]: http://searchstorage.techtarget.com/expert/KnowledgebaseAnswer/0,289625,sid5_gci1242421,00.html [59]: http://en.wikipedia.org/wiki/Lustre_%28file_system%29 <!-- vim: filetype=markdown -->
Uploading file...
Sidebar
# SideBar * [Home][1] * [Projects][2] * * * <!-- --> * [Code][3] * [Tech][4] * [Network][5] * [MediaCentre][6] * [UAV][7] * * * <!-- --> * [Travel][8] * [Music][9] * [Horse Riding][10] * [Study][11] * [Games][12] * [Other Activities][13] * * * <!-- --> * [Car][14] * [House][15] * [Watch][16] * [Clothing][17] * [Miscellany][18] * * * [1]: /Home [2]: /Projects [3]: /Code/Code [4]: /Tech/Tech [5]: /Network/Network [6]: /MediaCentre/MediaCentre [7]: /UAV/UAV [8]: /Travel/Travel [9]: /Music/Music [10]: /HorseRiding/HorseRiding [11]: /Study/Study [12]: /Games/Games [13]: /Do/Do [14]: /Car/Car [15]: /House/House [16]: /Watch/Watch [17]: /Clothing/Clothing [18]: /Miscellany/Miscellany <!-- vim: filetype=markdown -->
Edit message:
Cancel