☰
Current Page
Main Menu
Home
Home
Editing StorageServer
Edit
Preview
H1
H2
H3
default
Set your preferred keybinding
default
vim
emacs
markdown
Set this page's format to
Markdown
Plain Text
Pod
RDoc
reStructuredText
Rendering unavailable for
AsciiDoc
BibTeX
Creole
MediaWiki
Org-mode
Textile
Help 1
Help 1
Help 1
Help 2
Help 3
Help 4
Help 5
Help 6
Help 7
Help 8
Autosaved text is available. Click the button to restore it.
Restore Text
--- title: StorageServer --- [[_TOC_]] # Requirements * ACLs * Fault-tolerant RAID * 3+ Terabyte capacity * Data encryption * Data partitioning * User quotas ## Secondary Requirements ### Backup * <http://backuppc.sourceforge.net/index.html> * * * # Configuration * 4-8 Disk RAID6 * dmcrypt * LVM Linux >2.6.17 can resize RAID5 # Data Partitioning * Inherits [MediaCentre.BackEnd][24] requirements * User data (/home) * Backup data (/systems) * Project data (/src) * Multimedia data (/media) * Fast access data (RAID0) # Filesystem * [ext4 vs XFS][26] ## XFS * Very fast * ACLs * Not-resizeable Both XFS and JFS are good candidates. Benchmarking from 2004: <http://linuxgazette.net/102/piszcz.html> "XFS is only safe when you have: a) no write caching on the drive (barrier or nobarrier) b) non-volatile write caching on the drive (barrier or nobarrier) c) volatile write caching and barriers supported and enabled The same conditions hold true for any filesystem that requires I/O ordering guarantees to maintain filesystem consistency..." - [SGI Archive][27] [Opinions on XFS vs JFS][28] XFS important options: * mkfs.xfs -l size=128m (seems to be the default) * nobarrier? * noatime * block size <= page size (Linux limit) (4k on x86_64) ### RAID 5 tuning * [Don't specify su or sw][29], mkfs.xfs does the right thing. * ONLY on LVM or dmraid devices. For dmcrypt or HW raid they need to be specified manually. * <http://www.eecs.harvard.edu/~stein/PAPERS/hotosx-html/> sunit = DM chunk size swidth = sunit × (N-1) N = disks in RAID 5 array ## EXT4 * Resizeable * ACLs * Comparable performance to XFS, better metadata performance * Clear upgrade path to btrfs. (btrfs_convert) * * * # Hardware CPU Power * Buffalo TeraStation uses Freescale MPC8241 PPC @ 266MHz, 128MB RAM * TeraStation has Realtek 8110 ethernet, not Jumbo clean ## Commercial NAS | **Model** | **Bays** | **Price** | **Link** | || | Buffalo Terastation Pro | 4 | ~700 | | | Synology 407e | 4 | £380 | | | Infrant ReadyNAS NV+ | 4 | £500 | | | D-Link DNS-323 | 2 | £150 | [froogle][34] | ## Hardware Raid Adapters | **Model** | **Type** | **Ports** | **Price** | || | Adaptec 2410SA | SATA | 4 | £220 | | HighPoint RocketRAID 1640 | SATA | 4 | | | ICP Vortex 8546RZ | SATA | 4 | | | LSI MegaRAID 150-4 | SATA | 4 | | ## Software Raid Adapters | **Model** | **Type** | **Ports** | **Price** | || | Adaptec 1430SA | PCI-E | 4 | £62 | | Promise SATA300 TX4 | PCI-66 | 4 | £55 | | Promise SATA300 TX4302 | PCI-66 | 2, 2e | £55 | [http://www.span.com/catalog/product\_info.php?products\_id=5090&source=gbaseuk¤cy=GBP][41] ## eSATA adapters * [Tempo-X eSATA 8 ~£210][42] * [4xSATA to Multilane £13][43] * [Multilane to 4xSATA £13][44] ## Disk Enclosures * [Span 8-bay iSCSI: £336][45] * [Span 8-bay eSATA: £100][46] * [1U 4-bay generic: Eclipse £77][47] * [SeriTek 1EN2 £105][48] - hotswap * [Highpoint X4][49] - 4-bay Multilane * [CF-10 series][50] ## Hard Disks * [http://tomshardware.co.uk/2007/05/15/the\_spring\_hard\_drive\_guide_uk/][51] Maxtor: 250=6.5, 320=6.8 WD: 320=5.9, 400=4.8, 500=6.4 Seagate: 400=5.47, 500=6.7 (ST3500641AS), 500=5.95 * | **Model** | **Buffer** | **Capacity** | **Price** | **Warranty** | || | [Samsung HD501LJ][53] | 16 | 500 | 69 (Scan) | 3 | | [WD5000KS][54] | 16 | 500 | 80 (Misco) | 3 | | [Seagate 7200.10 ST3500630AS][55] | 16 | 500 | OEM 87, Dabs 77 | 5 non-OEM | * * * # Notes * For connecting disk enclosures to external controller * eSATA (one per SATA channel) * Infiniband (one per 4 SATA channels) * * * # SAS, eSATA, ML * <http://www.anandtech.com/printarticle.aspx?i=2859> - intro to server storage ## Port Multipliers Support from patched 2.6.22 * <http://home-tj.org/wiki/index.php/Libata-tj-stable> - status * <http://www.avsforum.com/avs-vb/showthread.php?t=869763> * [SATA PM vs SATA ML][56] * <http://www.mail-archive.com/linux-ide@vger.kernel.org/> - Linux-ide mailing list archive * <http://marc.info/?l=linux-ide&m=118825737704343&w=2> - SiI3132 is buggy (Limited to 120MB/sec) * <http://www.amug.org/amug-web/html/amug/reviews/reviews.html> - Loads of reviews of enclosures * <http://www.amug.org/amug-web/html/amug/reviews/articles/addonics/adsa3gpx8-4em/> - SiI3124 beats 120MB/sec * * * # RAID * Calculator: <http://www.ibeast.com/content/tools/RaidCalc/RaidCalc.asp> * <http://articles.techrepublic.com.com/5100-6349-1054944.html> - Guide * <http://www.chemistry.wustl.edu/~gelb/castle_raid.html> - HW vs SW RAID5 * * * # Links <http://tweakers.net/reviews/557/29> - comparison of 9 SATA hardware raid cards <http://www.chemistry.wustl.edu/~gelb/castle_raid.html> - software vs hardware raid (Linux) <http://www.hwb.no/artikkel/15307> <http://www.smallnetbuilder.com/content/view/27840/77/> - build a cheap and fast raid 5 NAS <http://www.terastation.org/wiki/Hacking> <http://www.terastation.org/wiki/Real_NAS> <http://www.cooldrives.com/eidrrerasaii.html> <http://www.span.com/> - Storage array cases [http://tomshardware.co.uk/2007/05/15/the\_spring\_hard\_drive\_guide_uk/][51] <http://marc.info/?l=linux-raid&m=108225929401354&w=2> - thread on 3TB array <http://smartmontools.sourceforge.net/> - watching SMART for signs of failure <http://forums.anandtech.com/messageview.cfm?catid=27&threadid=2047740> - 3-5 TB raid [http://en.wikipedia.org/wiki/Lustre\_%28file\_system%29][59] <http://www.gagme.com/greg/linux/raid-lvm.php> - Linux LVM and RAID [Tom's hardware - entry-level storage components review][60] <http://www.shimari.com/dm-crypt-on-raid/> - dmcrypt on RAID howto [24]: /MediaCentre/BackEnd [26]: http://www.phoronix.com/scan.php?page=article&item=ext4_benchmarks [27]: http://oss.sgi.com/archives/xfs/2006-07/msg00174.html [28]: http://www.dslreports.com/forum/r18913179-Opinions-on-XFS-vs-JFS [29]: http://oss.sgi.com/archives/xfs/2001-11/msg00401.html [34]: http://www.google.co.uk/products?q=DNS-323 [41]: http://www.span.com/catalog/product_info.php?products_id=5090&source=gbaseuk¤cy=GBP [42]: http://www.barefeats.com/hard45.html [43]: http://www.span.com/catalog/product_info.php?products_id=6812 [44]: http://www.span.com/catalog/product_info.php?products_id=6813 [45]: http://www.span.com/catalog/product_info.php?cPath=19_1001_1053&products_id=1452 [46]: http://www.span.com/catalog/product_info.php?cPath=19_1302_1329&products_id=8234 [47]: http://www.eclipsecomputers.com/product.aspx?code=CN-A1000BK&af=50 [48]: http://www.tech.co.uk/computing/upgrades-and-peripherals/storage/accessories/review/firmtek-seritek1en2 [49]: http://www.highpoint-tech.com/USA/x4mac.htm [50]: http://www.cfienclosure.com/10_Series.html [51]: http://tomshardware.co.uk/2007/05/15/the_spring_hard_drive_guide_uk/ [53]: http://www.google.co.uk/products?q=HD501LJ [54]: http://www.google.co.uk/products?q=WD5000KS [55]: http://www.google.co.uk/products?q=ST3500630AS [56]: http://searchstorage.techtarget.com/expert/KnowledgebaseAnswer/0,289625,sid5_gci1242421,00.html [59]: http://en.wikipedia.org/wiki/Lustre_%28file_system%29 <!-- vim: filetype=markdown -->
Uploading file...
Sidebar
# SideBar * [Home][1] * [Projects][2] * * * <!-- --> * [Code][3] * [Tech][4] * [Network][5] * [MediaCentre][6] * [UAV][7] * * * <!-- --> * [Travel][8] * [Music][9] * [Horse Riding][10] * [Study][11] * [Games][12] * [Other Activities][13] * * * <!-- --> * [Car][14] * [House][15] * [Watch][16] * [Clothing][17] * [Miscellany][18] * * * [1]: /Home [2]: /Projects [3]: /Code/Code [4]: /Tech/Tech [5]: /Network/Network [6]: /MediaCentre/MediaCentre [7]: /UAV/UAV [8]: /Travel/Travel [9]: /Music/Music [10]: /HorseRiding/HorseRiding [11]: /Study/Study [12]: /Games/Games [13]: /Do/Do [14]: /Car/Car [15]: /House/House [16]: /Watch/Watch [17]: /Clothing/Clothing [18]: /Miscellany/Miscellany <!-- vim: filetype=markdown -->
Edit message:
Cancel