BWFSTechnicalTraining-5.5.2

ContentSession1IntroductionBWFSKeyValueBWFSArchitectureand

DeploymentScenariosKeyfeatureGUIofMDCandCLIoverviewSession2InstallationSession3Function

ConfigurationSession4Systemmaintenanceanddiagnostic*Session5

System

internal

moduledetail*Session6PerformanceOptimizationNote:*isforadvancedtrainingBWFSKeyValueSAN:lowlatency,nofilesharingTraditionalNAS:filesharingandeasetoshare,highlatencyandunreliablescalability;Howtoattainultra-low-latencyandhigh-bandwidthfilesharing?Howtoattainlow-costandscalableNASsharing?Howtoattainlow-latencyfilesharingandlow-cost&scalableNASsharingsimultaneouslytomeetacomplexstoragerequirement?Customer’sPainPointBWFSisahigh-efficiency,high-reliabilityandhigh-scalabilityclusterfilesystem.BWFSiscapableofvirtualizingastandardSANintoahigh-efficiency,high-reliabilityandhigh-scalabilityfilesharingnamespace.BWFSsupportslow-latencyandcross-platformSANsharingandlow-costandscalableNASsharing,thusofferingahigh-performancescalablefilestoragesolutionwiththeoptimalperformance-priceratio.BWFSBWFSArchitectureand

DeploymentScenariosFC/IB/PCIE/IPSANHighPerformanceBWFSSANClientsHighAvailableMDCSANBasedFileSharing…………MetadataPathDataPathDataVolumeMetadataVolumeGlobalNamespace4KWorkstationsSANBlockLevelAccessfor

Ultra-lowLatencyFileAccessThirdPartyDiskArraySolutionConstitutionBasedonStandardSANKeycomponent:

DatavolumesandmetadatavolumesondiskarrayBWFSClientdriverontheclientmachineSingleordualMDC(MetadataDataController)BWFS

ClientsdriverDiskArrayEthernetSwitchHigh

Available

MetadataController

ServerData

PathSANSwitchDataVolumeMetadataVolumeMetadataVolumeMetadata

PathSolutionConstitutionMDCManagesthedirectories,layout,storageresources,useraccesscontrolandquota;canaccessalldatavolumesandmetadatavolumes;ClientdriverImplementedintheformofadiscdriverunderWindows,andintheformofmountpointsunderLinuxandMac;Allclientscanaccessthesamedatavolumes;DataflowClientdriverGetfilerequestfromapplicationrunonclientsClientcommumicatewithMDC.ClientdriveraccessdatavolumesonSANdirectlyBWFS

ClientsDriverDiskArrayEthernetSwitchHigh

Available

MetadataController

ServerData

PathSANSwitchDataVolumeMetadataVolumeMetadataVolumeMetadata

PathSeparationbetweendataandmetadatapathbringsultra-lowlatencyandhighscalability.FC/IB/IPSANNASClientsScale-outNASFileSharing…………DataVolumeMetadataVolumeGlobalNamespace10Gb+EthernetSONG(Scale-out

NAS

Gateway)……DataPathLowerCostperPortandLinearScalePerformanceThirdPartyDiskArraySolutionConstitutionKeycomponentDatavolumesandmetadatavolumesondiskarraySONGnodesthataccessthestoragenetworkandapplicationnetwork;thenumberisbasedonthereliabilityandperformancerequirementsNodedicatedclientsoftwareisrequired.*TheSONGcanbeinstalledwithMDCornotdependingontheload.*EachSONGcanbeconfiguredasredundantforbothapplicationnetworkandstoragenetworkwithdualHBAanddual10GbNIC.KernelModuleinSONGBWFS

ClientCTDB(ClusteredTrivialDatabase)NASServerNFSCIFSFTPHTTPLoadBalancePolicyEngineWebAPISNMPLDAPNTPEx-AD…ThebottomlayerisBWFS,andothermodulesarebuiltupontheBWFSclient.TheclusterDBensuresthehighavailabilityandconsistencyoftheclusterservicemanagementdata;ThediverseloadbalancingstrategiesscheduletheclusterservicesTheNASservers(includingNFSandCIFS)provideNASservicesexternally;Built-inuserrightmanagementserverFC/IB/IPSANNASClients……DataVolumeMetadataVolumeGlobalNamespace10Gb+EthernetSONG(Scale-out

NAS

Gateway)……ThirdPartyDiskArrayConvergedSAN/NASFileSharing

ForMaximumWorkflowCostAlignment…………HighPerformanceBWFSSANClientsNASSharingSANSharingSANFileSharingandNASFileSharinginOneNamespaceSolutionConfigurationKeycomponent:

DatavolumesandmetadatavolumesondiskarrayBWFSClientdriverontheclientmachineforhigh-performanceclientmachineSingleordualMDCSONGnodesTheSONGcanbeinstalledwithMDCornotdependingontheloadThesamenamespacemaybesharedbySANsharing

client

orNASclient.FC/IB/IPSANNASClients……DataVolumeMetadataVolume10Gb+EthernetSONG(Scale-out

NAS

Gateway)……SupportedThirdPartyDiskArrayFC/iSCSI/InfinibandSANProtocolsHardwareAgnostic:MoreFlexibleDeploymentSolutions…………HighPerformanceBWFSSANClientsMDCandSONGH/SMinimumRequirementMDCCPUIntelXEON5405x1,orXEON,Frequency>2GHzMEM>=4GBChipIntelDiskSAS146x2，RAID1NIC1GEx4IPMIx1,IPMIportPowerRedundancyPowerFCHBAQlogic8GbpsFCHBAmanded:DellR710/720OS:CentOS6.7SONGCPUIntelXEON5405x1,orXEON,Frequency>2GHzMEM>=16GBChipIntelDiskSAS146x2，RAID1NIC10GEx1IPMIx1,IPMIportPowerRedundancyPowerFCHBAQlogic8GbpsFCHBAmanded:DellR710/720OS:CentOS6.7BWFSKeyFeatures

MainSpecificationMaxCapacityinOnenamespaceDesignedfor64ZB2PBproveninlargecustomersiteMaxFileSizeDesignedfor2PB1PBprovenpercustomerMaxFiles/ObjectsperFileSystemDesignedfor4billion1billionfiles/objectsprovenincustomersiteMaxnumberofClientNodesperfilesystemproven1200serversMaxLUNsin

onefilesystemis4093MAXfilesystemperMDCis256BWFSClientFeaturesUsefultoolset/utilitiesEmbeddedintoWindowsperformancecounterIObehavior/performanceloggingandevent/errorloggingCLIandGUIformountingCrossPlatformSharedFileAccessBWFSClientSupportedOperatingsystem

WindowsXP/Vista/7/832/x86_64Windows2003/2008/2012Server32/x86_64RHEL5(U3-U10)32/x86_64RHEL6(U0-U5)32/x86_64SUSE11SP1-3Mac10.7~10.10SONGSupportedNASProtocol

CIFS/SMB1.0/2.0/3.0NFSv2/v3/v4FTP/FTPSHTTP/HTTPS/WebDAV*BWFSdoesnotallowmultipleAVIDmediacomposerworkstationstosharematerialsunderthesameProject,buttheycandosobyusingtheMXFServerorStrawberryprojectcollaborationsoftware.FilesystemDataVolumeDeviceOnlineExpansionPerformaceandCapacityServicesdonotneedtobeinterrupted;AfterSANisconfigured,capacityexpansiontakesonlyoneminute.Scale-outNASLoadBalancingandFailoverSupportEMPTYEMPTYEMPTYEMPTYFULLFULLFULLBALANCEDBALANCEDBALANCEDBALANCEDBasedonRoundRobinconnections,CPUandnetworkbalanceattributesSANSwitchMDCFileAFileBFileCFileEFLFIModeStripModeSequenceModeFileC1FileC2FileDFlexibleFileStoragePolicyServersandWorkstationsFIFLmodeFilesaresequentiallydistributedontheLUNsScenario:alargenumberoffileswhichareaccessedconcurrently

StripmodeFilesarestripedacrossmultipleLUNsAsinglefilecanobtainthebandwidthsaggregatedbymultipleLUNsandattainbetterloadbalanceScenario:VeryhighperformanceaccessingforlargefileSequencemodeFillvolumeonebyoneScenario:archivemodeDiskArraySANSwitchDiskArrayMDCDataMirroringSupportforMetadataRepositoryandDataCapacityBWFS

ClientsDataVolumeMetadataVolumeDataVolumeMetadataVolumeOnefilesystemcansimultaneouslycontainmirroringvolumegroupsandnon-mirroringvolumegroups;asaresult,somecriticaldataisselectedandstoredunderthedirectoriesexportedfromthemirrors.QuotaSupportedforbothUser/GroupandDirectoryDirectoryServiceBelowDirectoryServicesupportedforbothSANclientandNASclientNativeLDAPserver(couldcreateUserandGrouponGUI)forsmallsizecustomerExternalLDAPserverActiveDirectorydomainActiveDirectorydomainwithUNIXextensionsOpen

DirectoryIntelligentManagementandMaintenanceViaquickstar,configurethebasicenvironment(includingnetworksandstorage)forMDCsconveniently;ViatheBWFSconfigurationwizard,configurethefilesystemconveniently;Viatheintelligentdiagnosisinterface,diagnosethesystemfaultsconveniently;Viatheclientdiagnosistool,obtainthefaultinformationoftheclientandeventhelatencyrecordsofeachIO,thusdiagnosingandadjustingtheperformanceproblems.Usefultoolset/utilitiesEmbeddedWindowsperformancecounterIObehavior/performanceloggingandevent/errorloggingCLIandGUIformountingBWFSCKFSCKtime=sizeofmetadatavolume:ratioofinodeindex/speedofFSCK *speedoffsckdependsontheperformanceofmetadatavloumwhichcanbegetbyiostate *ratioofinodeindexis1/8bydefaultSupportMcAfeeandSymantecserverActiveandPassivescanSetscanpolicyMonitortheserverstatusPassivescansupportsFallOverICAP

SupportedBWFSPoolSAN/NASICAPClientmachineAnti-virusscanEngineSupportingSNMPManagementProvidetheMIB,andobtainthefollowinginformation:

Filesysteminformation,includingthefilesystemname,filesystemstatus,totalcapacityofthefilesystem,availablecapacityofthefilesystem,andutilizationofthefilesystem;Volumeinformation,including:nameofassociatedfilesystem,volumename,volumestate,andassociateddevicestate;Highavailabilitystate;Clusterinformation,including:clusternameandclusterstate;NASnodeinformation,including:associatedclustername,andNASnodestate.SNMPtrapData

Lifecycle

ManagementInconjunctionwithQstar,BWFSsupportsthestrategy-basedmigrationofdatatothenearlineoroffline;Thedirectorystructureremainsunchanged,anddatamovementistransparenttotheusers.SystemInstallationandConfiguration

InstallationInstallandconnectstoragehardwareasstandardSANInstallandconnectMDC/SONGhardwareInstallMDC/SONGsoftwareandClientdriver,configureMDC,SONGnetworkandstoragePlanandsetthedatavolumeandmetadata.EnsureallclientsmachinesandSONGcanaccessthedatavolumesandMDCcanaccessdata/metadatavolumesInstallation–

SAN

SharingOnMDC

GUICreatefilesystemCreateVolumeGroup(VG)andconfigureVGAddvolumetoVGFormatfilesystemStartfilesystemClientmachines

authorization(exportpath)OnClientGUIMountBWFSPerformanceReference

8GbpsFCSANSwitch#28GbpsFCBWFSMDCSNFS/BWFSclient#1SNFSMDCImationNexsanE48VT#1-3TB7.2KRPM*40eaAbout3.0~3.2GB/sTotalThroughputWindowsWindowsSNFS/BWFSclient#28GbpsFCSANSwitch#1ImationNexsanE48VT#2-3TB7.2KRPM*40eaMACSinglenamespaceBWFSOnlyMACclient#18Gbpsbased1winonly1win+1mac2win+1

macWin#1Mac#1Win#1Win#2Mac#1Read1,550MB/s1,090MB/s780MB/s1,310MB/s1,330MB/s710MB/sWrite930MB/s900MB/s760MB/s690MB/s600MB/s690MB/sPerformanceReference

–

VenbenchBMTforKBSFSAllocationpolicy=StripAllocationsize=1MStripsize=1MWinClientCachemode:nocacheMacClientCachemode:sync8Gbpsbased1winonly2winWin#1Win#2Read1,3000MB/s1,100MB/s1,050MB/sWriteBWFSSNFSPerformanceReference

–Test

basedonSFA7700inDDNJapenLab0000012DataTarget120NL-SASdrives(RAID68+2)FCNetwork8GbFiberChannelSwitchEF30101MDT-10SASdrivesRAID10MetadataServerClient2Client3Client12222Client42Cont.1Cont.0Cont.1Cont.0Optionalmac2IOZONE1M1*Linux4*Linux1*MacRead1.15GBps4.58GBps1.13GBpsWrite1.52Gbps4.21GBps1.29GBpsFrametest4clients–multiplestreamswithdifferentIOsizes(1MBand8MB)Writes(MB/s)Reads(MB/s)#Num.threads#Num.threadsSingleIBClientRawLinuxFS/RAWSequentialRead/1M