第1題Sourcecodingisprimarilyconcernedwithincreasingredundancyinthetransmitteddatatoensureerrordetectionandcorrection.()第2題Huffmancodingisanexampleoflosslesssourcecoding.()第3題Informationentropyquantifiestheamountofcertaintyinamessage.()第4題Thelevelofuncertaintyinasystemincreaseswith:()AFewerpossibleoutcomesBManypossibleoutcomesCHigh-probabilityoutcomesDLow-importanceinformation第5題Whatquantifiestheamountofuncertaintyorinformationcontentinamessage?()ADatasizeBEntropyCSpeedDBandwidth第6題Whatisthetermfortransmittingacertainamountofinformationintheshortestpossibletimeandwiththeleastnumberofdevices?()AEfficiencyBEffectivenessCSpeedDOptimization第7題WhichofthefollowingisNOTafundamentalconceptinInformationTheory?()AEntropyBMutualInformationCDataCompressionDQuantumEntanglement第8題Whichofthefollowingisameasureoftheamountofuncertaintyorinformationcontentinamessage?()ABandwidthBDataRateCInformationEntropyDChannelCapacity第9題Whatdoesthetheoryofsourcecodinginvolve?()ARepresentinginformationinacompactandefficientmannerBMeasuringthephysicalsizeofdatastoragedevicesCAnalyzingthespeedofdatatransmissionDEnsuringdataistransmittedinanalogformat第10題WhatisthemainadvantageofusingHuffmancodingfordatacompression?()AItmaximizesthespeedofdatatransmissionBItensuresdataistransmittedsecurelyCItprovideshighcompressionrateswithminimallossofinformationDItiseasytoimplementandunderstand第11題WhichofthefollowingisNOTanapplicationofinformationtheory?()AGeneticsandheredityBNeuralcommunicationinthenervoussystemCWeatherforecastingDMachinelearningalgorithmsinAI第12題Whatiscryptographyconcernedwith?()AEnsuringinformationistransmittedinanalogformatBIncreasingtheredundancyoftransmitteddataCSecuringinformationbytransformingitintoanunreadableformatDCompressingdatatoreducestoragerequirements第13題Whatisthemainideabehindchannelcoding?()AToimprovethespeedofdatatransmissionBToremoveunnecessarydatafromtransmittedinformationCToensurereliabletransmissionofinformationeveninthepresenceofnoiseDTomaximizethestoragecapacityofdatadevices第14題Whoisconsideredthe‘FatherofInformationTheory’?()ARalphHartleyBNorbertWienerCClaudeElwoodShannonDRichardHamming第15題Whatistheprimarygoalofinformationtheory?()AToimprovethespeedofcomputersBTodevelopnewcommunicationtechnologiesCToachievespecificobjectiveswiththehelpofinformationDTostudythephysicalpropertiesofdatatransmissionmedia第1題Conditionalself-informationcanbezeroiftheoccurrenceofoneeventmakesanothereventcertain.()第2題ThejointprobabilityspaceofanN-symbolextensionofadiscretememorylesssourceincludesallpossiblesequencesofsymbols.()第3題Pointwisemutualinformationcanonlybepositive.()第4題Jointself-informationistheuncertaintyofthejointsymbol(xk,yj).()第5題InanN-symbolextensionofaDMS,ifsymbolsareindependentandidenticallydistributed,howdoesthejointentropychangewithN?()AItdecreaseslinearlywithNBItincreaseslinearlywithNCItremainsconstantregardlessofNDItincreasesexponentiallywithN第6題WhatdoesthehomogeneityofaMarkovchainimply?()ATransitionprobabilitieschangeovertimeBTransitionprobabilitiesdonotchangeovertimeCInitialdistributionchangesovertimeDInitialdistributiondoesnotchangeovertime第7題Toimprovetheefficiencyofinformationtransmission,oneshould:()AIncreasetheentropyofthesourceBReducetheredundancyofthesourceCIncreasethelengthofthemessageDDecreasethenumberofsymbols第8題TheChapman-Kolmogorovequationsdescribe:()AThetransitionprobabilitiesbetweenstatesBThestationarydistributionoftheMarkovchainCThesumoftheprobabilitiesofmultiplestepsDTheinitialdistributionoftheMarkovchain第9題TheentropyrateRofadiscretememorysourceisdefinedas:()ATheaverageamountofinformationpersymbolBThetotalamountofinformationovertimeCThemaximumpossibleentropyDTheminimumpossibleentropy第10題Whichofthefollowingstatementsaboutpointwisemutualinformationiscorrect?()AItcanonlybepositiveBItcanbepositiveornegativeCItisalwayszeroDItisundefined第11題WhatdoesthehomogeneityofaMarkovchainimply?()ATransitionprobabilitieschangeovertimeBTransitionprobabilitiesdonotchangeovertimeCInitialdistributionchangesovertimeDInitialdistributiondoesnotchangeovertime第12題Whenasourcehasmorepossiblesymbolsandtheirprobabilitiesaredistributeduniformly,theentropy()AIncreasesBDecreasesCRemainsconstantDBecomeszero第13題Thepropertythataddingzero-probabilityeventsdoesnotaffectentropyiscalled()ASymmetryBExpansibilityCNon-negativityDAdditivity第14題Theentropyofacontinuousrandomvariableiscalled()ADifferentialentropyBMutualentropyCAverageentropyDNoneoftheabove第15題Theentropyofasourcecanbeaffectedbythepermutationofitsprobabilities.TrueorFalse?()ATrueBFalse3.11Exercises第1題Inanadditivenoisechannel,thecapacityofthechannelisindependentofthenoisepower.()第2題ThechannelcapacityofawaveformchanneloveradurationTcanbeexpressedas:CT(Ps)=limN→∞maxfXˉ(x){I(Xˉ;Yˉ);E(X2ˉ)≤PS}.()第3題Acontinuouschannelreferstoachannelwithcontinuoustimeandcontinuousamplitude.()第4題ThechannelcapacityoftheN-thextensionofadiscretememory-lesschannelismax

∑k=1NI(Xk;Yk).()第5題Doubtfulentropyrepresentstheamountofinformationlostinthechanneloutputduetonoiseinterference.()第6題Theoutputsymbolsetreferstothesetofallpossibleoutputsignalsinachannel.()第7題Thecapacityofadiscretechannelisrelatedtotheprobabilitydistributionofinputsymbols.()第8題Thecorrectstatementsaboutwhitenoiseare()AwhitenoiseisuniformlydistributedacrossthefrequencyrangeBwhitenoiseisnon-uniformlydistributedacrossthefrequencyrangeCwhitenoiseexistsinrealityDwhitenoiseisanidealizednoisesignalanddoesnotexistinreality正確答案：AD第9題Inacascadedcommunicationsystem,whatistheeffectofusingalow-passfilterasthesecondchannelinthecascade()AItwillincreasethehigh-frequencycomponentsofthesignal.BItwillcauseattenuationofhigh-frequencysignals.CItwillreducetheoverallbandwidthofthesystem.DItwillnotaffectthefrequencyresponseofthesystem.第10題Forsuccessfulinformationtransmission,wecanintroduce()betweenthesourceandthechannel.()AanADCBalatchCanencoderDadecoder第11題Foranadditivenoisechannel,theinputX,outputY,andnoiseZsatisfy()AX=YZBX=Y+ZCY=XZDY=X+Z第12題Thechannelcapacityofanindependentparallelchannelis()AtheproductofthechannelcapacitiesofitsconstituentchannelsBthesumofthechannelcapacitiesofitsconstituentchannelsClessthanthesumofthechannelcapacitiesofitsconstituentchannelsDbasedonthemathematicalmodeloftheentireparallelchannel第13題ForanN-stagecascadeofchannelswithtransitionmatricesQ1,Q2,…QN,thetransitionprobabilitymatrixfortheentirecascadeis:()A1/Q=Q1,Q2,…QN

B1/Q=?1/Q1+?1/Q2+…+?1/QNCQ=Q1+Q2+…+QN

DQ=Q1

Q2

…

QN第14題Whatistherelationshipbetweenmutualinformationandentropy()AI(Xˉ;Yˉ)=H(Xˉ)?H(XˉYˉ)BI(Xˉ;Yˉ)=H(Yˉ)?H(XˉYˉ)CI(Xˉ;Yˉ)=H(Xˉ)?H(Xˉ|Yˉ)DI(Xˉ;Yˉ)=H(Yˉ)?H(Xˉ|Yˉ)第15題ForaDMCwhichcouldberepresentedasdiagram,thecorrecttransitionprobabilitymatrixis()A．．PY|X=[0．10．910]B．．PY|X=[010．10．9]C．．PY|X=[100．10．9]D．．PY|X=[100．90．1]4.6Exercises第1題InHuffmancoding,thefrequencyofthecombinedsymbolisthe__________ofthetwofrequenciesmerged.()ASumBAverageCDifferenceDProduct第2題Theoptimalencodingofasourceisachievedbyminimizingthe__________ofthecode.()ABitrateBLengthCRedundancyDComplexity第3題Forasourcewithtwosymbols,wherethefirstsymbolhasaprobabilityof0.5andthesecondsymbolhasaprobabilityof0.5,theentropyis:()A0.5B1C2Dlog?2第4題Theminimumcodelengthrequiredforasourceisequalto:()AEntropyBThenumberofsymbolsCFrequencyDFixedlength第5題Insourcecoding,theredundancyisremovedby:()ACompressionalgorithmsBOptimalencodingCDictionaryalgorithmsDEncodingtables第6題Huffmancodingalwaysgeneratesa__________tree.()ACompleteBBinaryCHuffmanDSkewed第7題Forasourcewithuniformprobabilitydistributionand8symbols,theentropyis:()A1bitB3bitsC8bitsDlog?8第8題ForasourcewithNsymbols,thelowerboundfortheoptimalaveragecodelengthis:()Alog?NBNC1D0第9題Huffmancodingisa_____