1、信息論與編碼理論中的英文單詞和短語(yǔ)信息論與編碼理論TheoriesoflnformationandCoding第一章介紹Chapter 1Introduction信息論information theory編碼理論coding theory發(fā)出emit字節(jié)bit二進(jìn)制binary二進(jìn)制對(duì)稱源binary symmetric source二進(jìn)制對(duì)稱信道binary symmetric channel原始字節(jié)錯(cuò)誤率raw bit error probability編碼encode字節(jié)錯(cuò)誤率bit error probability噪音noise冗余redundant相互校驗(yàn)cross check編碼

2、算法codding algorithm錯(cuò)誤模式error pattern綜合synthesis漢明碼Hamming code單獨(dú)錯(cuò)誤校正碼single-error-correcting code速率rate二進(jìn)制熵函數(shù)binary entropy function能量capacity信道編碼理論channel coding theory比特bits (binary digits)自然碼natural digits熵函數(shù)entropy function可能向量probability vector條件熵conditional entropy離散記憶信道discrete memory channel

3、過(guò)渡可能性transition probability產(chǎn)出output邊際分布marginal distritution互信息mutual information啟發(fā)式heuristic聯(lián)合熵joint entropy維恩圖Venn diagram馬爾可夫鏈Markov chain限定函數(shù)definite function串聯(lián)tandem數(shù)據(jù)過(guò)程配置data-processing configuration凸組合convex combination操作manipulation速記法shorthand通信系統(tǒng)communication system連續(xù)信息輸出continuous source

4、outputs編碼員coder映射map目標(biāo)destination數(shù)據(jù)過(guò)程定理data-processing theorem離散量化discrete quantization改進(jìn)/精煉refinement密度density中值定理mean value theorem表面相似superficial resemblance網(wǎng)格mesh微分熵differential entropy琴生不等式Jensen inequality確定信道determinate channel第二章信息理論Chapter 2Information Theory第三章離散無(wú)記憶信第四章離散無(wú)記憶信道和容量成本l=J源和扭曲率

5、方方程Chapter 3Discrete Memory less Channels and their Capacity-Cost EquationsChapter 4Discrete Memoryless Sources and their Rate-Distortion Equations輸入符號(hào)系統(tǒng)input sign system輸出符號(hào)系統(tǒng)output sign system想象imagine無(wú)記憶假設(shè)memoryless assumption平均成本average cost容量成本方程capacity-cost equation驗(yàn)證源頭test-sourcen維容許驗(yàn)證源頭n-di

6、mensional admissible test sources容許成本admissible costr對(duì)稱r-symmetry系統(tǒng)比率rate of system超過(guò)信道容量率rates above channel capacity長(zhǎng)length每個(gè)符號(hào)的比特bits per symbol編碼規(guī)則decoding rule區(qū)別代碼distinct code指示函數(shù)indicator function隨機(jī)編碼random coding期望值expected value弱大數(shù)定律weak law of large numbers編碼范圍decoding sphere源字母表source alp

7、habet離散無(wú)記憶信源discrete memoryless sources統(tǒng)計(jì)源source statistics目標(biāo)符號(hào)object sign扭曲distortion扭曲度distortion measure平均扭曲average distortion測(cè)試通道test channel扭曲率distortion rate源編碼定理source coding theorem向后測(cè)試通道backwards test channel哈莫名扭曲度Hamming distortion measure錯(cuò)誤扭曲率error probability distortion rate數(shù)據(jù)壓縮定理data-co

8、mpression theorem目的符號(hào)destination symbols數(shù)據(jù)壓縮系統(tǒng)data compression scheme罰函數(shù)penalty function無(wú)限制和unrestricted sum內(nèi)部和inner sum第五章高斯信道和信Chapter 5Gaussian Channel and Source伏特voltage傳送transmit信號(hào)signal瓦watts耗散dissipate焦耳joule白高斯噪聲過(guò)程white Gaussian noise process噪聲錯(cuò)誤密度noise spectral density帶寬bandwidth波段限制band-l

9、imited功率限制power-limited第n項(xiàng)容量成本 函數(shù)n-th capacity-cost function平方錯(cuò)誤squared-error總的容量成本函數(shù)噪聲密度overall capacity-cost function oink density算術(shù)-幾何均值arithmetic-geometric average value離散時(shí)間無(wú)記憶高斯信源discrete-time memoryless Gaussian source均值平方錯(cuò)誤標(biāo)準(zhǔn)mean-squared error criterion高斯分布gaussion distribution高斯信源每個(gè)符號(hào)均值平方扭曲G

10、aussiansourceper-symbolper-symbol mean-squared distortion信源統(tǒng)計(jì)source statistics傳送率rate of transmission沖突conflict信源-信道編碼理論source-channel coding theorem數(shù)據(jù)傳輸定理data-processing theorem中間向量intermediate vector最壞扭曲worst-case distortion每個(gè)符號(hào)基礎(chǔ)per-symbol basis分解decomposition傳送編碼transmitted coding負(fù)擔(dān)afford交易trade

11、off可實(shí)現(xiàn)區(qū)域realizable region觀點(diǎn)standpoint第七章第一部分訪問(wèn)先進(jìn)標(biāo)題第六章信源-信道編碼Chapter 7Survey of Advanced Topics forPart One理論Chapter 6Source-Channel Coding Theory信息源information source噪聲源noisy source數(shù)據(jù)處理data processing量子化quantization調(diào)節(jié)modulation連續(xù)塊successive block發(fā)出信道輸出符號(hào)emit channel output symbols一對(duì)一通信one-to-one cor

12、respondence實(shí)驗(yàn)來(lái)源test source信源序列source sequence目的序列destination sequence攣生珍珠twin pearls有限阿貝爾交換群finite Abelian commutative group各態(tài)經(jīng)歷隨機(jī)過(guò)程ergodic random process熵entropy添加各態(tài)噪音信道additive ergodic noise channel漸進(jìn)線均分性質(zhì)asymptotic average property高斯過(guò)程Gaussian process多終端信道m(xù)ultiterminal channel反饋feedback發(fā)送人seeder接

13、受人receiver多通道信道m(xù)ulti-access channel擦掉符號(hào)erasure symbol矛盾contradiction比率rate廣播信道broadcast channel容量區(qū)域capacity region高對(duì)稱度high degree of symmetry測(cè)試信源test sources輸入符號(hào)信道input signal channel全局最大global maximum添加各態(tài)噪音additive ergodic noise信道的可靠性闡述reliability exponent of channel關(guān)鍵率critical rate線性碼linear code時(shí)間

14、改變卷積碼time-varying convolutional編碼-信道-譯碼encoder-channel-decoder外部信道outer channel內(nèi)部編碼inner code外部編碼outer code弱顛倒weak converse強(qiáng)顛倒strong converse術(shù)語(yǔ)term傳輸率rate of transmission錯(cuò)誤指數(shù)error exponent強(qiáng)近似strong similarity選擇兩重性rather duality扭曲率理論distortion rate theory源編碼法source coding method單字母扭曲度量single-letter d

15、istortion measure含義implication輪廓configuration錯(cuò)誤可能性error probability半平面界half-plane bound接待reception離散時(shí)間穩(wěn)定高斯信源discrete-time stable穩(wěn)定高斯序列stable Gaussian sequence譜密度spectral density樹(shù)碼tree codes實(shí)際觀點(diǎn)practical standpoint生成矩陣generator matrix行空間row space奇偶校驗(yàn)矩陣parity-check matrix規(guī)范形式canonical form錯(cuò)誤模式error pa

16、ttern傍系coset對(duì)稱信道symmetric channel漢明權(quán)Hamming wight表格查驗(yàn)table lookup標(biāo)準(zhǔn)排列standard array強(qiáng)調(diào)italicized度量空間metric space漢明距離Hamming distance穿過(guò)interect最小權(quán)重minimum weight單錯(cuò)誤校正single-error-correcting完全碼perfect codes重復(fù)碼repetition codes二進(jìn)制漢明碼binary Hamming codes檢測(cè)detect電子校驗(yàn)e-correctingF-檢測(cè)H-detecting類似校驗(yàn)矩陣parity-

17、check matrix雙錯(cuò)誤檢測(cè)double-error-detecting權(quán)重計(jì)數(shù)器weight enumerator同態(tài)homomorphism趨于增加組multiplicative group不確定indeterminate第九章循環(huán)碼Chapter 9 Cyclic Codes第八章線性碼突發(fā)性錯(cuò)誤burst errors表面無(wú)害定理definition of innocuous-appearing循環(huán)位移cyclic shift一般循環(huán)trivial cyclic無(wú)信息碼no-information codeChapter 8 Linear codes單等價(jià)校驗(yàn)碼single-pa

18、rity-check code無(wú)等價(jià)碼no-equivalent code右循環(huán)位移right cyclic shift母函數(shù)generating function生成多項(xiàng)式generator polynomial互惠的reciprocal循環(huán)性質(zhì)cyclic property分解decomposition傳送編碼transmitted codeword轉(zhuǎn)換登記編碼shift-register encoder突變加法器flip-flops adders常數(shù)乘法器constant multipliers延遲delay脈沖響應(yīng)impulse response狀態(tài)向量state vector狀態(tài)多項(xiàng)

19、式state polynomial輸入流input stream反順序reverse order線性遞歸linear recursion最右面的突變r(jià)ightmost flip-flop模2加法器mod-2 adder循環(huán)cyclic二域two-field原始多項(xiàng)式primitive polynomial譯碼循環(huán)decoding cycle循環(huán)旅程circular journey低位移寄存器lower shift register突發(fā)錯(cuò)誤校正burst-error-correcting模式pattern突發(fā)描述burst description位置location含糊不清ambiguity零操

20、作zero run突發(fā)錯(cuò)誤校正碼burst-error correcting code阿布拉門(mén)遜界Abramson bounds嚴(yán)格阿布拉門(mén)遜界strict Abramson bound弱阿布拉門(mén)遜界weak Abramson boundReiger 界Reiger bound松散loose阿布拉門(mén)遜碼Abramson code交錯(cuò)interleavingDe交錯(cuò)De-interleaving3度交錯(cuò)depth-3 interleaving交錯(cuò)操作interleaving operation復(fù)雜算法elaborate algorithm法爾碼Fire code法爾結(jié)構(gòu)Fire construc

21、tion爆發(fā)阻塞算法burst-trapping algorithm爆發(fā)錯(cuò)誤校正編碼burst-error-correcting code左對(duì)齊left-justified陷阱，阻塞trap爆發(fā)錯(cuò)誤模式burst-error pattern米戈蒂引理Meggitt lemma切換顯示shift-register環(huán)路circuit最左面的突變leftmost flip-flop y第十章香農(nóng)碼和相關(guān)Chapter 10 Shannon Codes and Related Codes香農(nóng)碼Shannon code范德蒙德行列式理論Vandermonde determinant theory初始相同

22、檢驗(yàn)矩 陣original parity-check matrix最小多項(xiàng)式minimal polynomial關(guān)鍵方程key equation離散傅里葉變換discrete Fourier transform時(shí)間領(lǐng)域time-domain頻數(shù)領(lǐng)域frequency-domain細(xì)致subtlety時(shí)間轉(zhuǎn)換time shift相位轉(zhuǎn)換phase shift支撐集合support set評(píng)估多項(xiàng)式evaluator polynomial規(guī)范派生formal derivative頻數(shù)主導(dǎo)遞歸frequency-domain recursion下標(biāo)subscript定位多項(xiàng)式locator poly

23、nomial錯(cuò)誤模式error pattern扭曲錯(cuò)誤模式twisted error pattern復(fù)原模reduced mode錯(cuò)誤定位error location錯(cuò)誤評(píng)估多項(xiàng)式error-evaluator polynomial歐幾里得算法Euclid algorithm份額quotient促進(jìn)facilitate時(shí)間主導(dǎo)方法time-domain approach錯(cuò)誤定位器error-locator試錯(cuò)法trial and error偽碼片段pseudocode fragment遞歸recursion反常abnormal復(fù)雜理論elaborate theory多倍錯(cuò)誤校正線性碼multi

24、ple-error-correcting linear code代碼字符code character最大距離可分碼maximum-distance separable codes插值法性質(zhì)interpolation property信息集合information set插值算法interpolation algorithm遞歸結(jié)束recursive completion偽碼pseudocode連鎖碼concatenated coding爆發(fā)錯(cuò)誤校正burst-error-correction描述depict非因子unfactor缺陷flaw擦掉符號(hào)erasure symbol傳遞符號(hào)transmitted symbol擴(kuò)大enlarge最小距離譯碼minimum-distance decoding擦除集合erasure set擦除位置多項(xiàng)式erasure-location polynomial錯(cuò)誤擦除位置多項(xiàng)式errors and erasures-locator-polynomial錯(cuò)誤擦除評(píng)估多項(xiàng)式errors-and-erasures-evaluator polynomial修正綜合多項(xiàng)式modified syndrome polynomial多項(xiàng)式乘法polynomial multiplication頻數(shù)域freq