機器視覺與機器學(xué)習(xí)應(yīng)用ApplicationsofMachineVisionandMachineLearning走進(jìn)機器視覺Machinevision走進(jìn)機器視覺Machinevision陳雨ChenYu主講教師Teacher課程導(dǎo)入CourseIntroduction課程導(dǎo)入CourseIntroduction走進(jìn)機器視覺Machinevision陳雨ChenYu主講教師Teacher二維碼是如何被瞬間識別的？ThisQRcodeisinstantlyrecognized?課程導(dǎo)入CourseIntroduction走進(jìn)機器視覺Machinevision它又是如何“看見”目標(biāo)的？howdoesit'see'thetarget?課程導(dǎo)入CourseIntroduction走進(jìn)機器視覺MachinevisionMachinevision機器視覺???走進(jìn)機器視覺Machinevision知識目標(biāo)Knowledgegoals技能目標(biāo)Skillgoals素養(yǎng)目標(biāo)Accomplishmentgoals學(xué)習(xí)目標(biāo)Learningobjectives案例導(dǎo)入Caseintroduction案例導(dǎo)入Caseintroduction在汽車制造車間，一臺裝配機器人正在快速安裝零件。Intheautomobilemanufacturingworkshop,anassemblyrobotisquicklyinstallingparts.它通過攝像頭捕捉零件位置，精準(zhǔn)完成組裝，誤差不超過0.1毫米。Itcapturesthepositionofpartsthroughacameraandaccuratelycompletestheassemblywithanerrorofnomorethan0.1mm.智能工廠的“火眼金睛”The"sharpeyes"ofsmartfactories收銀臺前，顧客將商品二維碼對準(zhǔn)掃描儀，“嘀”一聲完成支付。Infrontofthecheckoutcounter,theQRcodeoftheproductispointedatthescannerandthepaymentiscompletedwithasoundof"beep".這是機器視覺的識別應(yīng)用，通過解碼二維碼信息實現(xiàn)快速交易。Thisistherecognitionapplicationofmachinevision,whichenablesfasttransactionsbydecodingQRcodeinformation.案例導(dǎo)入Caseintroduction超市掃碼的“秒識別”"Quickrecognition"codeinsupermarket相關(guān)知識Relevantknowledge相關(guān)知識Relevantknowledge機器視覺是利用相機等傳感器，配合機器視覺算法賦予智能設(shè)備人眼的功能，從而進(jìn)行物體的識別、定位、測量、檢測等功能。Machinevisionusescamerasandothersensors,inconjunctionwithfunctionsofhumaneyesofsmartdevicesgivenbymachinevisionalgorithms,soastoperformobjectrecognition,positioning,measurementanddetection.機器視覺的定義

Definitionofmachinevision相關(guān)知識Relevantknowledge機器視覺的特點

Characteristicsofmachinevision特點

Characteristics

安全可靠Safeandreliable客觀性O(shè)bjectivity重復(fù)性Repeatability成本較低Lessexpensive效率高Highefficiency精準(zhǔn)性Precision20世紀(jì)50年代

1950s1965年

196520世紀(jì)70年代中期

Mid-1970s1977年

1977機器視覺的發(fā)展過程

Developmentprocessofmachinevision國外

Overseas相關(guān)知識RelevantknowledgeResearchonstatisticalpatternrecognitionof2Dimages開展二維圖像的統(tǒng)計模式識別研究Researchofthree-dimensionalvision開創(chuàng)了三維視覺研究MITartificialintelligencelaboratoryofficiallyopenedthe"MachineVision"course.MIT人工智能實驗室正式開設(shè)“機器視覺”課程DavidMarrproposedthefamousMarrvisiontheoryDavid·Marr提出了著名的Marr視覺理論1998-2002年

1998-20021990-1998年

1990-1998相關(guān)知識Relevantknowledge機器視覺的發(fā)展過程

Developmentprocessofmachinevision國內(nèi)DomesticBegantodevelopgradually開始逐步發(fā)展起來Chinaalsobegantodevelopmachinevisionequipment中國也開始了研發(fā)機器視覺設(shè)備光源、鏡頭（定焦鏡頭、變倍鏡頭、遠(yuǎn)心鏡頭、顯微鏡頭）、相機（包括CCD相機和COMS相機）、圖像處理軟件、系統(tǒng)集成等幾個部分。Lightsource,lens(fixedfocuslens,zoomlens,telecentriclens,microscopehead),camera(includingCCDcameraandCOMScamera),imageprocessingsoftware,systemintegrationandotherparts.機器視覺系統(tǒng)組成Compositionofmachinevisionsystem相關(guān)知識Relevantknowledge相機Camera鏡頭Lens光源Lightsource主要目的是使重要特征和非必要特征產(chǎn)生最大的對比度。InThemainpurposeistomaximizethecontrastbetweenimportantfeaturesandunnecessaryfeatures.即將目標(biāo)的重要特征顯現(xiàn)出來，而同時將不需要的特征抑制掉，最終形成對處理過程最佳的圖像效果。Thatis,toshowtheimportantfeaturesofthetarget,whilesuppressingunnecessaryfeatures,finallyformingthebestimageeffectfortheprocessingprocess.相關(guān)知識Relevantknowledge光源TheLightsource用于聚集光線使目標(biāo)能夠在相機CCD或者COMS上呈現(xiàn)出清晰的圖像。UsedtogatherlightsothatthetargetcanpresentaclearimageonthecameraCCDorCOMS.Asanimagingdevice.相關(guān)知識Relevantknowledge鏡頭Lens作為成像器件，通常要與相機、光源配合使用。Itisusuallyusedtogetherwithcameraandlightsource.屬于圖像采集單元。Itisanimageacquisitionunit.相關(guān)知識Relevantknowledge工業(yè)相機Industrialcamera它將光學(xué)圖像轉(zhuǎn)化為模擬/數(shù)字圖像，再將相應(yīng)的信號傳輸給圖像處理系統(tǒng)。Itcapturesconvertstheopticalimageintoanalog/digitalimage,andthentransmitsthecorrespondingsignaltotheimageprocessingsystem.根據(jù)實際需求所設(shè)計的一套處理被測物體圖像的算法。InAsetofalgorithmsforprocessingtheimageofthemeasuredobjectdesignedaccordingtotheactualneeds.相關(guān)知識Relevantknowledge圖像處理系統(tǒng)Imageprocessingsystem這是并輸出相關(guān)的系統(tǒng)邏輯運動控制信號，屬于機器視覺的核心。Andtherelatedsystemlogicmotioncontrolsignalsareoutput;theyarethecoreofmachinevision.相關(guān)知識Relevantknowledge機器視覺的應(yīng)用領(lǐng)域Applicationfieldsofmachinevision機器視覺應(yīng)用領(lǐng)域

Applicationfieldsofmachinevision自動駕駛

Autonomousdriving工業(yè)視覺

Industrialvision智能安防

Intelligentsecurity人機交互

Man-machineinteraction虛擬現(xiàn)實

VirtualReality物體自動識別

Automaticobjectrecognition醫(yī)學(xué)領(lǐng)域

Medicalfield圖像自動解釋

Automaticimageinterpretation相關(guān)知識Relevantknowledge定位應(yīng)用就是機器視覺系統(tǒng)能夠快速準(zhǔn)確地找到被測零件并確認(rèn)其位置，確保元件的正確裝配。Thepositioningapplicationisthatthemachinevisionsystemcanquicklyandaccuratelyfindthepartundertestandconfirmitspositiontoensurethecorrectassemblyofthecomponents.定位應(yīng)用Positioningapplication相關(guān)知識Relevantknowledge將元件放入貨盤中或從貨盤中拾取元件；Placecomponentsintoorpickupcomponentsfrompallets;定位應(yīng)用Positioningapplication對輸送帶上的元件進(jìn)行包裝；Packagetheelementsontheconveyorbelt;相關(guān)知識Relevantknowledge對元件進(jìn)行定位和對位，以便將其與其他部件裝配在一起；Positionandaligntheelementstofitthemwithothercomponents;定位應(yīng)用Positioningapplication將元件放置到工作架上；Placetheelementsontotheworkframe;或者將元件從箱子中移走等。Orremovetheelementsfrombox,etc.相關(guān)知識Relevantknowledge識別應(yīng)用Recognitionapplication一維碼、二維碼的解碼Decodingofone-dimensionalandtwo-dimensionalcodes直接部件標(biāo)識（DPM）Directpartmarking(DPM)光學(xué)字符識別（OCR）Opticalcharacterrecognition(OCR)光學(xué)字符驗證（OCV）Opticalcharacterverification(OCV）相關(guān)知識Relevantknowledge識別應(yīng)用Recognitionapplication獲取信息：制造商名稱、產(chǎn)品標(biāo)識、批號、幾乎任何成品都使用的唯一序列號。Getinformation:manufacturername,productidentification,lotnumber,uniqueserialnumberusedinanyfinishedproduct.二維碼的識別RecognitionofQRcodes相關(guān)知識Relevantknowledge測量應(yīng)用Measurementapplication常見的測量應(yīng)用

Commonmeasurementapplications尺寸檢測Dimensionaldetection容量檢測Capacitydetection預(yù)設(shè)標(biāo)記的測量Measurementofpresetmarkers相關(guān)知識Relevantknowledge測量應(yīng)用Measurementapplication在測量應(yīng)用中，機器視覺系統(tǒng)通過計算物品上兩個或以上的點或幾何位置之間的距離來進(jìn)行測量，然后確定這些測量結(jié)果是否符合規(guī)格。Inmeasurementapplications,machinevisionsystemtakesmeasurementsbycalculatingthedistancebetweentwoormorepointsorgeometriclocationsonanitem,andthendeterminewhetherthosemeasurementsmeetspecifications.相關(guān)知識Relevantknowledge測量應(yīng)用Measurementapplication如果不符合，視覺系統(tǒng)將向機器控制器發(fā)送一個未通過信號，進(jìn)而觸發(fā)生產(chǎn)線上的不合格產(chǎn)品剔除裝置，將該物品從生產(chǎn)線上剔除。Ifitdoesnotconform,thevisionsystemwillsendafailsignaltothemachinecontroller,whichinturntriggersthenon-conformingproductrejectiondeviceonthelineandremovestheitemfromtheline.相關(guān)知識Relevantknowledge檢測應(yīng)用Detectionapplication顏色和缺陷檢測，零件或組件的有無檢測，目標(biāo)位置和方向檢測等。Coloranddefectdetection,presenceorabsencedetectionofpartsorcomponents,targetpositionanddirectiondetection,etc.檢測Detection相關(guān)知識Relevantknowledge檢測應(yīng)用Detectionapplication檢測液體制劑的灌裝液位Detectthefillinglevelofliquidpreparations應(yīng)用：在醫(yī)藥行業(yè)Application:Inthepharmaceuticalindustry瓶體內(nèi)雜質(zhì)及封蓋質(zhì)量Impuritiesinthebottleandcappingquality尺寸不合格的膠囊Capsuleswithunqualifiedsizes相關(guān)知識Relevantknowledge檢測應(yīng)用Detectionapplication疫苗瓶口缺陷Vaccinebottlemouthdefects應(yīng)用：在醫(yī)藥行業(yè)Application:Inthepharmaceuticalindustry醫(yī)藥產(chǎn)品的外包裝打碼效果Codingeffectofouterpackagingofpharm