Davinci平台(DM644x)软件编程培训.ppt

Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,Menu,Software,:,Silicon,:,Tools,:,Support,DaVinci,Software Overview,Acronyms,API,=Application Programming Interface,APL,=Application Layer,EPSI,=Easy Peripheral Software Interface,HWAL,=Hardware Adaptation Layer,OSAL,=Operating System Adaptation Layer,SPL,=Signal Processing Layer,VISA,=Video,Imaging,Speech and Audio,xDM,=,eXpressDSP,Digital Media Interface,Software Challenges to Building a Video Product,OS,Drivers,Middleware,GUI,Human Factors Interface,Value Add,Customer Product Idea,Codecs:Video,Imaging,Speech,&Audio,S,DaVinci,Software Offerings,Optimized for Digital Video Innovation,Digital Media,Codecs,H.264,MPEG4,H.263,WMV9,VC1,MPEG2,JPEG,AAC-HE,AAC-LC,WMA9,WMA8,MP3,G.711,G.728,G.723.1,G.729ab,Operating Systems&Device Drivers,Linux OS,preported,to device,Input output drivers tightly integrated into OS,Configurable,Robust,tested with EPSI APIs,Published Multimedia Application Programming Interfaces(APIs),Industry-recognized APIs,DaVinci APIs(VISA,EPSI,xDM,),Codec abstraction,Interprocessor,communication,DSP/BIOS,Codec Engine,Signal Processing Libraries,Codec Kernels,FIR,IIR,DM644x,Software Overview,Drivers tightly integrated into OS,Input/output using Camera,LCD,HDD,Networking,etc.,Kernel Space,Signal Processing Layer,Application Layer,A DSP Image that consists of:,Codecs,Codec engine,DSP/BIOS,Inter-processor communications,Customer,Value-Added,Differentiation,Digital Media APIs,Input/Output APIs,Gstreamer,FFMPEG,OpenHelix,MPlayer,Open Source,Open Source Software,User Space,Codec APIs,Simplified Embedded Video,H.264,MP3,BIOS,Node,JPEG,PSP,Component-ware,TI Provides,Customer,3P Creates,Sub-system-ware,(Pre-wired Codec Combo),H.264,AAC+,MPEG4,MP3+,“,How-to”Methodology for creating,Custom Combos,Config,kit,LinuxDrivers,DSP Executable,Customer,Value-Added,Differentiation,Application Layer,Signal Processing Layer,Kernel Space,Digital Media APIs,Input/Output APIs,MPEG4,MP3+,MPEG4,MP3+,MPEG4,MP3+,MPEG4,MP3+,pre,Codecs,Codec Engine,Engine,VID,IMG,SPH,AUD,VISA API,VISA API,I-Node,Image-Task,A-Node,Audio-Task,V-Node,Video-Task,S-Node,Spch,-Task,DSKT2,DMAN3,ACPY3,Node,Mnmgt,Codec Engine,Remote,Server,Framework Components,xDM API,Audio Codec,xDM API,Speech Codec,xDM API,Imaging Codec,xDM API,Video Codec,DM644x,Software Stack,ARM Subsystem,DSP Subsystem,User Space,Kernel Space,Application Layer(APL),Transport,I/O,I/O,I/O,USB 2.0,Driver,I/O,I/O,I/O,GP,Timer,Watchdg,Timer,I,2,C,Driver,UART,Driver,Video,Driver,Audio,Driver,EMAC,Driver,MMC/SD,Driver,SPI,Driver,File,(ATA),Linux APIs w/EPSI,Link,Driver,BIOS,Driver,DSP/BIOS Link,DSP/BIOS,Customer,Value-Added Differentiation,AV Sync,Mux/Demux,TS /ASF,Network,RTP/RTSP,Signal Processing Layer(SPL),xDM API,Speech Codec,DSP/BIOS Services,PWRM,LOG,DSP/BIOS Link,Srv,MSGQ,PROC,Image Coding,JPEG,Central office,Control Module/Application Layer,Video Capture,Image quality,Bit-rate,control,Image size,control,Pre/after-motion recoding,Video Coding,MPEG4 SP,H.263 BP,H.264 BP,TCP/UDP,IP,B/W:21 Mbytes/s,D1:30 FPS YUV422,B/W:16 Mbytes/s,D1:30 FPS YUV420,B/W:16 Mbytes/s,D1:30 FPS YUV422,B/W:2,Mbits/s,B/W:12,Mbits/s,Audio Capture,B/W:96 K bytes/s,mono,B/W:32 K bits/s,Data flow,Control flow,Bandwidth,Customer components,BasicIP camera,Leveraging DaVinci,Software,Video pre-processing,De-interlacing,Input/Output,Signal Processing,Application Processing,Input/Output,Networking module,HTTP/RTP/RTSP,TI/DaVinci components,TCP/UDP,IP,HTTP/RTP/RTSP,TI/MontaVista/Open Source,B/W:1Mbits/s,B/W:1.2 Mbytes/s,QVGA:15 FPS,Y,Video/Audio Analytics,Motion detection,Event detection,Object tracking,Object recognition,Analysis Control,Intelligent Applications,Audio Coding,AAC/WMA,Image Coding,JPEG,Video Capture,Video Coding,MPEG4 SP,H.263 BP,H.264 BP,Audio Capture,Image quality,Bit-rate,control,Image size control,Pre/after-motion recoding,Audio Coding,AAC/WMA,Video pre-processing,De-interlacing,Codec Engine,VISA API,Intelligent IP camera,DM644x,Software Overview,Drivers tightly integrated into OS,Input/output using Camera,LCD,HDD,Networking,etc.,Kernel Space,Signal Processing Layer,Application Layer,Customer,Value-Added,Differentiation,Digital Media APIs,Input/Output APIs,User Space,Codec APIs,A DSP Image that consists of:,Codecs,Codec engine,DSP/BIOS,Interprocessor,communications,Building a DSP ExecutableWith a Configure Kit,S,.out,(DSP Executable/Image),Config,Kit,Codec Engine,Video Task,Image Task,Speech Task,Audio Task,DSP/BIOS,DSP/BIOS Link,MPEG4,MP3+,pre,OR,xDM API,H.264 BP enc,eXpressDSP,Digital Media(,xDM,)Interface,Compatible superset extension to the,eXpressDSP,algorithm standard(,xDAIS,),When a different,xDM,Algorithm is used,no changes are needed at the application layer,Enables varying levels of abstraction from DSP multimedia processing functionality,No dependencies on DSP/BIOS,Link-,xDM,codecs can work in any framework,Multiple options for delivery and flexibility,a la carte,Optimized Combinations,Complete DSP executable,Full system solution,Codecs,for,DaVinci,Technology have flexible interfaces,xDM API,H.264 BP enc,xDM API,WMV9,dec,xDM API,G.729ab,xDM API,JPEG enc/,dec,xDM API,WMAenc,xDM API,AAC,dec,MPEG4,MP3,WMA8,JPEG2K,JPEG,G.723,GSM-AMR,G.729ab,WMV9,MPEG2,H.264,60+codecs with 60+unique APIs!,Codecs,Video,Imaging,Speech,Audio,WMV9,VC1,MPEG4,H.264,MP3,WMA8,AAC+,etc.,JPEG,JPEG2K,G.729ab,G.726,GSM-AMR,60+codecs with only 1 API for each class!,Same class types as the VISA interface,xDM,is the low-level counterpart to the application layer VISA interface,Class-agnostic,Class-specific,xDM API,IMAGING,IALG,IRM,ICLASS,IERROR,IVENDOR,xDM API,VIDEO,IALG,IRM,ICLASS,IERROR,IVENDOR,xDM API,SPEECH,IALG,IRM,ICLASS,IERROR,IVENDOR,xDM API,AUDIO,IALG,IRM,ICLASS,IERROR,IVENDOR,Digital Media Codec Roadmap,1Q06,2Q06,3Q06,VIDEO,H.264 MP Decode,MPEG4 ASP Encode,H.264 BP Decode,WMV9 MP Encode,MPEG4 ASP Decode,H.264 BP Encode,VC1(WMV9 AP)Decode,H.263 Decode,H.263 Encode,MPEG4 SP Decode,MPEG4 SP Encode,MPEG-2 Decode,WMV9 MP Decode,IMAGE,JPEG Encode,JPEG Decode,SPEECH,G.711,G.728,G.729ab,G.723.1,AUDIO,MP3 Decode,WMA8 Encode,AAC-HE Encode,WMA9 Decode,AAC-HE Decode,AAC-LC Encode,AAC-LC Decode,Old Codec Roadmap,1Q06,2Q06,3Q06,VIDEO,H.264 MP Decode,H.263 Decode(profile-3),MPEG4 ASP Encode,H.264 BP Decode,H.263 Encode(profile-3),MPEG4 ASP Decode,H.264 BP Encode,VC1(WMV9 AP)Decode,H.263 Decode(profile-0),MPEG2 Encode,H.263 Encode(profile-0),MPEG4 SP Decode,MPEG4 SP Encode,MPEG-2 Decode,WMV9 MP Decode,WMV9 MP Encode,IMAGE,JPEG Encode,JPEG Decode,SPEECH,G.711,G.728,G.729ab,G.723.1,AUDIO,MP3 Decode,WMA8 Encode,WMA9 Decode,AAC+Encode,AAC+Decode,Codec Engine is TIs Powerful and Flexible Framework for Codec Execution,VISA APIs,The Codec Engine provides a standard software platform for algorithm execution,Robust,Tested with numerous codec combinations,Easy to use,Enables one API for each class of codecs with VISA API,Can use any,xDM,compliant codecs,Enables codecs to be remotely executed,ie,on DSP,Codecs can run on the ARM or DSP with same API presented to user,Powerful,Packages all the underlying component software to enable multi-algorithm combinations,Allows multiple codecs/combos to be run,Single or multiple codecs can be instantiated for each algorithm type,Codec Engine includes VISA APIs to interface with,xDM,compliant codecs,Supports,xDM,algorithm classes,Video,Imaging,Speech,Audio,Codec Engine,Video Task,Image Task,Speech Task,Audio Task,DSP/BIOS,DSP/BIOS Link,xDM,Codec,xDM,Codec,xDM,Codec,xDM,Codec,VISA APIs Enable Encode,Decode,and Algorithm Control,Eight interfaces based on four classes of multimedia algorithms(video,image,speech,&audio)and functionality(encode&decode),IIMG_ENC,IIMG_DEC,IVID_ENC IVID_DEC,VISA,IAUD_ENC IAUD_DEC,ISPH_ENC,ISPH_DEC,Figure 2:Generic interface defines by,xMI,Two functions for each interface:,process(),control(),Codec Engine,Create a DSP Executable with Configuration Guide,Documentation and example build script,Enables TI,customers,and 3rd parties to build custom combinations of algorithms,No DSP coding required,Builds libraries into a DSP executable with a,makefile,Parameters available to control memory placement,Uses TI codec engine framework to route data to multimedia algorithms,Creates a DSP AV executable,VISA interface is exposed to the application layer,Config,Guide,S,Codec Engine,Video Task,Image Task,Speech Task,Audio Task,DSP/BIOS,DSP/BIOS Link,xDM,Codec,xDM,Codec,xDM,Codec,xDM,Codec,xDM API,AUDIO,xDM API,SPEECH,xDM API,IMAGING,xDM API,VIDEO,xDM API,VIDEO,xDM API,VIDEO,xDM API,AUDIO,xDM API,AUDIO,DSP/BIOS,Building a Custom DSP AV Executable,Video Task,Image Task,Speech Task,Audio Task,H.264 BP enc,JPEG enc/,dec,AAC,dec,G.729ab,Codec Engine,Signal Processing LayerDSP Subsystem,Customer Application,Software,Linux Kernel v2.6.10 (Kernel Space),VISA APIs,Drivers,Input/Capture,Drivers,Output/Display,Application Layer ARM Subsystem,Inter-Processor Communication(Link),DSP/BIOS Link,Host Component,Codec Engine,Host Component,(User Space),VISA,Config,Guide,S,Codec Engine,Video Task,Image Task,Speech Task,Audio Task,DSP/BIOS,DSP/BIOS Link,xDM,Codec,xDM,Codec,xDM,Codec,xDM,Codec,Video Task,H.264 BP enc,Audio Task,AAC,dec,xDM API,AUDIO,xDM API,VIDEO,xDM API,H.264 BP enc,xDM API,AAC,dec,Old Slide not consistent with Feb 15,th,version of TRS for DVEVM/DVDP,Defined combinations of codecs to support key market requirements,Additional executables will be available over time,based on market demand,3,rd,parties will be enabled with the tools to create custom DSP AV executables,DSP AV Executables from TI,Defined combinations of codecs to support key market requirements,Additional executables will be available over time,based on market demand,3,rd,parties will be enabled with the tools to create custom DSP AV executables,DSP EXECUTABLES,Included with DVEVM,H.264 BP encode/decode;,H.264 BP encode,G.711 encode,MPEG-4 SP encode,G.711 encode,H.264 BP decode,AAC LC decode,MPEG-4 SP decode,G.711 decode,Also available,MPEG-2 decode,MPEG-1 layer 2 audio decode,JPEG encode/decode,More DSP AV executable combinations to come,DSP/BIOS,Building a Custom DSP AV Executable,Video Task,Image Task,Speech Task,Audio Task,H.264 BP enc,JPEG enc/,dec,AAC,dec,G.729ab,Codec Engine,Signal Processing LayerDSP Subsystem,Customer Application,Software,Linux Kernel v2.6.10 (Kernel Space),VISA APIs,Drivers,Input/Capture,Drivers,Output/Display,Application Layer ARM Subsystem,Inter-Processor Communication(Link),DSP/BIOS Link,Host Component,Codec Engine,Host Component,(User Space),VISA,Config,Guide,S,Codec Engine,Video Task,Image Task,Speech Task,Audio Task,DSP/BIOS,DSP/BIOS Link,xDM,Codec,xDM,Codec,xDM,Codec,xDM,Codec,Video Task,H.264 BP enc,Audio Task,AAC,dec,xDM API,VIDEO,xDM API,H.264 BP enc,xDM API,AUDIO,xDM API,AAC,dec,Custom DSP AV,Executable:,H.264,dec,+AAC,dec,AAC,WMA9,enc+dec,OEM Value Add,Customer Application Software,Linux Kernel,Video Encoder algorithm,Inter-Processor Communication(Link),Framework,Components,DSP/BIOS,Open Software Architecture on DSP and ARM,VIVA Interface,Codec Engine,xDAIS,-DT,Codec Combo:,WMV9+WMA9,.out-DSP executable,APIs,Drivers,Input/Capture,Drivers,Output/Display,DSP AV Executable(.out file),Pre-wired,by TI,by Authorized Software Provider,Custom Built with TI Codec Engine,Custom Built with Custom framework,Multiple options to tap into DSP performance,Pre-built DSP executable,Custom bundle of codecs,Custom IP along with codecs,Different levels of abstraction for different users,DSP AV Executable,Pre-built by TI or 3,rd,parties,Custom built w/Codec Engine,Codecs w/custom framework,DM644x,Software Overview,Drivers tightly integrated into OS,Input/output using Camera,LCD,HDD,Networking,etc.,Kernel Space,Signal Processing Layer,Application Layer,Customer,Value-Added,Differentiation,Digital Media APIs,Input/Output APIs,User Space,Codec APIs,A DSP Image that consists of:,Codecs,Codec engine,DSP/BIOS,Interprocessor,communications,Optimized Linux BSP,Linux 2.6.10 base port for DM644x EVM(based upon MontaVista kernel),Drivers,Serial,-,UART,I2C,SPI,Storage,-,ATA,NAND,MMC,Network,-,10/100 Ethernet(EMAC/CPMAC),USB,-,Mass storage-Host and Gadget drivers,Audio,-,OSS Audio driver,Video,-,V4L2 for Capture and,FBDev,/,DirectFB,for Display,UBoot 1.1.3(boot-loader),OS Adaptation Layer enables IPC Link to multiple Operating systems,ARM Subsystem,DSP Subsystem,OS,Adaptation,Layer,LINK driver,drivers,DSP/BIOS,DSP Application,WinCE OS,Adaptation,Layer,LINK driver,DSP/BIOS Link API,Operating System,Linux,WinCE,Host Application,BIOS Link software designed to support multiple,OSs,First implementation of DSP/BIOS Link will include OSAL for,Linux,PrOS,BIOS/Link porting guide outlines steps required to port to other operating systems,DSP/BIOS,Video,Audio,etc,WinCE,Video,Networking,etc,PrOS,Video,Audio,etc,EPSI,V4L2,FBDEV,OSS,etc,Linux,I2C,VLYNQ,Cache,etc,Commonality of drivers,Linux,BIOS,WinCE,PrOS,Etc,Facilitates faster porting of OS drivers for DaVinci,Customers,TI,or 3rd party partners can port driver package to additional,OSs,based on market needs,EPSI Leverages Commonality Between Multiple,OSs,Development tools and support,Linux development tools,Reference guidelines for high-speed video board design,DDR2 layout,etc.,DaVinci,Development Tools,Digital Video Evaluation Module(DV-EVM),Hardware,Based on the DM6446,Additional including hardware components:,NTSC/PAL video camera,5.6-inch LCD screen,Speakers and microphone,IR remote,Hard disk drive(2.5-inch 40G),Software,Codec evaluation and demos including:H.264,MPEG-4,MPEG-2,AAC+,G.711,Multimedia APIs&frameworks,MontaVista 2.6.10 Linux support package,Connectivity,Connectivity capabilities:USB 2.0,10/100 EMAC,Multiple on-board memory types:,CompactFlash,ATA,SD,DDR,Video input via NTSC/PAL,Video output via NTSC/PAL&,YPbPr,/RGB,CD-quality audio input and output,Daughter-card connections to peripheral interfaces,DVEVM,TMDXEVM6446,Order entry open,Get Started:Order Entry Open,Processors:Digital video system-on-chips,TMX320DM6443 Video decode,TMX320DM6446 Video encode/decode,DV-EVM(TMDXEVM6446):Validated software and hardware development,Software:Open,optimized&production tested,Platform-optimized,multimedia codecs,Platform support package,Linux support package,Industry-recognized APIs,Multimedia frameworks,DM6446,DM6443,DV-EVM,Digital Video Evaluation Module,You!,