Chinaunix首页 | 论坛 | 博客

Seal--学海无涯

首页　| 　博文目录　| 　关于我

xinyuwuxian

  • 博客访问： 646000
  • 博文数量： 113
  • 博客积分： 10
  • 博客等级： 民兵
  • 技术积分： 4176
  • 用 户 组： 普通用户
  • 注册时间： 2012-11-15 20:22
个人简介

最大化我的市场价值

文章分类

全部博文（113）

文章存档

2013年（113）

我的朋友
最近访客
推荐博文
相关博文
Android Camera OMX方式数据流分析

分类： Android平台

2013-04-18 18:41:08

Android Camera OMX方式数据流分析

在上一篇文章中，对preview过程做了一些简单的分析，其实没有很深入的分析，这篇文章就要在上一篇文章的基础之上深入分析数据到底是怎么传递的，其一，图像是怎样显示的，其二，图像是怎样保存的，这里只针对OMX这种方式进行分析，其实V4L2方式只是在CameraAdapter这里的实现不一样，其他层的调用基本是一致的，理解了OMX方法数据的流向，V4L2方式就没有什么问题

现在开始步入正题了
首先我们必须明确的是camera的图像是需要buffer存储的，那么这块内存是在哪里分配的呢
android camera的操作过程相信大家都比较熟悉，即使不是android 的camera，其他camera也都是一样的，只要打开camera，就自动进入preview模式，然后你点某个button拍了一张照片，或者点了某个button录了一段视频，这是camera的最主要功能，那么应该只有两种可能吧，就是一开始camera被调用的时候内存就申请了，另一种就是打开camera后，开始preview前申请内存，但肯定是不能再preview之后的，很容易理解啊，就像睡觉时先眯起眼睛在睡着的，而不是先睡着再眯起眼睛，嘻嘻
不知道的可以大体看一下frameworks的app，你可以发现好像是没有申请什么内存的方法出现，当然我没有那么细心的去看，那是因为我是认为是通过上面的第二种可能申请内存的，现在就开始看看
camera 打开后，一切都初始化ok，然后就真正的开始干活了，那就是调用startPreview了，开始preview啊，这从app一路高歌，知道走到hal层才去申请这个空间，让我不禁感慨app层就是爽，一声令下，底层你怎么去实现我不管，我只要结果，多有范儿，底层就用足了力气实现去了
再说细一点，这个内存的申请是在hal层startPreview的cameraPreviewInitialization方法中实现的，先贴出代码，待会分析
  1. status_t CameraHal::allocPreviewBufs(int width, int height, const char* previewFormat, unsigned int buffercount, unsigned int &max_queueable)
  2. {
  3.     status_t ret = NO_ERROR;

  5.     LOG_FUNCTION_NAME;

  7.     if(mDisplayAdapter.get() == NULL)
  8.     {
  9.         // Memory allocation of preview buffers is now placed in gralloc
  10.         // CameraHal should not allocate preview buffers without DisplayAdapter
  11.         return NO_MEMORY;
  12.     }

  14.     if(!mPreviewBuffers)
  15.     {
  16.         mPreviewLength = 0;
  17.         mPreviewBuffers = mDisplayAdapter->allocateBufferList(width, height,
  18.                                                                     previewFormat,
  19.                                                                     mPreviewLength,
  20.                                                                     buffercount);
  21.         if (NULL == mPreviewBuffers ) {
  22.             CAMHAL_LOGEA("Couldn't allocate preview buffers");
  23.             return NO_MEMORY;
  24.         }

  26.         mPreviewOffsets = (uint32_t *) mDisplayAdapter->getOffsets();
  27.         if ( NULL == mPreviewOffsets ) {
  28.             CAMHAL_LOGEA("Buffer mapping failed");
  29.             return BAD_VALUE;
  30.         }
  31.         //指定bufferProvider
  32.         mBufProvider = (BufferProvider*) mDisplayAdapter.get();
  33.         //获取mac_queueable
  34.         ret = mDisplayAdapter->maxQueueableBuffers(max_queueable);
  35.         if (ret != NO_ERROR) {
  36.             return ret;
  37.         }
  38.     }

  40.     LOG_FUNCTION_NAME_EXIT;

  42.     return ret;
  43. }
这个方法传入了几个参数，前几个参数是在这个方法之前都可以得到的，方法没什么难的，很容易理解
width：显示的宽
height：显示的高
previewFrame：显示的frame
buffercount：buffer的个数
max_queueable：这个参数以引用方式调用，重点是他是要往外带东西的，嘻嘻
上面的代码在开始分析之前，先大体看一下，也许你可以猜到，这里申请的mPreviewBuffer到底是用来干什么的，他是一个CameraFrame类型，底层获取到的数据最后都会打包成CameraFrame类型在往app层转交，或者直接通过overlay方式显示出来
在这之后还申请了一块memory，其实我不是很理解具体有什么意义，先看看吧
  1. status_t CameraHal::allocPreviewDataBufs(size_t size, size_t bufferCount)
  2. {
  3.     status_t ret = NO_ERROR;
  4.     int bytes;

  6.     LOG_FUNCTION_NAME;

  8.     bytes = size;

  10.     if ( NO_ERROR == ret )
  11.         {
  12.         if( NULL != mPreviewDataBuffers )
  13.             {
  14.             ret = freePreviewDataBufs();
  15.             }
  16.         }

  18.     if ( NO_ERROR == ret )
  19.         {
  20.         bytes = ((bytes+4095)/4096)*4096;
  21.         mPreviewDataBuffers = mMemoryManager->allocateBufferList(0, 0, NULL, bytes, bufferCount);

  23.         CAMHAL_LOGDB("Size of Preview data buffer = %d", bytes);
  24.         if( NULL == mPreviewDataBuffers )
  25.             {
  26.             CAMHAL_LOGEA("Couldn't allocate image buffers using memory manager");
  27.             ret = -NO_MEMORY;
  28.             }
  29.         else
  30.             {
  31.             bytes = size;
  32.             }
  33.         }

  35.     if ( NO_ERROR == ret )
  36.         {
  37.         mPreviewDataFd = mMemoryManager->getFd();
  38.         mPreviewDataLength = bytes;
  39.         mPreviewDataOffsets = mMemoryManager->getOffsets();
  40.         }
  41.     else
  42.         {
  43.         mPreviewDataFd = -1;
  44.         mPreviewDataLength = 0;
  45.         mPreviewDataOffsets = NULL;
  46.         }

  48.     LOG_FUNCTION_NAME_EXIT;

  50.     return ret;
  51. }
这里是通过mMemoryManager申请的一块内存区域，这里先知道这个内存区mPreviewDataBuffers
这里首先对mPreviewDataBuffers这块内存相关的属性信息打包到BuffersDescriptor这个结构中，然后调用
mCameraAdapter->sendCommand(CameraAdapter::CAMERA_USE_BUFFERS_PREVIEW_DATA, ( int ) &desc);
我们看看OMXCameraAdapter是怎样对应实现的吧
  1. case CameraAdapter::CAMERA_USE_BUFFERS_PREVIEW_DATA:
  2.                     CAMHAL_LOGDA("Use buffers for preview data");
  3.                     desc = ( BuffersDescriptor * ) value1;

  5.                     if ( NULL == desc )
  6.                         {
  7.                         CAMHAL_LOGEA("Invalid preview data buffers!");
  8.                         return -EINVAL;
  9.                         }

  11.                     if ( ret == NO_ERROR )
  12.                         {
  13.                         ret = setState(operation);
  14.                         }

  16.                     if ( ret == NO_ERROR )
  17.                         {
  18.                         Mutex::Autolock lock(mPreviewDataBufferLock);
  19.                         mPreviewDataBuffers = desc->mBuffers;
  20.                         mPreviewDataBuffersLength = desc->mLength;
  21.                         mPreviewDataBuffersAvailable.clear();
  22.                         for ( uint32_t i = 0 ; i < desc->mMaxQueueable ; i++ )
  23.                             {
  24.                             mPreviewDataBuffersAvailable.add(&mPreviewDataBuffers[i], 0);
  25.                             }
  26.                         // initial ref count for undeqeueued buffers is 1 since buffer provider
  27.                         // is still holding on to it
  28.                         for ( uint32_t i = desc->mMaxQueueable ; i < desc->mCount ; i++ )
  29.                             {
  30.                             mPreviewDataBuffersAvailable.add(&mPreviewDataBuffers[i], 1);
  31.                             }
  32.                         }

  34.                     if ( NULL != desc )
  35.                         {
  36.                         ret = useBuffers(CameraAdapter::CAMERA_MEASUREMENT,
  37.                                          desc->mBuffers,
  38.                                          desc->mCount,
  39.                                          desc->mLength,
  40.                                          desc->mMaxQueueable);
  41.                         }

  43.                     if ( ret == NO_ERROR )
  44.                         {
  45.                         ret = commitState();
  46.                         }
  47.                     else
  48.                         {
  49.                         ret |= rollbackState();
  50.                         }

  52.                     break;
这里先不做过多说明，之后遇到了再说，最终他会调用到OMXCameraAdapter的UseBuffersPreviewData方法，看看他的实现
  1. status_t OMXCameraAdapter::UseBuffersPreviewData(CameraBuffer * bufArr, int num)
  2. {
  3.     status_t ret = NO_ERROR;
  4.     OMX_ERRORTYPE eError = OMX_ErrorNone;
  5.     OMXCameraPortParameters * measurementData = NULL;
  6.     Mutex::Autolock lock( mPreviewDataBufferLock);

  8.     LOG_FUNCTION_NAME;

  10.     if ( mComponentState != OMX_StateLoaded )
  11.         {
  12.         CAMHAL_LOGEA("Calling UseBuffersPreviewData() when not in LOADED state");
  13.         return BAD_VALUE;
  14.         }

  16.     if ( NULL == bufArr )
  17.         {
  18.         CAMHAL_LOGEA("NULL pointer passed for buffArr");
  19.         return BAD_VALUE;
  20.         }

  22.     if ( 0 != mUsePreviewDataSem.Count() )
  23.         {
  24.         CAMHAL_LOGEB("Error mUsePreviewDataSem semaphore count %d", mUsePreviewDataSem.Count());
  25.         LOG_FUNCTION_NAME_EXIT;
  26.         return NO_INIT;
  27.         }

  29.     if ( NO_ERROR == ret )
  30.         {
  31.         这里只是把num这个参数保存到measurementPortIndex对应的参数mNumBufs
  32.         measurementData = &mCameraAdapterParameters.mCameraPortParams[mCameraAdapterParameters.mMeasurementPortIndex];
  33.         measurementData->mNumBufs = num ;
  34.         }

  36.     if ( NO_ERROR == ret )
  37.         {
  38.          ///Register for port enable event on measurement port
  39.         ret = RegisterForEvent(mCameraAdapterParameters.mHandleComp,
  40.                                       OMX_EventCmdComplete,
  41.                                       OMX_CommandPortEnable,
  42.                                       mCameraAdapterParameters.mMeasurementPortIndex,
  43.                                       mUsePreviewDataSem);

  45.         if ( ret == NO_ERROR )
  46.             {
  47.             CAMHAL_LOGDB("Registering for event %d", ret);
  48.             }
  49.         else
  50.             {
  51.             CAMHAL_LOGEB("Error in registering for event %d", ret);
  52.             goto EXIT;
  53.             }
  54.         }

  56.     if ( NO_ERROR == ret )
  57.         {
  58.          //Enable MEASUREMENT Port
  59.          eError = OMX_SendCommand(mCameraAdapterParameters.mHandleComp,
  60.                                       OMX_CommandPortEnable,
  61.                                       mCameraAdapterParameters.mMeasurementPortIndex,
  62.                                       NULL);

  64.             if ( eError == OMX_ErrorNone )
  65.                 {
  66.                 CAMHAL_LOGDB("OMX_SendCommand(OMX_CommandPortEnable) -0x%x", eError);
  67.                 }
  68.             else
  69.                 {
  70.                 CAMHAL_LOGEB("OMX_SendCommand(OMX_CommandPortEnable) -0x%x", eError);
  71.                 goto EXIT;
  72.                 }
  73.         }

  75.     if ( NO_ERROR == ret )
  76.         {
  77.         ret = mUsePreviewDataSem.WaitTimeout(OMX_CMD_TIMEOUT);

  79.         //If somethiing bad happened while we wait
  80.         if (mComponentState == OMX_StateInvalid)
  81.           {
  82.             CAMHAL_LOGEA("Invalid State after measurement port enable Exitting!!!");
  83.             goto EXIT;
  84.           }

  86.         if ( NO_ERROR == ret )
  87.             {
  88.             CAMHAL_LOGDA("Port enable event arrived on measurement port");
  89.             }
  90.         else
  91.             {
  92.             ret |= RemoveEvent(mCameraAdapterParameters.mHandleComp,
  93.                                OMX_EventCmdComplete,
  94.                                OMX_CommandPortEnable,
  95.                                mCameraAdapterParameters.mMeasurementPortIndex,
  96.                                NULL);
  97.             CAMHAL_LOGEA("Timeout expoired during port enable on measurement port");
  98.             goto EXIT;
  99.             }

  101.         CAMHAL_LOGDA("Port enable event arrived on measurement port");
  102.         }

  104.     LOG_FUNCTION_NAME_EXIT;

  106.     return ret;
  107. EXIT:
  108.     CAMHAL_LOGEB("Exiting function %s because of ret %d eError=%x", __FUNCTION__, ret, eError);
  109.     performCleanupAfterError();
  110.     LOG_FUNCTION_NAME_EXIT;
  111.     return (ret | ErrorUtils::omxToAndroidError(eError));
  112. }
接下来首先对mPreviewBuffers这块内存相关的属性信息打包到BuffersDescriptor这个结构中，然后调用
ret = mCameraAdapter->sendCommand(CameraAdapter::CAMERA_USE_BUFFERS_PREVIEW, ( int ) &desc);
看看他的具体实现吧
  1. case CameraAdapter::CAMERA_USE_BUFFERS_PREVIEW:
  2.                 CAMHAL_LOGDA("Use buffers for preview");
  3.                 desc = ( BuffersDescriptor * ) value1;

  5.                 if ( NULL == desc )
  6.                     {
  7.                     CAMHAL_LOGEA("Invalid preview buffers!");
  8.                     return -EINVAL;
  9.                     }

  11.                 if ( ret == NO_ERROR )
  12.                     {
  13.                     ret = setState(operation);
  14.                     }

  16.                 if ( ret == NO_ERROR )
  17.                     {
  18.                     Mutex::Autolock lock(mPreviewBufferLock);
  19.                     mPreviewBuffers = desc->mBuffers;
  20.                     mPreviewBuffersLength = desc->mLength;
  21.                     mPreviewBuffersAvailable.clear();
  22.                     mSnapshotBuffersAvailable.clear();
  23.                     for ( uint32_t i = 0 ; i < desc->mMaxQueueable ; i++ )
  24.                         {
  25.                         mPreviewBuffersAvailable.add(&mPreviewBuffers[i], 0);
  26.                         }
  27.                     // initial ref count for undeqeueued buffers is 1 since buffer provider
  28.                     // is still holding on to it
  29.                     for ( uint32_t i = desc->mMaxQueueable ; i < desc->mCount ; i++ )
  30.                         {
  31.                         mPreviewBuffersAvailable.add(&mPreviewBuffers[i], 1);
  32.                         }
  33.                     }

  35.                 if ( NULL != desc )
  36.                     {
  37.                     ret = useBuffers(CameraAdapter::CAMERA_PREVIEW,
  38.                                      desc->mBuffers,
  39.                                      desc->mCount,
  40.                                      desc->mLength,
  41.                                      desc->mMaxQueueable);
  42.                     }

  44.                 if ( ret == NO_ERROR )
  45.                     {
  46.                     ret = commitState();
  47.                     }
  48.                 else
  49.                     {
  50.                     ret |= rollbackState();
  51.                     }

  53.                 break;
到这里大家看到了这个过程跟上面的调用时那么的相似，接下来也看看他在OMXCameraAdapter的实现方法UseBuffersPreview
  1. status_t OMXCameraAdapter::UseBuffersPreview(CameraBuffer * bufArr, int num)
  2. {
  3.     status_t ret = NO_ERROR;
  4.     OMX_ERRORTYPE eError = OMX_ErrorNone;
  5.     int tmpHeight, tmpWidth;

  7.     LOG_FUNCTION_NAME;

  9.     if(!bufArr)
  10.         {
  11.         CAMHAL_LOGEA("NULL pointer passed for buffArr");
  12.         LOG_FUNCTION_NAME_EXIT;
  13.         return BAD_VALUE;
  14.         }

  16.     OMXCameraPortParameters * mPreviewData = NULL;
  17.     OMXCameraPortParameters *measurementData = NULL;
  18.     这里暂时将mPreviewData和measurementData这两个指针分别指向preview port和measurement port的port params结构，方便之后对这两个port的设置
  19.     mPreviewData = &mCameraAdapterParameters.mCameraPortParams[mCameraAdapterParameters.mPrevPortIndex];
  20.     measurementData = &mCameraAdapterParameters.mCameraPortParams[mCameraAdapterParameters.mMeasurementPortIndex];
  21.     mPreviewData->mNumBufs = num ;

  23.     if ( 0 != mUsePreviewSem.Count() )
  24.         {
  25.         CAMHAL_LOGEB("Error mUsePreviewSem semaphore count %d", mUsePreviewSem.Count());
  26.         LOG_FUNCTION_NAME_EXIT;
  27.         return NO_INIT;
  28.         }

  30.     if(mPreviewData->mNumBufs != num)
  31.         {
  32.         CAMHAL_LOGEA("Current number of buffers doesnt equal new num of buffers passed!");
  33.         LOG_FUNCTION_NAME_EXIT;
  34.         return BAD_VALUE;
  35.         }

  37.     mStateSwitchLock.lock();
  38.     这里两个横线之中的内容，其实我没有很理解这些东西是干什么用的，不影响我们接着往下看，暂不深入追究
  39.     if ( mComponentState == OMX_StateLoaded ) {

  41.         if (mPendingPreviewSettings & SetLDC) {
  42.             mPendingPreviewSettings &= ~SetLDC;
  43.             ret = setLDC(mIPP);
  44.             if ( NO_ERROR != ret ) {
  45.                 CAMHAL_LOGEB("setLDC() failed %d", ret);
  46.             }
  47.         }

  49.         if (mPendingPreviewSettings & SetNSF) {
  50.             mPendingPreviewSettings &= ~SetNSF;
  51.             ret = setNSF(mIPP);
  52.             if ( NO_ERROR != ret ) {
  53.                 CAMHAL_LOGEB("setNSF() failed %d", ret);
  54.             }
  55.         }

  57.         if (mPendingPreviewSettings & SetCapMode) {
  58.             mPendingPreviewSettings &= ~SetCapMode;
  59.             ret = setCaptureMode(mCapMode);
  60.             if ( NO_ERROR != ret ) {
  61.                 CAMHAL_LOGEB("setCaptureMode() failed %d", ret);
  62.             }
  63.         }

  65.         if(mCapMode == OMXCameraAdapter::VIDEO_MODE) {

  67.             if (mPendingPreviewSettings & SetVNF) {
  68.                 mPendingPreviewSettings &= ~SetVNF;
  69.                 ret = enableVideoNoiseFilter(mVnfEnabled);
  70.                 if ( NO_ERROR != ret){
  71.                     CAMHAL_LOGEB("Error configuring VNF %x", ret);
  72.                 }
  73.             }

  75.             if (mPendingPreviewSettings & SetVSTAB) {
  76.                 mPendingPreviewSettings &= ~SetVSTAB;
  77.                 ret = enableVideoStabilization(mVstabEnabled);
  78.                 if ( NO_ERROR != ret) {
  79.                     CAMHAL_LOGEB("Error configuring VSTAB %x", ret);
  80.                 }
  81.             }

  83.         }
  84.     }

  86.     ret = setSensorOrientation(mSensorOrientation);
  87.     if ( NO_ERROR != ret )
  88.         {
  89.         CAMHAL_LOGEB("Error configuring Sensor Orientation %x", ret);
  90.         mSensorOrientation = 0;
  91.         }

  93.     if ( mComponentState == OMX_StateLoaded )
  94.         {
  95.         ///Register for IDLE state switch event
  96.         ret = RegisterForEvent(mCameraAdapterParameters.mHandleComp,
  97.                                OMX_EventCmdComplete,
  98.                                OMX_CommandStateSet,
  99.                                OMX_StateIdle,
  100.                                mUsePreviewSem);

  102.         if(ret!=NO_ERROR)
  103.             {
  104.             CAMHAL_LOGEB("Error in registering for event %d", ret);
  105.             goto EXIT;
  106.             }

  108.         ///Once we get the buffers, move component state to idle state and pass the buffers to OMX comp using UseBuffer
  109.         eError = OMX_SendCommand (mCameraAdapterParameters.mHandleComp ,
  110.                                   OMX_CommandStateSet,
  111.                                   OMX_StateIdle,
  112.                                   NULL);

  114.         CAMHAL_LOGDB("OMX_SendCommand(OMX_CommandStateSet) 0x%x", eError);

  116.         GOTO_EXIT_IF((eError!=OMX_ErrorNone), eError);

  118.         mComponentState = OMX_StateIdle;
  119.         }
  120.     else
  121.         {
  122.             ///Register for Preview port ENABLE event
  123.             ret = RegisterForEvent(mCameraAdapterParameters.mHandleComp,
  124.                                    OMX_EventCmdComplete,
  125.                                    OMX_CommandPortEnable,
  126.                                    mCameraAdapterParameters.mPrevPortIndex,
  127.                                    mUsePreviewSem);

  129.             if ( NO_ERROR != ret )
  130.                 {
  131.                 CAMHAL_LOGEB("Error in registering for event %d", ret);
  132.                 goto EXIT;
  133.                 }

  135.             ///Enable Preview Port
  136.             eError = OMX_SendCommand(mCameraAdapterParameters.mHandleComp,
  137.                                      OMX_CommandPortEnable,
  138.                                      mCameraAdapterParameters.mPrevPortIndex,
  139.                                      NULL);
  140.         }


  143.     ///Configure DOMX to use either gralloc handles or vptrs
  144.     OMX_TI_PARAMUSENATIVEBUFFER domxUseGrallocHandles;
  145.     OMX_INIT_STRUCT_PTR (&domxUseGrallocHandles, OMX_TI_PARAMUSENATIVEBUFFER);

  147.     domxUseGrallocHandles.nPortIndex = mCameraAdapterParameters.mPrevPortIndex;
  148.     domxUseGrallocHandles.bEnable = OMX_TRUE;

  150.     eError = OMX_SetParameter(mCameraAdapterParameters.mHandleComp, (OMX_INDEXTYPE)OMX_TI_IndexUseNativeBuffers, &domxUseGrallocHandles);
  151.     if(eError!=OMX_ErrorNone)
  152.         {
  153.         CAMHAL_LOGEB("OMX_SetParameter - %x", eError);
  154.         }
  155.     GOTO_EXIT_IF((eError!=OMX_ErrorNone), eError);

  157.     OMX_BUFFERHEADERTYPE *pBufferHdr;
  158.     for(int index=0;index<num;index++) {
  159.         OMX_U8 *ptr;

  161.         ptr = (OMX_U8 *)camera_buffer_get_omx_ptr (&bufArr[index]);
  162.         eError = OMX_UseBuffer( mCameraAdapterParameters.mHandleComp,
  163.                                 &pBufferHdr,
  164.                                 mCameraAdapterParameters.mPrevPortIndex,
  165.                                 0,
  166.                                 mPreviewData->mBufSize,
  167.                                 ptr);
  168.         if(eError!=OMX_ErrorNone)
  169.             {
  170.             CAMHAL_LOGEB("OMX_UseBuffer-0x%x", eError);
  171.             }
  172.         GOTO_EXIT_IF((eError!=OMX_ErrorNone), eError);
  173.         这里在我看来还是很重要的，将我们从hal层申请的内存与preview port的bufferheader关联到一起，这里先填充一个bufferheader然后指向port param的mBufferHeader
  174.         pBufferHdr->pAppPrivate = (OMX_PTR)&bufArr[index];
  175.         pBufferHdr->nSize = sizeof(OMX_BUFFERHEADERTYPE);
  176.         pBufferHdr->nVersion.s.nVersionMajor = 1 ;
  177.         pBufferHdr->nVersion.s.nVersionMinor = 1 ;
  178.         pBufferHdr->nVersion.s.nRevision = 0 ;
  179.         pBufferHdr->nVersion.s.nStep = 0;
  180.         mPreviewData->mBufferHeader[index] = pBufferHdr;
  181.     }

  183.     if ( mMeasurementEnabled )
  184.         {

  186.         for( int i = 0; i < num; i++ )
  187.             {
  188.             OMX_BUFFERHEADERTYPE *pBufHdr;
  189.             OMX_U8 *ptr;

  191.             ptr = (OMX_U8 *)camera_buffer_get_omx_ptr (&mPreviewDataBuffers[i]);
  192.             eError = OMX_UseBuffer( mCameraAdapterParameters.mHandleComp,
  193.                                     &pBufHdr,
  194.                                     mCameraAdapterParameters.mMeasurementPortIndex,
  195.                                     0,
  196.                                     measurementData->mBufSize,
  197.                                     ptr);

  199.              if ( eError == OMX_ErrorNone )
  200.                 {
  201.                 这里在我看来还是很重要的，将我们从hal层申请的内存与measurement port的bufferheader关联到一起，这里先填充一个bufferheader然后指向port param的mBufferHeader
  202.                 pBufHdr->pAppPrivate = (OMX_PTR *)&mPreviewDataBuffers[i];
  203.                 pBufHdr->nSize = sizeof(OMX_BUFFERHEADERTYPE);
  204.                 pBufHdr->nVersion.s.nVersionMajor = 1 ;
  205.                 pBufHdr->nVersion.s.nVersionMinor = 1 ;
  206.                 pBufHdr->nVersion.s.nRevision = 0 ;
  207.                 pBufHdr->nVersion.s.nStep = 0;
  208.                 measurementData->mBufferHeader[i] = pBufHdr;
  209.                 }
  210.             else
  211.                 {
  212.                 CAMHAL_LOGEB("OMX_UseBuffer -0x%x", eError);
  213.                 ret = BAD_VALUE;
  214.                 break;
  215.                 }
  216.             }

  218.         }

  220.     CAMHAL_LOGDA("Registering preview buffers");

  222.     ret = mUsePreviewSem.WaitTimeout(OMX_CMD_TIMEOUT);

  224.     //If somethiing bad happened while we wait
  225.     if (mComponentState == OMX_StateInvalid)
  226.       {
  227.         CAMHAL_LOGEA("Invalid State after Registering preview buffers Exitting!!!");
  228.         goto EXIT;
  229.       }

  231.     if ( NO_ERROR == ret )
  232.         {
  233.         CAMHAL_LOGDA("Preview buffer registration successfull");
  234.         }
  235.     else
  236.         {
  237.         if ( mComponentState == OMX_StateLoaded )
  238.             {
  239.             ret |= RemoveEvent(mCameraAdapterParameters.mHandleComp,
  240.                                OMX_EventCmdComplete,
  241.                                OMX_CommandStateSet,
  242.                                OMX_StateIdle,
  243.                                NULL);
  244.             }
  245.         else
  246.             {
  247.             ret |= SignalEvent(mCameraAdapterParameters.mHandleComp,
  248.                                OMX_EventCmdComplete,
  249.                                OMX_CommandPortEnable,
  250.                                mCameraAdapterParameters.mPrevPortIndex,
  251.                                NULL);
  252.             }
  253.         CAMHAL_LOGEA("Timeout expired on preview buffer registration");
  254.         goto EXIT;
  255.         }

  257.     LOG_FUNCTION_NAME_EXIT;

  259.     return (ret | ErrorUtils::omxToAndroidError(eError));

  261.     ///If there is any failure, we reach here.
  262.     ///Here, we do any resource freeing and convert from OMX error code to Camera Hal error code
  263. EXIT:
  264.     mStateSwitchLock.unlock();

  266.     CAMHAL_LOGEB("Exiting function %s because of ret %d eError=%x", __FUNCTION__, ret, eError);
  267.     performCleanupAfterError();
  268.     CAMHAL_LOGEB("Exiting function %s because of ret %d eError=%x", __FUNCTION__, ret, eError);

  270.     LOG_FUNCTION_NAME_EXIT;

  272.     return (ret | ErrorUtils::omxToAndroidError(eError));
  273. }
到这里我所关注的初始化已经完成了，其实一些初始动作，这里暂时不关注，最后hal层调用OMXCameraAdapter的startPreview真正要开始preview了
接下来的分析就要仔细一点了，相对来说很重要，不能马虎，慢慢研究startPreview的实现吧
  1. status_t OMXCameraAdapter::startPreview()
  2. {
  3.     status_t ret = NO_ERROR;
  4.     OMX_ERRORTYPE eError = OMX_ErrorNone;
  5.     OMXCameraPortParameters *mPreviewData = NULL;
  6.     OMXCameraPortParameters *measurementData = NULL;

  8.     LOG_FUNCTION_NAME;

  10.     if( 0 != mStartPreviewSem.Count() )
  11.         {
  12.         CAMHAL_LOGEB("Error mStartPreviewSem semaphore count %d", mStartPreviewSem.Count());
  13.         ret = NO_INIT;
  14.         goto EXIT;
  15.         }

  17.     // Enable all preview mode extra data.
  18.     if ( OMX_ErrorNone == eError) {
  19.         ret |= setExtraData(true, mCameraAdapterParameters.mPrevPortIndex, OMX_AncillaryData);
  20.         ret |= setExtraData(true, OMX_ALL, OMX_TI_VectShotInfo);
  21.     }
  22.     
  23.     这里获取到preview port和measurement port param结构的指针，方便之后的使用
  24.     mPreviewData = &mCameraAdapterParameters.mCameraPortParams[mCameraAdapterParameters.mPrevPortIndex];
  25.     measurementData = &mCameraAdapterParameters.mCameraPortParams[mCameraAdapterParameters.mMeasurementPortIndex];

  27.     if( OMX_StateIdle == mComponentState )
  28.         {
  29.         ///Register for EXECUTING state transition.
  30.         ///This method just inserts a message in Event Q, which is checked in the callback
  31.         ///The sempahore passed is signalled by the callback
  32.         ret = RegisterForEvent(mCameraAdapterParameters.mHandleComp,
  33.                                OMX_EventCmdComplete,
  34.                                OMX_CommandStateSet,
  35.                                OMX_StateExecuting,
  36.                                mStartPreviewSem);

  38.         if(ret!=NO_ERROR)
  39.             {
  40.             CAMHAL_LOGEB("Error in registering for event %d", ret);
  41.             goto EXIT;
  42.             }

  44.         ///Switch to EXECUTING state，为fillbuffer做准备
  45.         eError = OMX_SendCommand(mCameraAdapterParameters.mHandleComp,
  46.                                  OMX_CommandStateSet,
  47.                                  OMX_StateExecuting,
  48.                                  NULL);

  50.         if(eError!=OMX_ErrorNone)
  51.             {
  52.             CAMHAL_LOGEB("OMX_SendCommand(OMX_StateExecuting)-0x%x", eError);
  53.             }

  55.         CAMHAL_LOGDA("+Waiting for component to go into EXECUTING state");
  56.         ret = mStartPreviewSem.WaitTimeout(OMX_CMD_TIMEOUT);

  58.         //If somethiing bad happened while we wait
  59.         if (mComponentState == OMX_StateInvalid)
  60.           {
  61.             CAMHAL_LOGEA("Invalid State after IDLE_EXECUTING Exitting!!!");
  62.             goto EXIT;
  63.           }

  65.         if ( NO_ERROR == ret )
  66.             {
  67.             CAMHAL_LOGDA("+Great. Component went into executing state!!");
  68.             }
  69.         else
  70.             {
  71.             ret |= RemoveEvent(mCameraAdapterParameters.mHandleComp,
  72.                                OMX_EventCmdComplete,
  73.                                OMX_CommandStateSet,
  74.                                OMX_StateExecuting,
  75.                                NULL);
  76.             CAMHAL_LOGDA("Timeout expired on executing state switch!");
  77.             goto EXIT;
  78.             }

  80.         mComponentState = OMX_StateExecuting;

  82.         }

  84.     mStateSwitchLock.unlock();

  86.     //Queue all the buffers on preview port
  87.     这里把所有的preview port的bufferheader fill到preview port上，然后等待数据经过处理，buffer被填充后通过fillBufferDone回调给应用层
  88.     for(int index=0;index< mPreviewData->mMaxQueueable;index++)
  89.         {
  90.         CAMHAL_LOGDB("Queuing buffer on Preview port - 0x%x", (uint32_t)mPreviewData->mBufferHeader[index]->pBuffer);
  91.         mPreviewData->mStatus[index] = OMXCameraPortParameters::FILL;
  92.         eError = OMX_FillThisBuffer(mCameraAdapterParameters.mHandleComp,
  93.                     (OMX_BUFFERHEADERTYPE*)mPreviewData->mBufferHeader[index]);
  94.         if(eError!=OMX_ErrorNone)
  95.             {
  96.             CAMHAL_LOGEB("OMX_FillThisBuffer-0x%x", eError);
  97.             }
  98.         mFramesWithDucati++;
  99. #ifdef CAMERAHAL_DEBUG
  100.         mBuffersWithDucati.add((int)mPreviewData->mBufferHeader[index]->pAppPrivate,1);
  101. #endif
  102.         GOTO_EXIT_IF((eError!=OMX_ErrorNone), eError);
  103.         }

  105.     if ( mMeasurementEnabled )
  106.         {
  107.         这里把所有的measure port的bufferheader fill到measure port上，然后等待数据经过处理，buffer被填充后通过fillBufferDone回调给应用层
  108.         for(int index=0;index< mPreviewData->mNumBufs;index++)
  109.             {
  110.             CAMHAL_LOGDB("Queuing buffer on Measurement port - 0x%x", (uint32_t) measurementData->mBufferHeader[index]->pBuffer);
  111.             measurementData->mStatus[index] = OMXCameraPortParameters::FILL;
  112.             eError = OMX_FillThisBuffer(mCameraAdapterParameters.mHandleComp,
  113.                             (OMX_BUFFERHEADERTYPE*) measurementData->mBufferHeader[index]);
  114.             if(eError!=OMX_ErrorNone)
  115.                 {
  116.                 CAMHAL_LOGEB("OMX_FillThisBuffer-0x%x", eError);
  117.                 }
  118.             GOTO_EXIT_IF((eError!=OMX_ErrorNone), eError);
  119.             }

  121.         }

  123.     setFocusCallback(true);

  125.     //reset frame rate estimates
  126.     mFPS = 0.0f;
  127.     mLastFPS = 0.0f;
  128.     // start frame count from 0. i.e first frame after
  129.     // startPreview will be the 0th reference frame
  130.     // this way we will wait for second frame until
  131.     // takePicture/autoFocus is allowed to run. we
  132.     // are seeing SetConfig/GetConfig fail after
  133.     // calling after the first frame and not failing
  134.     // after the second frame
  135.     mFrameCount = -1;
  136.     mLastFrameCount = 0;
  137.     mIter = 1;
  138.     mLastFPSTime = systemTime();
  139.     mTunnelDestroyed = false;

  141.     LOG_FUNCTION_NAME_EXIT;

  143.     return (ret | ErrorUtils::omxToAndroidError(eError));

  145.     EXIT:

  147.     CAMHAL_LOGEB("Exiting function %s because of ret %d eError=%x", __FUNCTION__, ret, eError);
  148.     performCleanupAfterError();
  149.     mStateSwitchLock.unlock();
  150.     LOG_FUNCTION_NAME_EXIT;

  152.     return (ret | ErrorUtils::omxToAndroidError(eError));

  154. }
经过上面的调用，之前初始化ok的buffer全部被分别fill到preview和measure port上，然后我上面也已经说过了，我们就等待组件处理完，并填充buffer，然后通知我，那么我们是在哪里接到组件的通知的呢？？
不错，就是上面说的FillBufferDone方法，下面就多花点时间看看这个FillBufferDone方法
  1. /*========================================================*/
  2. /* @ fn SampleTest_FillBufferDone :: Application callback*/
  3. /*========================================================*/
  4. OMX_ERRORTYPE OMXCameraAdapterFillBufferDone(OMX_IN OMX_HANDLETYPE hComponent,
  5.                                    OMX_IN OMX_PTR pAppData,
  6.                                    OMX_IN OMX_BUFFERHEADERTYPE* pBuffHeader)
  7. {
  8.     TIUTILS::Message msg;
  9.     OMX_ERRORTYPE eError = OMX_ErrorNone;

  11.     if (UNLIKELY(mDebugFps)) {
  12.         debugShowFPS();
  13.     }

  15.     OMXCameraAdapter *adapter = ( OMXCameraAdapter * ) pAppData;
  16.     if ( NULL != adapter )
  17.         {
  18.         msg.command = OMXCameraAdapter::OMXCallbackHandler::CAMERA_FILL_BUFFER_DONE;
  19.         msg.arg1 = ( void * ) hComponent;
  20.         msg.arg2 = ( void * ) pBuffHeader;
  21.         adapter->mOMXCallbackHandler->put(&msg);
  22.         }

  24.     return eError;
  25. }
分析一下上面的fillbufferdone方法，他没有直接对组件发给我们的消息做任何操作，他只是有点懒，他对发来的消息只是进行了打包然后就丢下去，让下面的小弟去做那些繁琐的处理过程，就是之前在初始化时启动的OMXCallbackHandler线程去做这件事请的，那么就看看这个handle方法吧，看看他到底是怎么处理的
  1. bool OMXCameraAdapter::OMXCallbackHandler::Handler()
  2. {
  3.     TIUTILS::Message msg;
  4.     volatile int forever = 1;
  5.     status_t ret = NO_ERROR;

  7.     LOG_FUNCTION_NAME;

  9.     while(forever){
  10.         TIUTILS::MessageQueue::waitForMsg(&mCommandMsgQ, NULL, NULL, -1);
  11.         {
  12.         Mutex::Autolock lock(mLock);
  13.         mCommandMsgQ.get(&msg);
  14.         mIsProcessed = false;
  15.         }

  17.         switch ( msg.command ) {
  18.             case OMXCallbackHandler::CAMERA_FILL_BUFFER_DONE:
  19.             {
  20.                 ret = mCameraAdapter->OMXCameraAdapterFillBufferDone(( OMX_HANDLETYPE ) msg.arg1, ( OMX_BUFFERHEADERTYPE *) msg.arg2);
  21.                 break;
  22.             }
  23.             case OMXCallbackHandler::CAMERA_FOCUS_STATUS:
  24.             {
  25.                 mCameraAdapter->handleFocusCallback();
  26.                 break;
  27.             }
  28.             case CommandHandler::COMMAND_EXIT:
  29.             {
  30.                 CAMHAL_LOGDA("Exiting OMX callback handler");
  31.                 forever = 0;
  32.                 break;
  33.             }
  34.         }

  36.         {
  37.             android::AutoMutex locker(mLock);
  38.             CAMHAL_UNUSED(locker);

  40.             mIsProcessed = mCommandMsgQ.isEmpty();
  41.             if ( mIsProcessed )
  42.                 mCondition.signal();
  43.         }
  44.     }

  46.     // force the condition to wake
  47.     {
  48.         android::AutoMutex locker(mLock);
  49.         CAMHAL_UNUSED(locker);

  51.         mIsProcessed = true;
  52.         mCondition.signal();
  53.     }

  55.     LOG_FUNCTION_NAME_EXIT;
  56.     return false;
  57. }
不错，上面标注部分就是组件给我们返回来的消息，开始处理喽，这个处理过程第一次看很复杂，没办法啊，谁让他那么重要呢？？硬着头皮看看吧
  1. /*========================================================*/
  2. /* @ fn SampleTest_FillBufferDone :: Application callback*/
  3. /*========================================================*/
  4. OMX_ERRORTYPE OMXCameraAdapter::OMXCameraAdapterFillBufferDone(OMX_IN OMX_HANDLETYPE hComponent,
  5.                                    OMX_IN OMX_BUFFERHEADERTYPE* pBuffHeader)
  6. {

  8.     status_t stat = NO_ERROR;
  9.     status_t res1, res2;
  10.     OMXCameraPortParameters *pPortParam;
  11.     OMX_ERRORTYPE eError = OMX_ErrorNone;
  12.     CameraFrame::FrameType typeOfFrame = CameraFrame::ALL_FRAMES;
  13.     unsigned int refCount = 0;
  14.     BaseCameraAdapter::AdapterState state, nextState;
  15.     BaseCameraAdapter::getState(state);
  16.     BaseCameraAdapter::getNextState(nextState);
  17.     sp<CameraMetadataResult> metadataResult = NULL;
  18.     unsigned int mask = 0xFFFF;
  19.     CameraFrame cameraFrame;
  20.     OMX_OTHER_EXTRADATATYPE *extraData;
  21.     OMX_TI_ANCILLARYDATATYPE *ancillaryData = NULL;
  22.     bool snapshotFrame = false;

  24.     if ( NULL == pBuffHeader ) {
  25.         return OMX_ErrorBadParameter;
  26.     }

  28. #ifdef CAMERAHAL_OMX_PROFILING

  30.     storeProfilingData(pBuffHeader);

  32. #endif

  34.     res1 = res2 = NO_ERROR;

  36.     if ( !pBuffHeader || !pBuffHeader->pBuffer ) {
  37.         CAMHAL_LOGEA("NULL Buffer from OMX");
  38.         return OMX_ErrorNone;
  39.     }
  40.     这里这个pPortParm到底应该是哪个port的param呢？？其实是不一定的
  41.     1.如果这个消息是preview port 的fillbufferdone，那么自然这里这个pPortParm指针指向的就是preview port 的param
  42.     2.如果这个消息是measurement port 的fillbufferdone，那么自然这里这个pPortParm指针指向的就是measurement port 的param
  43.     pPortParam = &(mCameraAdapterParameters.mCameraPortParams[pBuffHeader->nOutputPortIndex]);

  45.     // Find buffer and mark it as filled，首先比对，比对ok后标记为filldone
  46.     for (int i = 0; i < pPortParam->mNumBufs; i++) {
  47.         if (pPortParam->mBufferHeader[i] == pBuffHeader) {
  48.             pPortParam->mStatus[i] = OMXCameraPortParameters::DONE;
  49.         }
  50.     }
  51.     从这里开始就要进行分类处理了，对应不同output port type有不同的处理方法
  52.     1.OMX_CAMERA_PORT_VIDEO_OUT_PREVIEW（对应preview过程）
  53.     if (pBuffHeader->nOutputPortIndex == OMX_CAMERA_PORT_VIDEO_OUT_PREVIEW)
  54.         {

  56.         if ( ( PREVIEW_ACTIVE & state ) != PREVIEW_ACTIVE )
  57.             {
  58.             return OMX_ErrorNone;
  59.             }
  60.         从这里开始我们暂时不做过多研究，只是对preview环境的一些初始化
  61.         if ( mWaitingForSnapshot ) {
  62.             extraData = getExtradata(pBuffHeader->pPlatformPrivate,
  63.                                      (OMX_EXTRADATATYPE) OMX_AncillaryData);

  65.             if ( NULL != extraData ) {
  66.                 ancillaryData = (OMX_TI_ANCILLARYDATATYPE*) extraData->data;
  67.                 if ((OMX_2D_Snap == ancillaryData->eCameraView)
  68.                     || (OMX_3D_Left_Snap == ancillaryData->eCameraView)
  69.                     || (OMX_3D_Right_Snap == ancillaryData->eCameraView)) {
  70.                     snapshotFrame = OMX_TRUE;
  71.                 } else {
  72.                     snapshotFrame = OMX_FALSE;
  73.                 }
  74.                 mPending3Asettings |= SetFocus;
  75.             }
  76.         }

  78.         ///Prepare the frames to be sent - initialize CameraFrame object and reference count
  79.         // TODO(XXX): ancillary data for snapshot frame is not being sent for video snapshot
  80.         // if we are waiting for a snapshot and in video mode...go ahead and send
  81.         // this frame as a snapshot
  82.         if( mWaitingForSnapshot && (mCapturedFrames > 0) &&
  83.             (snapshotFrame || (mCapMode == VIDEO_MODE)))
  84.             {
  85.             typeOfFrame = CameraFrame::SNAPSHOT_FRAME;
  86.             mask = (unsigned int)CameraFrame::SNAPSHOT_FRAME;

  88.             // video snapshot gets ancillary data and wb info from last snapshot frame
  89.             mCaptureAncillaryData = ancillaryData;
  90.             mWhiteBalanceData = NULL;
  91.             extraData = getExtradata(pBuffHeader->pPlatformPrivate,
  92.                                      (OMX_EXTRADATATYPE) OMX_WhiteBalance);
  93.             if ( NULL != extraData )
  94.                 {
  95.                 mWhiteBalanceData = (OMX_TI_WHITEBALANCERESULTTYPE*) extraData->data;
  96.                 }
  97.             }
  98.         else
  99.             {
  100.             typeOfFrame = CameraFrame::PREVIEW_FRAME_SYNC;
  101.             mask = (unsigned int)CameraFrame::PREVIEW_FRAME_SYNC;
  102.             }

  104.         if (mRecording)
  105.             {
  106.             mask |= (unsigned int)CameraFrame::VIDEO_FRAME_SYNC;
  107.             mFramesWithEncoder++;
  108.             }

  110.         //LOGV("FBD pBuffer = 0x%x", pBuffHeader->pBuffer);

  112.         if( mWaitingForSnapshot )
  113.           {
  114.             if (!mBracketingEnabled &&
  115.                  ((HIGH_SPEED == mCapMode) || (VIDEO_MODE == mCapMode)) )
  116.               {
  117.                 notifyShutterSubscribers();
  118.               }
  119.           }
  120.         这里这个sendCallBacks还是要好好研究一下的
  121.         stat = sendCallBacks(cameraFrame, pBuffHeader, mask, pPortParam);
  122.         mFramesWithDisplay++;

  124.         mFramesWithDucati--;
  125.         下面暂不做研究
  126. #ifdef CAMERAHAL_DEBUG
  127.         if(mBuffersWithDucati.indexOfKey((uint32_t)pBuffHeader->pBuffer)<0)
  128.             {
  129.             LOGE("Buffer was never with Ducati!! %p", pBuffHeader->pBuffer);
  130.             for(unsigned int i=0;i<mBuffersWithDucati.size();i++) LOGE("0x%x", mBuffersWithDucati.keyAt(i));
  131.             }
  132.         mBuffersWithDucati.removeItem((int)pBuffHeader->pBuffer);
  133. #endif

  135.         if(mDebugFcs)
  136.             CAMHAL_LOGEB("C[%d] D[%d] E[%d]", mFramesWithDucati, mFramesWithDisplay, mFramesWithEncoder);

  138.         recalculateFPS();

  140.         createPreviewMetadata(pBuffHeader, metadataResult, pPortParam->mWidth, pPortParam->mHeight);
  141.         if ( NULL != metadataResult.get() ) {
  142.             notifyMetadataSubscribers(metadataResult);
  143.             metadataResult.clear();
  144.         }

  146.         {
  147.             Mutex::Autolock lock(mFaceDetectionLock);
  148.             if ( mFDSwitchAlgoPriority ) {

  150.                  //Disable region priority and enable face priority for AF
  151.                  setAlgoPriority(REGION_PRIORITY, FOCUS_ALGO, false);
  152.                  setAlgoPriority(FACE_PRIORITY, FOCUS_ALGO , true);

  154.                  //Disable Region priority and enable Face priority
  155.                  setAlgoPriority(REGION_PRIORITY, EXPOSURE_ALGO, false);
  156.                  setAlgoPriority(FACE_PRIORITY, EXPOSURE_ALGO, true);
  157.                  mFDSwitchAlgoPriority = false;
  158.             }
  159.         }

  161.         sniffDccFileDataSave(pBuffHeader);

  163.         stat |= advanceZoom();

  165.         // On the fly update to 3A settings not working
  166.         // Do not update 3A here if we are in the middle of a capture
  167.         // or in the middle of transitioning to it
  168.         if( mPending3Asettings &&
  169.                 ( (nextState & CAPTURE_ACTIVE) == 0 ) &&
  170.                 ( (state & CAPTURE_ACTIVE) == 0 ) ) {
  171.             apply3Asettings(mParameters3A);
  172.         }

  174.         }
  175.     2.OMX_CAMERA_PORT_VIDEO_OUT_MEASUREMENT 
  176.     else if( pBuffHeader->nOutputPortIndex == OMX_CAMERA_PORT_VIDEO_OUT_MEASUREMENT )
  177.         {
  178.         typeOfFrame = CameraFrame::FRAME_DATA_SYNC;
  179.         mask = (unsigned int)CameraFrame::FRAME_DATA_SYNC;

  181.         stat = sendCallBacks(cameraFrame, pBuffHeader, mask, pPortParam);
  182.        }
  183.     3.OMX_CAMERA_PORT_IMAGE_OUT_IMAGE 
  184.     else if( pBuffHeader->nOutputPortIndex == OMX_CAMERA_PORT_IMAGE_OUT_IMAGE )
  185.     {
  186.         OMX_COLOR_FORMATTYPE pixFormat;
  187.         const char *valstr = NULL;

  189.         pixFormat = pPortParam->mColorFormat;

  191.         if ( OMX_COLOR_FormatUnused == pixFormat )
  192.             {
  193.             typeOfFrame = CameraFrame::IMAGE_FRAME;
  194.             mask = (unsigned int) CameraFrame::IMAGE_FRAME;
  195.         } else if ( pixFormat == OMX_COLOR_FormatCbYCrY &&
  196.                   ((mPictureFormatFromClient &&
  197.                           !strcmp(mPictureFormatFromClient,
  198.                                   CameraParameters::PIXEL_FORMAT_JPEG)) ||
  199.                    !mPictureFormatFromClient) ) {
  200.             // signals to callbacks that this needs to be coverted to jpeg
  201.             // before returning to framework
  202.             typeOfFrame = CameraFrame::IMAGE_FRAME;
  203.             mask = (unsigned int) CameraFrame::IMAGE_FRAME;
  204.             cameraFrame.mQuirks |= CameraFrame::ENCODE_RAW_YUV422I_TO_JPEG;
  205.             cameraFrame.mQuirks |= CameraFrame::FORMAT_YUV422I_UYVY;

  207.             // populate exif data and pass to subscribers via quirk
  208.             // subscriber is in charge of freeing exif data
  209.             ExifElementsTable* exif = new ExifElementsTable();
  210.             setupEXIF_libjpeg(exif, mCaptureAncillaryData, mWhiteBalanceData);
  211.             cameraFrame.mQuirks |= CameraFrame::HAS_EXIF_DATA;
  212.             cameraFrame.mCookie2 = (void*) exif;
  213.         } else {
  214.             typeOfFrame = CameraFrame::RAW_FRAME;
  215.             mask = (unsigned int) CameraFrame::RAW_FRAME;
  216.         }

  218.             pPortParam->mImageType = typeOfFrame;

  220.             if((mCapturedFrames>0) && !mCaptureSignalled)
  221.                 {
  222.                 mCaptureSignalled = true;
  223.                 mCaptureSem.Signal();
  224.                 }

  226.             if( ( CAPTURE_ACTIVE & state ) != CAPTURE_ACTIVE )
  227.                 {
  228.                 goto EXIT;
  229.                 }

  231.             {
  232.             Mutex::Autolock lock(mBracketingLock);
  233.             if ( mBracketingEnabled )
  234.                 {
  235.                 doBracketing(pBuffHeader, typeOfFrame);
  236.                 return eError;
  237.                 }
  238.             }

  240.             if (mZoomBracketingEnabled) {
  241.                 doZoom(mZoomBracketingValues[mCurrentZoomBracketing]);
  242.                 CAMHAL_LOGDB("Current Zoom Bracketing: %d", mZoomBracketingValues[mCurrentZoomBracketing]);
  243.                 mCurrentZoomBracketing++;
  244.                 if (mCurrentZoomBracketing == ARRAY_SIZE(mZoomBracketingValues)) {
  245.                     mZoomBracketingEnabled = false;
  246.                 }
  247.             }

  249.         if ( 1 > mCapturedFrames )
  250.             {
  251.             goto EXIT;
  252.             }

  254. #ifdef OMAP_ENHANCEMENT_CPCAM
  255.         setMetaData(cameraFrame.mMetaData, pBuffHeader->pPlatformPrivate);
  256. #endif

  258.         CAMHAL_LOGDB("Captured Frames: %d", mCapturedFrames);

  260.         mCapturedFrames--;

  262. #ifdef CAMERAHAL_USE_RAW_IMAGE_SAVING
  263.         if (mYuvCapture) {
  264.             struct timeval timeStampUsec;
  265.             gettimeofday(&timeStampUsec, NULL);

  267.             time_t saveTime;
  268.             time(&saveTime);
  269.             const struct tm * const timeStamp = gmtime(&saveTime);

  271.             char filename[256];
  272.             snprintf(filename,256, "%s/yuv_%d_%d_%d_%lu.yuv",
  273.                     kYuvImagesOutputDirPath,
  274.                     timeStamp->tm_hour,
  275.                     timeStamp->tm_min,
  276.                     timeStamp->tm_sec,
  277.                     timeStampUsec.tv_usec);

  279.             const status_t saveBufferStatus = saveBufferToFile(((CameraBuffer*)pBuffHeader->pAppPrivate)->mapped,
  280.                                                pBuffHeader->nFilledLen, filename);

  282.             if (saveBufferStatus != OK) {
  283.                 CAMHAL_LOGE("ERROR: %d, while saving yuv!", saveBufferStatus);
  284.             } else {
  285.                 CAMHAL_LOGD("yuv_%d_%d_%d_%lu.yuv successfully saved in %s",
  286.                         timeStamp->tm_hour,
  287.                         timeStamp->tm_min,
  288.                         timeStamp->tm_sec,
  289.                         timeStampUsec.tv_usec,
  290.                         kYuvImagesOutputDirPath);
  291.             }
  292.         }
  293. #endif

  295.         stat = sendCallBacks(cameraFrame, pBuffHeader, mask, pPortParam);
  296.         }
  297.         4.OMX_CAMERA_PORT_VIDEO_OUT_VIDEO
  298.         else if (pBuffHeader->nOutputPortIndex == OMX_CAMERA_PORT_VIDEO_OUT_VIDEO) {
  299.             typeOfFrame = CameraFrame::RAW_FRAME;
  300.             pPortParam->mImageType = typeOfFrame;
  301.             {
  302.                 Mutex::Autolock lock(mLock);
  303.                 if( ( CAPTURE_ACTIVE & state ) != CAPTURE_ACTIVE ) {
  304.                     goto EXIT;
  305.                 }
  306.             }

  308.             CAMHAL_LOGD("RAW buffer done on video port, length = %d", pBuffHeader->nFilledLen);

  310.             mask = (unsigned int) CameraFrame::RAW_FRAME;

  312. #ifdef CAMERAHAL_USE_RAW_IMAGE_SAVING
  313.             if ( mRawCapture ) {
  314.                 struct timeval timeStampUsec;
  315.                 gettimeofday(&timeStampUsec, NULL);

  317.                 time_t saveTime;
  318.                 time(&saveTime);
  319.                 const struct tm * const timeStamp = gmtime(&saveTime);

  321.                 char filename[256];
  322.                 snprintf(filename,256, "%s/raw_%d_%d_%d_%lu.raw",
  323.                          kRawImagesOutputDirPath,
  324.                          timeStamp->tm_hour,
  325.                          timeStamp->tm_min,
  326.                          timeStamp->tm_sec,
  327.                          timeStampUsec.tv_usec);

  329.                 const status_t saveBufferStatus = saveBufferToFile( ((CameraBuffer*)pBuffHeader->pAppPrivate)->mapped,
  330.                                                    pBuffHeader->nFilledLen, filename);

  332.                 if (saveBufferStatus != OK) {
  333.                     CAMHAL_LOGE("ERROR: %d , while saving raw!", saveBufferStatus);
  334.                 } else {
  335.                     CAMHAL_LOGD("raw_%d_%d_%d_%lu.raw successfully saved in %s",
  336.                                 timeStamp->tm_hour,
  337.                                 timeStamp->tm_min,
  338.                                 timeStamp->tm_sec,
  339.                                 timeStampUsec.tv_usec,
  340.                                 kRawImagesOutputDirPath);
  341.                     stat = sendCallBacks(cameraFrame, pBuffHeader, mask, pPortParam);
  342.                 }
  343.             }
  344. #endif
  345.         } else {
  346.             CAMHAL_LOGEA("Frame received for non-(preview/capture/measure) port. This is yet to be supported");
  347.             goto EXIT;
  348.         }
     这里在上面的操作完成之后都会进行下面的方法returnFrame，这个returnFrame同样要好好分析一下
  1.     if ( NO_ERROR != stat )
  2.         {
  3.         CameraBuffer *camera_buffer;

  5.         camera_buffer = (CameraBuffer *)pBuffHeader->pAppPrivate;

  7.         CAMHAL_LOGDB("sendFrameToSubscribers error: %d", stat);
  8.         returnFrame(camera_buffer, typeOfFrame);
  9.         }

  11.     return eError;

  13.     EXIT:

  15.     CAMHAL_LOGEB("Exiting function %s because of ret %d eError=%x", __FUNCTION__, stat, eError);

  17.     if ( NO_ERROR != stat )
  18.         {
  19.         if ( NULL != mErrorNotifier )
  20.             {
  21.             mErrorNotifier->errorNotify(CAMERA_ERROR_UNKNOWN);
  22.             }
  23.         }

  25.     return eError;
  26. }
首先看一下sendCallbacks方法的实现
  1. status_t OMXCameraAdapter::sendCallBacks(CameraFrame frame, OMX_IN OMX_BUFFERHEADERTYPE *pBuffHeader, unsigned int mask, OMXCameraPortParameters *port)
  2. {
  3.   status_t ret = NO_ERROR;

  5.   LOG_FUNCTION_NAME;

  7.   if ( NULL == port)
  8.     {
  9.       CAMHAL_LOGEA("Invalid portParam");
  10.       return -EINVAL;
  11.     }

  13.   if ( NULL == pBuffHeader )
  14.     {
  15.       CAMHAL_LOGEA("Invalid Buffer header");
  16.       return -EINVAL;
  17.     }

  19.   Mutex::Autolock lock(mSubscriberLock);
  20.   首先填充我们将要发送的camerabuffer
  21.   //frame.mFrameType = typeOfFrame;
  22.   frame.mFrameMask = mask;
  23.   frame.mBuffer = (CameraBuffer *)pBuffHeader->pAppPrivate;
  24.   frame.mLength = pBuffHeader->nFilledLen;
  25.   frame.mAlignment = port->mStride;
  26.   frame.mOffset = pBuffHeader->nOffset;
  27.   frame.mWidth = port->mWidth;
  28.   frame.mHeight = port->mHeight;
  29.   frame.mYuv[0] = NULL;
  30.   frame.mYuv[1] = NULL;

  32.   if ( onlyOnce && mRecording )
  33.     {
  34.       mTimeSourceDelta = (pBuffHeader->nTimeStamp * 1000) - systemTime(SYSTEM_TIME_MONOTONIC);
  35.       onlyOnce = false;
  36.     }

  38.   frame.mTimestamp = (pBuffHeader->nTimeStamp * 1000) - mTimeSourceDelta;

  40.   ret = setInitFrameRefCount(frame.mBuffer, mask);

  42.   if (ret != NO_ERROR) {
  43.      CAMHAL_LOGDB("Error in setInitFrameRefCount %d", ret);
  44.   } else {
  45.       ret = sendFrameToSubscribers(&frame);
  46.   }

  48.   CAMHAL_LOGVB("B 0x%x T %llu", frame.mBuffer, pBuffHeader->nTimeStamp);

  50.   LOG_FUNCTION_NAME_EXIT;

  52.   return ret;
  53. }
上面两个方法的实现也是很重点的部分，先看setInitFrameRefCount的实现
  1. int BaseCameraAdapter::setInitFrameRefCount(CameraBuffer * buf, unsigned int mask)
  2. {
  3.   int ret = NO_ERROR;
  4.   unsigned int lmask;

  6.   LOG_FUNCTION_NAME;

  8.   if (buf == NULL)
  9.     {
  10.       return -EINVAL;
  11.     }

  13.   for( lmask = 1; lmask < CameraFrame::ALL_FRAMES; lmask <<= 1){
  14.     if( lmask & mask ){
  15.       switch( lmask ){

  17.       case CameraFrame::IMAGE_FRAME:
  18.         {
  19.           把buffer添加到mImageSubscribers的最后的key上
  20.           setFrameRefCount(buf, CameraFrame::IMAGE_FRAME, (int) mImageSubscribers.size());
  21.         }
  22.         break;
  23.       case CameraFrame::RAW_FRAME:
  24.         {
  25.           setFrameRefCount(buf, CameraFrame::RAW_FRAME, mRawSubscribers.size());
  26.         }
  27.         break;
  28.       case CameraFrame::PREVIEW_FRAME_SYNC:
  29.         {
  30.           setFrameRefCount(buf, CameraFrame::PREVIEW_FRAME_SYNC, mFrameSubscribers.size());
  31.         }
  32.         break;
  33.       case CameraFrame::SNAPSHOT_FRAME:
  34.         {
  35.           setFrameRefCount(buf, CameraFrame::SNAPSHOT_FRAME, mSnapshotSubscribers.size());
  36.         }
  37.         break;
  38.       case CameraFrame::VIDEO_FRAME_SYNC:
  39.         {
  40.           setFrameRefCount(buf,CameraFrame::VIDEO_FRAME_SYNC, mVideoSubscribers.size());
  41.         }
  42.         break;
  43.       case CameraFrame::FRAME_DATA_SYNC:
  44.         {
  45.           setFrameRefCount(buf, CameraFrame::FRAME_DATA_SYNC, mFrameDataSubscribers.size());
  46.         }
  47.         break;
  48.       case CameraFrame::REPROCESS_INPUT_FRAME:
  49.         {
  50.           setFrameRefCount(buf,CameraFrame::REPROCESS_INPUT_FRAME, mVideoInSubscribers.size());
  51.         }
  52.         break;
  53.       default:
  54.         CAMHAL_LOGEB("FRAMETYPE NOT SUPPORTED 0x%x", lmask);
  55.         break;
  56.       }//SWITCH
  57.       mask &= ~lmask;
  58.     }//IF
  59.   }//FOR
  60.   LOG_FUNCTION_NAME_EXIT;
  61.   return ret;
  62. }
  1. void BaseCameraAdapter::setFrameRefCount(CameraBuffer * frameBuf, CameraFrame::FrameType frameType, int refCount)
  2. {

  4.     LOG_FUNCTION_NAME;

  6.     switch ( frameType )
  7.         {
  8.         case CameraFrame::IMAGE_FRAME:
  9.         case CameraFrame::RAW_FRAME:
  10.                 {
  11.                 Mutex::Autolock lock(mCaptureBufferLock);
  12.                 mCaptureBuffersAvailable.replaceValueFor(frameBuf, refCount);
  13.                 }
  14.             break;
  15.         case CameraFrame::SNAPSHOT_FRAME:
  16.                 {
  17.                 Mutex::Autolock lock(mSnapshotBufferLock);
  18.                 mSnapshotBuffersAvailable.replaceValueFor( ( unsigned int ) frameBuf, refCount);
  19.                 }
  20.             break;
  21.         case CameraFrame::PREVIEW_FRAME_SYNC:
  22.                 {
  23.                 Mutex::Autolock lock(mPreviewBufferLock);
  24.                 更新framebuf在mPreviewBuffersAviailable中的key
  25.                 mPreviewBuffersAvailable.replaceValueFor(frameBuf, refCount);
  26.                 }
  27.             break;
  28.         case CameraFrame::FRAME_DATA_SYNC:
  29.                 {
  30.                 Mutex::Autolock lock(mPreviewDataBufferLock);
  31.                 mPreviewDataBuffersAvailable.replaceValueFor(frameBuf, refCount);
  32.                 }
  33.             break;
  34.         case CameraFrame::VIDEO_FRAME_SYNC:
  35.                 {
  36.                 Mutex::Autolock lock(mVideoBufferLock);
  37.                 mVideoBuffersAvailable.replaceValueFor(frameBuf, refCount);
  38.                 }
  39.             break;
  40.         case CameraFrame::REPROCESS_INPUT_FRAME: {
  41.             Mutex::Autolock lock(mVideoInBufferLock);
  42.             mVideoInBuffersAvailable.replaceValueFor(frameBuf, refCount);
  43.         }
  44.             break;
  45.         default:
  46.             break;
  47.         };

  49.     LOG_FUNCTION_NAME_EXIT;

  51. }
然后我们再看看sendFrameToSubscribers这个很重要的方法，最终调用以下方法
  1. status_t BaseCameraAdapter::__sendFrameToSubscribers(CameraFrame* frame,
  2.                                                      KeyedVector<int, frame_callback> *subscribers,
  3.                                                      CameraFrame::FrameType frameType)
  4. {
  5.     size_t refCount = 0;
  6.     status_t ret = NO_ERROR;
  7.     frame_callback callback = NULL;

  9.     frame->mFrameType = frameType;

  11.     if ( (frameType == CameraFrame::PREVIEW_FRAME_SYNC) ||
  12.          (frameType == CameraFrame::VIDEO_FRAME_SYNC) ||
  13.          (frameType == CameraFrame::SNAPSHOT_FRAME) ){
  14.         if (mFrameQueue.size() > 0){
  15.           CameraFrame *lframe = (CameraFrame *)mFrameQueue.valueFor(frame->mBuffer);
  16.           frame->mYuv[0] = lframe->mYuv[0];
  17.           frame->mYuv[1] = frame->mYuv[0] + (frame->mLength + frame->mOffset)*2/3;
  18.         }
  19.         else{
  20.           CAMHAL_LOGDA("Empty Frame Queue");
  21.           return -EINVAL;
  22.         }
  23.       }

  25.     if (NULL != subscribers) {
  26.         refCount = getFrameRefCount(frame->mBuffer, frameType);

  28.         if (refCount == 0) {
  29.             CAMHAL_LOGDA("Invalid ref count of 0");
  30.             return -EINVAL;
  31.         }

  33.         if (refCount > subscribers->size()) {
  34.             CAMHAL_LOGEB("Invalid ref count for frame type: 0x%x", frameType);
  35.             return -EINVAL;
  36.         }

  38.         CAMHAL_LOGVB("Type of Frame: 0x%x address: 0x%x refCount start %d",
  39.                      frame->mFrameType,
  40.                      ( uint32_t ) frame->mBuffer,
  41.                      refCount);

  43.         for ( unsigned int i = 0 ; i < refCount; i++ ) {
  44.             frame->mCookie = ( void * ) subscribers->keyAt(i);
  45.             callback = (frame_callback) subscribers->valueAt(i);

  47.             if (!callback) {
  48.                 CAMHAL_LOGEB("callback not set for frame type: 0x%x", frameType);
  49.                 return -EINVAL;
  50.             }

  52.             callback(frame);
  53.         }
  54.     } else {
  55.         CAMHAL_LOGEA("Subscribers is null??");
  56.         return -EINVAL;
  57.     }

  59.     return ret;
  60. }
通过获得callback最终实现数据网上层回调
待续。。。。。
阅读(6147) | 评论(0) | 转发(4) |
1

上一篇：Android Camera OMX方式Preview完整过程分析

下一篇：文件安全与权限

给主人留下些什么吧！~~
关于我们 | 关于IT168 | 联系方式 | 广告合作 | 法律声明 | 免费注册

Copyright 2001-2010 ChinaUnix.net All Rights Reserved 北京皓辰网域网络信息技术有限公司. 版权所有

感谢所有关心和支持过ChinaUnix的朋友们

16024965号-6