Frequency of frames coming to ImageReader.OnImageAvailableListener










0















I'm integrating the Camera2 API to my Android app and test it on Samsung Galaxy Tab S2. I need to work with real time preview frames.
Here is my code:



private val onPreviewAvailableListener = ImageReader.OnImageAvailableListener reader ->
if (reader != null)
val image = reader.acquireNextImage()
if (image != null)
// do something with image
image.close()




private var mPreviewRequestBuilder: CaptureRequest.Builder? = null
private lateinit var mPreviewSize: Size

private fun configurePreview()
// some code here
// ...

previewImageReader = ImageReader.newInstance(
mPreviewSize.width,
mPreviewSize.height,
ImageFormat.YUV_420_888,
2
)
previewImageReader?.setOnImageAvailableListener(onPreviewAvailableListener, backgroundHandler)

// some code here
// ...


// other code

private fun createCameraPreviewSession()
mPreviewRequestBuilder = mCameraDevice?.createCaptureRequest(CameraDevice.TEMPLATE_PREVIEW)
mPreviewRequestBuilder?.addTarget(previewImageReader?.surface)
mPreviewRequestBuilder?.addTarget(surface) // surfaceView

mCameraDevice?.createCaptureSession(
Arrays.asList(previewImageReader?.surface, surface),
object : CameraCaptureSession.StateCallback() ,
null /* null handler */



I need images in onPreviewAvailableListener to be of a high resolution. And they are. The resolution is not too high. Something about 1280*720. The problem is that my preview TextureView lags as if 15 FPS was set.



Maybe I can decrease the frequency of images coming to onPreviewAvailableListener. I tried setting a flag to only handle every 10-th o 20-th image in onPreviewAvailableListener's onImageAvailable, but nothing changed:



private val onPreviewAvailableListener = object: ImageReader.OnImageAvailableListener 

private var counter = 10

fun onImageAvailable(reader : ImageReader)
if (counter % 10 == 0)
if (reader != null)
val image = reader.acquireNextImage()
if (image != null)
// do something with image
image.close()



if (counter == Int.MAX_VALUE)
counter = 0
else
counter++





I also tried creating a new background thread specially for onPreviewAvailableListener so that its callback method is called on that thread. Nothing changed either:



previewImageReader?.setOnImageAvailableListener(onPreviewAvailableListener, previewImageReaderHandler) /* it's NOT backgroundHandler */









share|improve this question


























    0















    I'm integrating the Camera2 API to my Android app and test it on Samsung Galaxy Tab S2. I need to work with real time preview frames.
    Here is my code:



    private val onPreviewAvailableListener = ImageReader.OnImageAvailableListener reader ->
    if (reader != null)
    val image = reader.acquireNextImage()
    if (image != null)
    // do something with image
    image.close()




    private var mPreviewRequestBuilder: CaptureRequest.Builder? = null
    private lateinit var mPreviewSize: Size

    private fun configurePreview()
    // some code here
    // ...

    previewImageReader = ImageReader.newInstance(
    mPreviewSize.width,
    mPreviewSize.height,
    ImageFormat.YUV_420_888,
    2
    )
    previewImageReader?.setOnImageAvailableListener(onPreviewAvailableListener, backgroundHandler)

    // some code here
    // ...


    // other code

    private fun createCameraPreviewSession()
    mPreviewRequestBuilder = mCameraDevice?.createCaptureRequest(CameraDevice.TEMPLATE_PREVIEW)
    mPreviewRequestBuilder?.addTarget(previewImageReader?.surface)
    mPreviewRequestBuilder?.addTarget(surface) // surfaceView

    mCameraDevice?.createCaptureSession(
    Arrays.asList(previewImageReader?.surface, surface),
    object : CameraCaptureSession.StateCallback() ,
    null /* null handler */



    I need images in onPreviewAvailableListener to be of a high resolution. And they are. The resolution is not too high. Something about 1280*720. The problem is that my preview TextureView lags as if 15 FPS was set.



    Maybe I can decrease the frequency of images coming to onPreviewAvailableListener. I tried setting a flag to only handle every 10-th o 20-th image in onPreviewAvailableListener's onImageAvailable, but nothing changed:



    private val onPreviewAvailableListener = object: ImageReader.OnImageAvailableListener 

    private var counter = 10

    fun onImageAvailable(reader : ImageReader)
    if (counter % 10 == 0)
    if (reader != null)
    val image = reader.acquireNextImage()
    if (image != null)
    // do something with image
    image.close()



    if (counter == Int.MAX_VALUE)
    counter = 0
    else
    counter++





    I also tried creating a new background thread specially for onPreviewAvailableListener so that its callback method is called on that thread. Nothing changed either:



    previewImageReader?.setOnImageAvailableListener(onPreviewAvailableListener, previewImageReaderHandler) /* it's NOT backgroundHandler */









    share|improve this question
























      0












      0








      0








      I'm integrating the Camera2 API to my Android app and test it on Samsung Galaxy Tab S2. I need to work with real time preview frames.
      Here is my code:



      private val onPreviewAvailableListener = ImageReader.OnImageAvailableListener reader ->
      if (reader != null)
      val image = reader.acquireNextImage()
      if (image != null)
      // do something with image
      image.close()




      private var mPreviewRequestBuilder: CaptureRequest.Builder? = null
      private lateinit var mPreviewSize: Size

      private fun configurePreview()
      // some code here
      // ...

      previewImageReader = ImageReader.newInstance(
      mPreviewSize.width,
      mPreviewSize.height,
      ImageFormat.YUV_420_888,
      2
      )
      previewImageReader?.setOnImageAvailableListener(onPreviewAvailableListener, backgroundHandler)

      // some code here
      // ...


      // other code

      private fun createCameraPreviewSession()
      mPreviewRequestBuilder = mCameraDevice?.createCaptureRequest(CameraDevice.TEMPLATE_PREVIEW)
      mPreviewRequestBuilder?.addTarget(previewImageReader?.surface)
      mPreviewRequestBuilder?.addTarget(surface) // surfaceView

      mCameraDevice?.createCaptureSession(
      Arrays.asList(previewImageReader?.surface, surface),
      object : CameraCaptureSession.StateCallback() ,
      null /* null handler */



      I need images in onPreviewAvailableListener to be of a high resolution. And they are. The resolution is not too high. Something about 1280*720. The problem is that my preview TextureView lags as if 15 FPS was set.



      Maybe I can decrease the frequency of images coming to onPreviewAvailableListener. I tried setting a flag to only handle every 10-th o 20-th image in onPreviewAvailableListener's onImageAvailable, but nothing changed:



      private val onPreviewAvailableListener = object: ImageReader.OnImageAvailableListener 

      private var counter = 10

      fun onImageAvailable(reader : ImageReader)
      if (counter % 10 == 0)
      if (reader != null)
      val image = reader.acquireNextImage()
      if (image != null)
      // do something with image
      image.close()



      if (counter == Int.MAX_VALUE)
      counter = 0
      else
      counter++





      I also tried creating a new background thread specially for onPreviewAvailableListener so that its callback method is called on that thread. Nothing changed either:



      previewImageReader?.setOnImageAvailableListener(onPreviewAvailableListener, previewImageReaderHandler) /* it's NOT backgroundHandler */









      share|improve this question














      I'm integrating the Camera2 API to my Android app and test it on Samsung Galaxy Tab S2. I need to work with real time preview frames.
      Here is my code:



      private val onPreviewAvailableListener = ImageReader.OnImageAvailableListener reader ->
      if (reader != null)
      val image = reader.acquireNextImage()
      if (image != null)
      // do something with image
      image.close()




      private var mPreviewRequestBuilder: CaptureRequest.Builder? = null
      private lateinit var mPreviewSize: Size

      private fun configurePreview()
      // some code here
      // ...

      previewImageReader = ImageReader.newInstance(
      mPreviewSize.width,
      mPreviewSize.height,
      ImageFormat.YUV_420_888,
      2
      )
      previewImageReader?.setOnImageAvailableListener(onPreviewAvailableListener, backgroundHandler)

      // some code here
      // ...


      // other code

      private fun createCameraPreviewSession()
      mPreviewRequestBuilder = mCameraDevice?.createCaptureRequest(CameraDevice.TEMPLATE_PREVIEW)
      mPreviewRequestBuilder?.addTarget(previewImageReader?.surface)
      mPreviewRequestBuilder?.addTarget(surface) // surfaceView

      mCameraDevice?.createCaptureSession(
      Arrays.asList(previewImageReader?.surface, surface),
      object : CameraCaptureSession.StateCallback() ,
      null /* null handler */



      I need images in onPreviewAvailableListener to be of a high resolution. And they are. The resolution is not too high. Something about 1280*720. The problem is that my preview TextureView lags as if 15 FPS was set.



      Maybe I can decrease the frequency of images coming to onPreviewAvailableListener. I tried setting a flag to only handle every 10-th o 20-th image in onPreviewAvailableListener's onImageAvailable, but nothing changed:



      private val onPreviewAvailableListener = object: ImageReader.OnImageAvailableListener 

      private var counter = 10

      fun onImageAvailable(reader : ImageReader)
      if (counter % 10 == 0)
      if (reader != null)
      val image = reader.acquireNextImage()
      if (image != null)
      // do something with image
      image.close()



      if (counter == Int.MAX_VALUE)
      counter = 0
      else
      counter++





      I also tried creating a new background thread specially for onPreviewAvailableListener so that its callback method is called on that thread. Nothing changed either:



      previewImageReader?.setOnImageAvailableListener(onPreviewAvailableListener, previewImageReaderHandler) /* it's NOT backgroundHandler */






      android lag android-camera2






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Nov 14 '18 at 15:03









      Maksim DmitrievMaksim Dmitriev

      2,11084496




      2,11084496






















          0






          active

          oldest

          votes











          Your Answer






          StackExchange.ifUsing("editor", function ()
          StackExchange.using("externalEditor", function ()
          StackExchange.using("snippets", function ()
          StackExchange.snippets.init();
          );
          );
          , "code-snippets");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "1"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53303182%2ffrequency-of-frames-coming-to-imagereader-onimageavailablelistener%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53303182%2ffrequency-of-frames-coming-to-imagereader-onimageavailablelistener%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          這個網誌中的熱門文章

          How to read a connectionString WITH PROVIDER in .NET Core?

          Node.js Script on GitHub Pages or Amazon S3

          Museum of Modern and Contemporary Art of Trento and Rovereto