BDB JE how to deletes reserved log files manually










0















we use bdb je in replicated environments with 10 billion records per day ,and met some problem about reclaim log files and delete reserved log files.



As descipted in Getting Started with High Availability Applications :



"For replicated environments, JE hangs on to log files as long as possible in case they are needed to bring a replica up to date. Log files that have been cleaned but then saved due because of replication are in a reserved state. All such files are retained until the disk usage thresholds as defined by EnvironmentConfig.MAX_DISK and EnvironmentConfig.FREE_DISK are exceeded. At that point, JE deletes reserved log files."



In out project , write operations are increasing quickly sometimes. And if the disk usage thresholds are approaching , the replicated environment throws DiskLimitException and write operations are prohibited because of the speed of delete file cannot match the speed of write data . So I'm really want to know if there is a way to delete reserved files manually instead of dependent on the the disk usage thresholds .



we use je.properties to config out HA environment and content is like :



 je.log.fileMax=1073741824
je.lock.timeout=3000000
je.sharedCache=true
je.maxMemoryPercent=50
je.rep.txnRollbackLimit=1000
je.rep.replicaReceiveBufferSize=4194304
je.rep.feederBatchNs=10000000
je.rep.feederBatchBuffKb=256
je.rep.commitToNetwork=false
je.rep.replicaMessageQueueSize=10000
je.rep.insufficientReplicasTimeout=5000 ms
je.rep.replicaAckTimeout=10000 ms
je.cleaner.minUtilization=50
je.rep.replayFreeDiskPercent=50
je.env.runCleaner=false
je.rep.designatedPrimary=false
je.env.backgroundReadLimit=20
je.cleaner.readSize=33554432
je.cleaner.detailMaxMemoryPercentage=5
je.cleaner.lookAheadCacheSize=32768


In our project , we use ReplicatedEnvironment.cleanLogFile() telling je to clean file , and use ReplicatedEnvironment.removeDatabase(null, "persist#" + storeName + "#com.sleepycat.persist.formats") to declare one EntityStore can be cleaned.



Any advise will be appreciated.










share|improve this question


























    0















    we use bdb je in replicated environments with 10 billion records per day ,and met some problem about reclaim log files and delete reserved log files.



    As descipted in Getting Started with High Availability Applications :



    "For replicated environments, JE hangs on to log files as long as possible in case they are needed to bring a replica up to date. Log files that have been cleaned but then saved due because of replication are in a reserved state. All such files are retained until the disk usage thresholds as defined by EnvironmentConfig.MAX_DISK and EnvironmentConfig.FREE_DISK are exceeded. At that point, JE deletes reserved log files."



    In out project , write operations are increasing quickly sometimes. And if the disk usage thresholds are approaching , the replicated environment throws DiskLimitException and write operations are prohibited because of the speed of delete file cannot match the speed of write data . So I'm really want to know if there is a way to delete reserved files manually instead of dependent on the the disk usage thresholds .



    we use je.properties to config out HA environment and content is like :



     je.log.fileMax=1073741824
    je.lock.timeout=3000000
    je.sharedCache=true
    je.maxMemoryPercent=50
    je.rep.txnRollbackLimit=1000
    je.rep.replicaReceiveBufferSize=4194304
    je.rep.feederBatchNs=10000000
    je.rep.feederBatchBuffKb=256
    je.rep.commitToNetwork=false
    je.rep.replicaMessageQueueSize=10000
    je.rep.insufficientReplicasTimeout=5000 ms
    je.rep.replicaAckTimeout=10000 ms
    je.cleaner.minUtilization=50
    je.rep.replayFreeDiskPercent=50
    je.env.runCleaner=false
    je.rep.designatedPrimary=false
    je.env.backgroundReadLimit=20
    je.cleaner.readSize=33554432
    je.cleaner.detailMaxMemoryPercentage=5
    je.cleaner.lookAheadCacheSize=32768


    In our project , we use ReplicatedEnvironment.cleanLogFile() telling je to clean file , and use ReplicatedEnvironment.removeDatabase(null, "persist#" + storeName + "#com.sleepycat.persist.formats") to declare one EntityStore can be cleaned.



    Any advise will be appreciated.










    share|improve this question
























      0












      0








      0








      we use bdb je in replicated environments with 10 billion records per day ,and met some problem about reclaim log files and delete reserved log files.



      As descipted in Getting Started with High Availability Applications :



      "For replicated environments, JE hangs on to log files as long as possible in case they are needed to bring a replica up to date. Log files that have been cleaned but then saved due because of replication are in a reserved state. All such files are retained until the disk usage thresholds as defined by EnvironmentConfig.MAX_DISK and EnvironmentConfig.FREE_DISK are exceeded. At that point, JE deletes reserved log files."



      In out project , write operations are increasing quickly sometimes. And if the disk usage thresholds are approaching , the replicated environment throws DiskLimitException and write operations are prohibited because of the speed of delete file cannot match the speed of write data . So I'm really want to know if there is a way to delete reserved files manually instead of dependent on the the disk usage thresholds .



      we use je.properties to config out HA environment and content is like :



       je.log.fileMax=1073741824
      je.lock.timeout=3000000
      je.sharedCache=true
      je.maxMemoryPercent=50
      je.rep.txnRollbackLimit=1000
      je.rep.replicaReceiveBufferSize=4194304
      je.rep.feederBatchNs=10000000
      je.rep.feederBatchBuffKb=256
      je.rep.commitToNetwork=false
      je.rep.replicaMessageQueueSize=10000
      je.rep.insufficientReplicasTimeout=5000 ms
      je.rep.replicaAckTimeout=10000 ms
      je.cleaner.minUtilization=50
      je.rep.replayFreeDiskPercent=50
      je.env.runCleaner=false
      je.rep.designatedPrimary=false
      je.env.backgroundReadLimit=20
      je.cleaner.readSize=33554432
      je.cleaner.detailMaxMemoryPercentage=5
      je.cleaner.lookAheadCacheSize=32768


      In our project , we use ReplicatedEnvironment.cleanLogFile() telling je to clean file , and use ReplicatedEnvironment.removeDatabase(null, "persist#" + storeName + "#com.sleepycat.persist.formats") to declare one EntityStore can be cleaned.



      Any advise will be appreciated.










      share|improve this question














      we use bdb je in replicated environments with 10 billion records per day ,and met some problem about reclaim log files and delete reserved log files.



      As descipted in Getting Started with High Availability Applications :



      "For replicated environments, JE hangs on to log files as long as possible in case they are needed to bring a replica up to date. Log files that have been cleaned but then saved due because of replication are in a reserved state. All such files are retained until the disk usage thresholds as defined by EnvironmentConfig.MAX_DISK and EnvironmentConfig.FREE_DISK are exceeded. At that point, JE deletes reserved log files."



      In out project , write operations are increasing quickly sometimes. And if the disk usage thresholds are approaching , the replicated environment throws DiskLimitException and write operations are prohibited because of the speed of delete file cannot match the speed of write data . So I'm really want to know if there is a way to delete reserved files manually instead of dependent on the the disk usage thresholds .



      we use je.properties to config out HA environment and content is like :



       je.log.fileMax=1073741824
      je.lock.timeout=3000000
      je.sharedCache=true
      je.maxMemoryPercent=50
      je.rep.txnRollbackLimit=1000
      je.rep.replicaReceiveBufferSize=4194304
      je.rep.feederBatchNs=10000000
      je.rep.feederBatchBuffKb=256
      je.rep.commitToNetwork=false
      je.rep.replicaMessageQueueSize=10000
      je.rep.insufficientReplicasTimeout=5000 ms
      je.rep.replicaAckTimeout=10000 ms
      je.cleaner.minUtilization=50
      je.rep.replayFreeDiskPercent=50
      je.env.runCleaner=false
      je.rep.designatedPrimary=false
      je.env.backgroundReadLimit=20
      je.cleaner.readSize=33554432
      je.cleaner.detailMaxMemoryPercentage=5
      je.cleaner.lookAheadCacheSize=32768


      In our project , we use ReplicatedEnvironment.cleanLogFile() telling je to clean file , and use ReplicatedEnvironment.removeDatabase(null, "persist#" + storeName + "#com.sleepycat.persist.formats") to declare one EntityStore can be cleaned.



      Any advise will be appreciated.







      berkeley-db-je






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Nov 14 '18 at 14:02









      张大伟张大伟

      11




      11






















          0






          active

          oldest

          votes











          Your Answer






          StackExchange.ifUsing("editor", function ()
          StackExchange.using("externalEditor", function ()
          StackExchange.using("snippets", function ()
          StackExchange.snippets.init();
          );
          );
          , "code-snippets");

          StackExchange.ready(function()
          var channelOptions =
          tags: "".split(" "),
          id: "1"
          ;
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function()
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled)
          StackExchange.using("snippets", function()
          createEditor();
          );

          else
          createEditor();

          );

          function createEditor()
          StackExchange.prepareEditor(
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader:
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          ,
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          );



          );













          draft saved

          draft discarded


















          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53302028%2fbdb-je-how-to-deletes-reserved-log-files-manually%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes















          draft saved

          draft discarded
















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid


          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.

          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function ()
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53302028%2fbdb-je-how-to-deletes-reserved-log-files-manually%23new-answer', 'question_page');

          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          這個網誌中的熱門文章

          How to read a connectionString WITH PROVIDER in .NET Core?

          Node.js Script on GitHub Pages or Amazon S3

          Museum of Modern and Contemporary Art of Trento and Rovereto