Uploaded image for project: 'Opencast'
  1. MH-10712

Workflow cleanup out of memory error

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed and reviewed
    • Affects versions: 1.6.1
    • Fix versions: 2.0.0
    • Components: Backend Software
    • Labels:
      None
    • Severity:
      Performance
    • Steps to reproduce:
      Hide
      One example:

       2015-03-02 13:43:56 ERROR [DefaultQuartzScheduler_Worker-3] (JobRunShell:225) - Job mh-workflow-find-missed-captures-job-group.mh-workflow-find-missed-captures-job threw an unhandled Exception:java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:2271) at java.io.ByteArrayOutputStream.toByteArray(ByteArrayOutputStream.java:191) at org.apache.solr.request.BinaryResponseWriter.getParsedResponse(BinaryResponseWriter.java:187) at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.getParsedResponse(EmbeddedSolrServer.java:170) at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:145) at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:89) at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:118) at org.opencastproject.workflow.impl.WorkflowServiceSolrIndex.getWorkflowInstances(WorkflowServiceSolrIndex.java:1020) at org.opencastproject.workflow.impl.WorkflowServiceImpl.getWorkflowInstances(WorkflowServiceImpl.java:1366) at org.opencastproject.workflow.impl.WorkflowServiceImpl.getAllWorkflowInstances(WorkflowServiceImpl.java:2287) at org.opencastproject.workflow.impl.WorkflowServiceImpl.failJobs(WorkflowServiceImpl.java:2317) at org.opencastproject.workflow.impl.WorkflowServiceImpl.moveMissingCapturesFromUpcomingToFailedStatus(WorkflowServiceImpl.java:2453) at org.opencastproject.workflow.impl.MissedCaptureScanner.scan(MissedCaptureScanner.java:80) at org.opencastproject.workflow.impl.MissedCaptureScanner$Runner$1.run(MissedCaptureScanner.java:109) at org.opencastproject.util.data.Effect0.apply(Effect0.java:29) at org.opencastproject.util.data.Effect0.apply(Effect0.java:26) at org.opencastproject.security.util.SecurityContext.runInContext(SecurityContext.java:51) at org.opencastproject.workflow.impl.MissedCaptureScanner$Runner.execute(MissedCaptureScanner.java:106) at org.opencastproject.workflow.impl.MissedCaptureScanner$Runner.execute(MissedCaptureScanner.java:92) at org.opencastproject.kernel.scanner.AbstractScanner$TypedQuartzJob$1.xapply(AbstractScanner.java:307) at org.opencastproject.kernel.scanner.AbstractScanner$TypedQuartzJob$1.xapply(AbstractScanner.java:303) at org.opencastproject.util.data.Function0$X.apply(Function0.java:52) at org.opencastproject.util.NeedleEye.apply(NeedleEye.java:40) at org.opencastproject.kernel.scanner.AbstractScanner$TypedQuartzJob.execute(AbstractScanner.java:293) at org.quartz.core.JobRunShell.run(JobRunShell.java:216) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)2015-03-02 13:43:56 ERROR [DefaultQuartzScheduler_Worker-3] (ErrorLogger:2339) - Job (mh-workflow-find-missed-captures-job-group.mh-workflow-find-missed-captures-job threw an exception.org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: java.lang.OutOfMemoryError: Java heap space] at org.quartz.core.JobRunShell.run(JobRunShell.java:227) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)Caused by: java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:2271) at java.io.ByteArrayOutputStream.toByteArray(ByteArrayOutputStream.java:191) at org.apache.solr.request.BinaryResponseWriter.getParsedResponse(BinaryResponseWriter.java:187) at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.getParsedResponse(EmbeddedSolrServer.java:170) at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:145) at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:89) at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:118) at org.opencastproject.workflow.impl.WorkflowServiceSolrIndex.getWorkflowInstances(WorkflowServiceSolrIndex.java:1020) at org.opencastproject.workflow.impl.WorkflowServiceImpl.getWorkflowInstances(WorkflowServiceImpl.java:1366) at org.opencastproject.workflow.impl.WorkflowServiceImpl.getAllWorkflowInstances(WorkflowServiceImpl.java:2287) at org.opencastproject.workflow.impl.WorkflowServiceImpl.failJobs(WorkflowServiceImpl.java:2317) at org.opencastproject.workflow.impl.WorkflowServiceImpl.moveMissingCapturesFromUpcomingToFailedStatus(WorkflowServiceImpl.java:2453) at org.opencastproject.workflow.impl.MissedCaptureScanner.scan(MissedCaptureScanner.java:80) at org.opencastproject.workflow.impl.MissedCaptureScanner$Runner$1.run(MissedCaptureScanner.java:109) at org.opencastproject.util.data.Effect0.apply(Effect0.java:29) at org.opencastproject.util.data.Effect0.apply(Effect0.java:26) at org.opencastproject.security.util.SecurityContext.runInContext(SecurityContext.java:51) at org.opencastproject.workflow.impl.MissedCaptureScanner$Runner.execute(MissedCaptureScanner.java:106) at org.opencastproject.workflow.impl.MissedCaptureScanner$Runner.execute(MissedCaptureScanner.java:92) at org.opencastproject.kernel.scanner.AbstractScanner$TypedQuartzJob$1.xapply(AbstractScanner.java:307) at org.opencastproject.kernel.scanner.AbstractScanner$TypedQuartzJob$1.xapply(AbstractScanner.java:303) at org.opencastproject.util.data.Function0$X.apply(Function0.java:52) at org.opencastproject.util.NeedleEye.apply(NeedleEye.java:40) at org.opencastproject.kernel.scanner.AbstractScanner$TypedQuartzJob.execute(AbstractScanner.java:293) at org.quartz.core.JobRunShell.run(JobRunShell.java:216) ... 1 more
      Show
      One example:  2015-03-02 13:43:56 ERROR [DefaultQuartzScheduler_Worker-3] (JobRunShell:225) - Job mh-workflow-find-missed-captures-job-group.mh-workflow-find-missed-captures-job threw an unhandled Exception:java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:2271) at java.io.ByteArrayOutputStream.toByteArray(ByteArrayOutputStream.java:191) at org.apache.solr.request.BinaryResponseWriter.getParsedResponse(BinaryResponseWriter.java:187) at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.getParsedResponse(EmbeddedSolrServer.java:170) at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:145) at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:89) at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:118) at org.opencastproject.workflow.impl.WorkflowServiceSolrIndex.getWorkflowInstances(WorkflowServiceSolrIndex.java:1020) at org.opencastproject.workflow.impl.WorkflowServiceImpl.getWorkflowInstances(WorkflowServiceImpl.java:1366) at org.opencastproject.workflow.impl.WorkflowServiceImpl.getAllWorkflowInstances(WorkflowServiceImpl.java:2287) at org.opencastproject.workflow.impl.WorkflowServiceImpl.failJobs(WorkflowServiceImpl.java:2317) at org.opencastproject.workflow.impl.WorkflowServiceImpl.moveMissingCapturesFromUpcomingToFailedStatus(WorkflowServiceImpl.java:2453) at org.opencastproject.workflow.impl.MissedCaptureScanner.scan(MissedCaptureScanner.java:80) at org.opencastproject.workflow.impl.MissedCaptureScanner$Runner$1.run(MissedCaptureScanner.java:109) at org.opencastproject.util.data.Effect0.apply(Effect0.java:29) at org.opencastproject.util.data.Effect0.apply(Effect0.java:26) at org.opencastproject.security.util.SecurityContext.runInContext(SecurityContext.java:51) at org.opencastproject.workflow.impl.MissedCaptureScanner$Runner.execute(MissedCaptureScanner.java:106) at org.opencastproject.workflow.impl.MissedCaptureScanner$Runner.execute(MissedCaptureScanner.java:92) at org.opencastproject.kernel.scanner.AbstractScanner$TypedQuartzJob$1.xapply(AbstractScanner.java:307) at org.opencastproject.kernel.scanner.AbstractScanner$TypedQuartzJob$1.xapply(AbstractScanner.java:303) at org.opencastproject.util.data.Function0$X.apply(Function0.java:52) at org.opencastproject.util.NeedleEye.apply(NeedleEye.java:40) at org.opencastproject.kernel.scanner.AbstractScanner$TypedQuartzJob.execute(AbstractScanner.java:293) at org.quartz.core.JobRunShell.run(JobRunShell.java:216) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)2015-03-02 13:43:56 ERROR [DefaultQuartzScheduler_Worker-3] (ErrorLogger:2339) - Job (mh-workflow-find-missed-captures-job-group.mh-workflow-find-missed-captures-job threw an exception.org.quartz.SchedulerException: Job threw an unhandled exception. [See nested exception: java.lang.OutOfMemoryError: Java heap space] at org.quartz.core.JobRunShell.run(JobRunShell.java:227) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:549)Caused by: java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:2271) at java.io.ByteArrayOutputStream.toByteArray(ByteArrayOutputStream.java:191) at org.apache.solr.request.BinaryResponseWriter.getParsedResponse(BinaryResponseWriter.java:187) at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.getParsedResponse(EmbeddedSolrServer.java:170) at org.apache.solr.client.solrj.embedded.EmbeddedSolrServer.request(EmbeddedSolrServer.java:145) at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:89) at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:118) at org.opencastproject.workflow.impl.WorkflowServiceSolrIndex.getWorkflowInstances(WorkflowServiceSolrIndex.java:1020) at org.opencastproject.workflow.impl.WorkflowServiceImpl.getWorkflowInstances(WorkflowServiceImpl.java:1366) at org.opencastproject.workflow.impl.WorkflowServiceImpl.getAllWorkflowInstances(WorkflowServiceImpl.java:2287) at org.opencastproject.workflow.impl.WorkflowServiceImpl.failJobs(WorkflowServiceImpl.java:2317) at org.opencastproject.workflow.impl.WorkflowServiceImpl.moveMissingCapturesFromUpcomingToFailedStatus(WorkflowServiceImpl.java:2453) at org.opencastproject.workflow.impl.MissedCaptureScanner.scan(MissedCaptureScanner.java:80) at org.opencastproject.workflow.impl.MissedCaptureScanner$Runner$1.run(MissedCaptureScanner.java:109) at org.opencastproject.util.data.Effect0.apply(Effect0.java:29) at org.opencastproject.util.data.Effect0.apply(Effect0.java:26) at org.opencastproject.security.util.SecurityContext.runInContext(SecurityContext.java:51) at org.opencastproject.workflow.impl.MissedCaptureScanner$Runner.execute(MissedCaptureScanner.java:106) at org.opencastproject.workflow.impl.MissedCaptureScanner$Runner.execute(MissedCaptureScanner.java:92) at org.opencastproject.kernel.scanner.AbstractScanner$TypedQuartzJob$1.xapply(AbstractScanner.java:307) at org.opencastproject.kernel.scanner.AbstractScanner$TypedQuartzJob$1.xapply(AbstractScanner.java:303) at org.opencastproject.util.data.Function0$X.apply(Function0.java:52) at org.opencastproject.util.NeedleEye.apply(NeedleEye.java:40) at org.opencastproject.kernel.scanner.AbstractScanner$TypedQuartzJob.execute(AbstractScanner.java:293) at org.quartz.core.JobRunShell.run(JobRunShell.java:216) ... 1 more
    • Tags (folksonomy):

      TestRail: Results

        Attachments

          Issue links

            Activity

              People

              • Assignee:
                lrohner Lukas Rohner
                Reporter:
                lrohner Lukas Rohner
              • Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  TestRail: Cases