Too Many Open Files Error when Updating Solr Collection

Report · Jan 12, 2012

Does anybody know what the following error means and how to fix it?

javaioFileNotFoundException_optcoldfusionsolrmulticorecore0dataindex_3cm0fnm_Too_many_open_files__javalangRuntimeException_javaioFileNotFoundException_optcoldfusionsolrmulticorecore0dataindex_3cm0fnm_Too_many_open_files__at_orgapachesolrcoreSolrCoregetSearcherSolrCorejava1085__at_orgapachesolrupdateDirectUpdateHandler2commitDirectUpdateHandler2java383__at_orgapachesolrupdateprocessorRunUpdateProcessorprocessCommitRunUpdateProcessorFactoryjava78__at_orgapachesolrhandlerRequestHandlerUtilshandleCommitRequestHandlerUtilsjava105__at_orgapachesolrhandlerContentStreamHandlerBasehandleRequestBodyContentStreamHandlerBasejava58__at_orgapachesolrhandlerRequestHandlerBasehandleRequestRequestHandlerBasejava131__at_orgapachesolrcoreSolrCoreexecuteSolrCorejava1333__at_orgapachesolrservletSolrDispatchFilterexecuteSolrDispatchFilterjava303__at_orgapachesolrservletSolrDispatchFilterdoFilterSolrDispatchFilterjava232__at_orgmortbayjettyservletServletHandler$CachedChaindoFilterServletHandlerjava1089__at_orgmortbayjettyservletServletHandlerhandleServletHandlerjava365__at_orgmortbayjettysecuritySecurityHandlerhandleSecurityHandlerjava216__at_orgmortbayjettyservletSessionHandlerhandleSessionHandlerjava181__at_orgmortbayjettyhandlerContextHandlerhandleContextHandlerjava712__at_orgmortbayjettywebappWebAppContexthandleWebAppContextjava405__at_orgmortbayjettyhandlerContextHandlerCollectionhandleContextHandlerCollectionjava211__at_orgmortbayjettyhandlerHandlerCollectionhandleHandlerCollectionjava114__at_orgmortbayjettyhandlerHandlerWrapperhandleHandlerWrapperjava139__at_orgmortbayjettyServerhandleServerjava285__at_orgmortbayjettyHttpConnectionhandleRequestHttpConnectionjava502__at_orgmortbayjettyHttpConnection$RequestHandlercontentHttpConnectionjava835__at_orgmortbayjettyHttpParserparseNextHttpParserjava723__at_orgmortb javaioFileNotFoundException_optcoldfusionsolrmulticorecore0dataindex_3cm0fnm_Too_many_open_files__javalangRuntimeException_javaioFileNotFoundException_optcoldfusionsolrmulticorecore0dataindex_3cm0fnm_Too_many_open_files__at_orgapachesolrcoreSolrCoregetSearcherSolrCorejava1085__at_orgapachesolrupdateDirectUpdateHandler2commitDirectUpdateHandler2java383__at_orgapachesolrupdateprocessorRunUpdateProcessorprocessCommitRunUpdateProcessorFactoryjava78__at_orgapachesolrhandlerRequestHandlerUtilshandleCommitRequestHandlerUtilsjava105__at_orgapachesolrhandlerContentStreamHandlerBasehandleRequestBodyContentStreamHandlerBasejava58__at_orgapachesolrhandlerRequestHandlerBasehandleRequestRequestHandlerBasejava131__at_orgapachesolrcoreSolrCoreexecuteSolrCorejava1333__at_orgapachesolrservletSolrDispatchFilterexecuteSolrDispatchFilterjava303__at_orgapachesolrservletSolrDispatchFilterdoFilterSolrDispatchFilterjava232__at_orgmortbayjettyservletServletHandler$CachedChaindoFilterServletHandlerjava1089__at_orgmortbayjettyservletServletHandlerhandleServletHandlerjava365__at_orgmortbayjettysecuritySecurityHandlerhandleSecurityHandlerjava216__at_orgmortbayjettyservletSessionHandlerhandleSessionHandlerjava181__at_orgmortbayjettyhandlerContextHandlerhandleContextHandlerjava712__at_orgmortbayjettywebappWebAppContexthandleWebAppContextjava405__at_orgmortbayjettyhandlerContextHandlerCollectionhandleContextHandlerCollectionjava211__at_orgmortbayjettyhandlerHandlerCollectionhandleHandlerCollectionjava114__at_orgmortbayjettyhandlerHandlerWrapperhandleHandlerWrapperjava139__at_orgmortbayjettyServerhandleServerjava285__at_orgmortbayjettyHttpConnectionhandleRequestHttpConnectionjava502__at_orgmortbayjettyHttpConnection$RequestHandlercontentHttpConnectionjava835__at_orgmortbayjettyHttpParserparseNextHttpParserjava723__at_orgmortb request: http://localhost:8983/solr/core0/update?commit=true&waitFlush=false&waitSearcher=false&wt=javabin null <br>The error occurred on line 87.

I am trying to add 1 PDF file to the collection with the following code. (I will eventually be adding more files, but in trying to figure out the errorI have it limited to one file.)

<cfindex

type="file"

action="update"

collection="core0"

key="#thispathkey#"

category="#qSelectDistinctFiles.academic_year#"

custom1="#qSelectDistinctFiles.course_id#"

custom2="#qSelectDistinctFiles.educational_method#"

custom3="#qSelectDistinctFiles.store_id#"

custom4="#qSelectDistinctFiles.qtype#">

Thanks for the help.

Report · Jan 12, 2012

I would guess that you've used up all your file descriptor handles. This might help for a start:

http://wiki.apache.org/lucene-java/LuceneFAQ#Why_am_I_getting_an_IOException_that_says_.22Too_many_o...

Dave Watts, CTO, Fig Leaf Software

Dave Watts, Eidolon LLC

Report · Jan 17, 2012

I think this might have had to do with the KEY attribute not being unique. I am still looking into it though.