2011-03-08 70 views
9

我使用c3p0作为连接池运行连接到MySQL设置的Spring/Hibernate。由于某些奇怪的原因,当系统负载不足时(当然),它会断开连接。用完数据库连接!

该网站是相当稳定,直到我们开始达到一个新的水平(超过100个并发用户)。此时数据库将会融化(挂住CPU)。我的第一个行动是通过广泛的缓存和优化查询等来提高性能的应用程序。

现在它会间歇性地耗尽连接。它似乎甚至不依赖于负载。更多的时间,这让我觉得这是一个泄漏,但对于我的生活,我无法弄清楚它会来自哪里。

WARN [2011-03-07 17:19:42,409] [TP-Processor38] (JDBCExceptionReporter.java:100) - SQL Error: 0, SQLState: null 
ERROR [2011-03-07 17:19:42,409] [TP-Processor38] (JDBCExceptionReporter.java:101) - An attempt by a client to checkout a Connection has timed out. 
ERROR [2011-03-07 17:19:42,410] [TP-Processor38] (HttpHeadFilter.java:46) - There was a problem passing thru filter:/is-this-guy-crazy-or-just-a-huge-dancing-with-the-stars-fan 
org.springframework.web.util.NestedServletException: Request processing failed; nested exception is org.hibernate.exception.GenericJDBCException: could not execute query 
     at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:659) 
     at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:552) 
     at javax.servlet.http.HttpServlet.service(HttpServlet.java:617) 
     at javax.servlet.http.HttpServlet.service(HttpServlet.java:717) 
     at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) 
     at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) 
     at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:343) 
     at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:109) 

Caused by: java.sql.SQLException: An attempt by a client to checkout a Connection has timed out. 
    at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:106) 
    at com.mchange.v2.sql.SqlUtils.toSQLException(SqlUtils.java:65) 
    at com.mchange.v2.c3p0.impl.C3P0PooledConnectionPool.checkoutPooledConnection(C3P0PooledConnectionPool.java:527) 
    at com.mchange.v2.c3p0.impl.AbstractPoolBackedDataSource.getConnection(AbstractPoolBackedDataSource.java:128) 

这里是我的配置:

<bean id="dataSource" class="org.springframework.jdbc.datasource.LazyConnectionDataSourceProxy"> 
     <property name="targetDataSource" ref="rootDataSource" /> 
    </bean> 
    <bean id="sessionFactory" class="org.springframework.orm.hibernate3.LocalSessionFactoryBean"> 
     <property name="mappingLocations" value="classpath:hibernate-mapping.xml" /> 
     <property name="hibernateProperties"> 
      <props> 
       <prop key="hibernate.connection.provider_class">net.sf.hibernate.connection.C3P0ConnectionProvider</prop> 
       <prop key="hibernate.dialect">${hibernate.dialect}</prop> 
       <prop key="hibernate.show_sql">${hibernate.show_sql}</prop> 
       <prop key="hibernate.cache.use_second_level_cache">true</prop> 
       <prop key="hibernate.cache.use_query_cache">true</prop> 
       <prop key="hibernate.cache.generate_statistics">true</prop> 
       <prop key="hibernate.cache.provider_class">net.sf.ehcache.hibernate.EhCacheProvider</prop> 
       <prop key="hibernate.generate_statistics">${hibernate.generate_statistics}</prop> 
       <prop key="hibernate.connection.zeroDateTimeBehavior">convertToNull</prop> 
       <prop key="hibernate.bytecode.use_reflection_optimizer">${hibernate.bytecode.use_reflection_optimizer}</prop> 
       <!--<prop key="hibernate.hbm2ddl.auto">${hibernate.hbm2ddl.auto}</prop>--> 
       <prop key="hibernate.jdbc.batch_size">${hibernate.jdbc.batch_size}</prop> 

       <!--Actually, it seems the following property affects batch size (or explicit per relationship in the mapping)--> 
       <!--<prop key="hibernate.default_batch_fetch_size">${hibernate.jdbc.batch_size}</prop>--> 
      </props> 
     </property> 
     <property name="dataSource" ref="dataSource" /> 
    </bean> 

    <bean id="rootDataSource" class="com.mchange.v2.c3p0.ComboPooledDataSource"> 
     <property name="driverClass" value="${jdbc.driver}" /> 
     <property name="jdbcUrl" value="${jdbc.url}" /> 
     <property name="user" value="${jdbc.username}" /> 
     <property name="password" value="${jdbc.password}" /> 
     <property name="initialPoolSize" value="20" /> 
     <property name="maxPoolSize" value="200" /> 
     <property name="checkoutTimeout" value="30000" /> 
     <property name="maxStatements" value="180" /> 

     <property name="minPoolSize"> 
      <value>${hibernate.c3p0.minPoolSize}</value> 
     </property> 
     <property name="acquireRetryAttempts"> 
      <value>${hibernate.c3p0.acquireRetryAttempts}</value> 
     </property> 
     <property name="acquireIncrement"> 
      <value>${hibernate.c3p0.acquireIncrement}</value> 
     </property> 
     <property name="idleConnectionTestPeriod"> 
      <value>${hibernate.c3p0.idleConnectionTestPeriod}</value> 
     </property> 
     <property name="maxIdleTime"> 
      <value>${hibernate.c3p0.maxIdleTime}</value> 
     </property> 
     <property name="maxIdleTimeExcessConnections"> 
      <value>${hibernate.c3p0.maxIdleTimeExcessConnections}</value> 
     </property> 
     <property name="maxConnectionAge"> 
      <value>${hibernate.c3p0.maxConnectionAge}</value> 
     </property> 
     <property name="preferredTestQuery"> 
      <value>${hibernate.c3p0.preferredTestQuery}</value> 
     </property> 
     <property name="testConnectionOnCheckin"> 
      <value>${hibernate.c3p0.testConnectionOnCheckin}</value> 
     </property> 
     <property name="numHelperThreads"> 
      <value>${hibernate.c3p0.numHelperThreads}</value> 
     </property> 
     <property name="unreturnedConnectionTimeout"> 
      <value>${hibernate.c3p0.unreturnedConnectionTimeout}</value> 
     </property> 
     <property name="debugUnreturnedConnectionStackTraces"> 
      <value>${hibernate.c3p0.debugUnreturnedConnectionStackTraces}</value> 
     </property> 
     <property name="automaticTestTable"> 
      <value>${hibernate.c3p0.automaticTestTable}</value> 
     </property> 
    </bean> 
    hibernate.c3p0.acquireIncrement=5 
hibernate.c3p0.minPoolSize=20 
hibernate.c3p0.acquireRetryAttempts=30 
hibernate.c3p0.idleConnectionTestPeriod=3600 
hibernate.c3p0.maxIdleTime=7200 
hibernate.c3p0.maxIdleTimeExcessConnections=1800  
hibernate.c3p0.maxConnectionAge=14400 
hibernate.c3p0.preferredTestQuery=select 1; 
hibernate.c3p0.testConnectionOnCheckin=false 
hibernate.c3p0.numHelperThreads=6 
hibernate.c3p0.unreturnedConnectionTimeout=0 
hibernate.c3p0.debugUnreturnedConnectionStackTraces=true 
hibernate.c3p0.automaticTestTable=test_connection; 

我正在运行的OpenSessionInViewInterceptor应关闭连接:

<bean id="openSessionInViewInterceptor" class="org.springframework.orm.hibernate3.support.OpenSessionInViewInterceptor"> 
    <property name="sessionFactory"> 
     <ref bean="sessionFactory" /> 
    </property> 
    <property name="flushModeName"> 
     <value>FLUSH_AUTO</value> 
    </property> 

</bean> 

我也利用弹簧注解@Transactional因为我重用我非网页前端代码中的服务。

这里确实只有两个选项,它在完成时不会释放连接。或者它正在闲聊聊天室,就像它试图穿上裤子一样。 如果任何人有任何想法,我将不胜感激 THX

跟进:最终事实证明,我被泄露,由于使用的OpenSessionInViewInterceptor连接。我的弹簧安全性作为一个过滤器运行,所以它将连接到数据库并且从不关闭它们。解决的办法是将OpenSessionInViewInterceptor移动到OpenSessionInViewFilter。

回答

5

@Transactional泄漏连接的可能性很小 - 否则,您的网站会在前100个请求后停止工作。

但是还有另外一个原因,发生这种情况:

也许你已经为“死”的连接和一些查询需要更长时间的超时。这意味着您的池从池中删除了一个繁忙的连接,并从数据库中请求另一个连接 - 直到数据库拔出插件。

要调试此功能,请为您的连接池启用日志记录,以便您可以查看它何时请求新的连接。

+0

我maxConnectionAge设置为14400根据文档以秒为单位(不MS),所以这将是240分钟。我绝对会尝试开启日志记录。问题在于它打开并关闭了一个TON连接,因此隔离它发生的位置很困难。特别是在负载下。 – matsientst 2011-03-08 18:16:38

12

尝试启用日志记录并将c3p0.debugUnreturnedConnectionStackTraces属性设置为true。还将c3p0.unreturnedConnectionTimeout设置为小于您的平均查询时间(1秒?)。那么任何比超时时间长的事件都会记录堆栈跟踪。这应该可以让你很快缩小事情的范围。

如果堆栈跟踪没有模式,那可能只是您的池太小。你说100个并发用户,但是有什么想法每秒有多少个查询?如果它每秒钟有100个查询,并且你有20个连接,那么每个sql执行需要少于200毫秒(20个连接=>每秒挂钟时间> 20个总工作秒数以执行100个查询)。

+0

+1使用较小的超时更快地追踪它 – 2011-03-09 15:30:05

3

不管C3P0的配置如何(通过休眠),你可能会受到MySQL本身的限制。请记住,默认情况下,MySQL允许的最大连接数为100!所以,即使您告诉C3P0将200,500或1000个连接集中起来,这也无法实现。使用打开一个MySQL壳:

$ msql -u [user] -p 

和类型,以获得允许的最大连接数如下:

$ show variables where Variable_name='max_connections'; 

如果返回的数字太低了您的应用程序,考虑改变它(编辑my.cnf文件,通常位于Linux系统上的/ etc/mysql /内)。

0

我也有这个问题。原因是用户没有对主机的授权,因为/ etc/hosts条目已被修改。