数据库连接池
数据库连接池负责分配，管理，释放数据库连接，它允许应用程序重复使用一个现有的数据库连接，而不是重新建立一个。
编写数据库连接池
- 编写数据库连接池必须实现java.sql.DataSource接口
- 在DataSource构造函数中批量创建与数据库的连接，并把创建的连接加入LinkedList对象中。
- 实现getConnection方法，让getConnection方法每次调用时，从LinkedList中取一个Connection返回给用户。
- 当用户使用完Connection，调用Connection.close()方法时，Collection对象应保证将自己返回到LinkedList中,而不要把conn还给数据库。Collection保证将自己返回到LinkedList中是此处编程的难点。
package com.demo.demo.demo1;
import java.io.PrintWriter;
import java.lang.reflect.InvocationHandler;
import java.lang.reflect.Method;
import java.lang.reflect.Proxy;
import java.sql.Connection;
import java.sql.DriverManager;
import java.sql.SQLException;
import java.sql.SQLFeatureNotSupportedException;
import java.util.LinkedList;
import java.util.logging.Logger;
import javax.sql.ConnectionPoolDataSource;
import javax.sql.DataSource;
public class ConnetionPool implements DataSource {
private static LinkedList<Connection> connPool=new LinkedList<>();
static{
String dirver = "com.mysql.jdbc.Driver";
String url = "JDBC:mysql://localhost:3306/world";
String user = "root";
String passwd = "1234";
try {
Class.forName(dirver);
for(int i=0;i<50;i++){
{
Connection c=DriverManager.getConnection(url,user,passwd);
connPool.add(c);
}
}
} catch (Exception e) {
// TODO Auto-generated catch block
e.printStackTrace();
}
}
@Override
public PrintWriter getLogWriter() throws SQLException {
// TODO Auto-generated method stub
return null;
}
@Override
public void setLogWriter(PrintWriter out) throws SQLException {
// TODO Auto-generated method stub
}
@Override
public void setLoginTimeout(int seconds) throws SQLException {
// TODO Auto-generated method stub
}
@Override
public int getLoginTimeout() throws SQLException {
// TODO Auto-generated method stub
return 0;
}
@Override
public Logger getParentLogger() throws SQLFeatureNotSupportedException {
// TODO Auto-generated method stub
return null;
}
@Override
public <T> T unwrap(Class<T> iface) throws SQLException {
// TODO Auto-generated method stub
return null;
}
@Override
public boolean isWrapperFor(Class<?> iface) throws SQLException {
// TODO Auto-generated method stub
return false;
}
@Override
public Connection getConnection() throws SQLException {
if(connPool.size()>0){
final Connection c=connPool.removeFirst();
return (Connection) Proxy.newProxyInstance(ConnetionPool.class.getClassLoader(), c.getClass().getInterfaces(), new InvocationHandler(){
@Override
public Object invoke(Object proxy, Method method, Object[] args) throws Throwable {
if(!method.getName().equals("close")){
//调用的不是close方法
return method.invoke(c,args);
}
else{
//调用的是close方法
connPool.add(c);
return null;
}
}
});
}else{
throw new RuntimeException("数据库繁忙");
}
}
private InvocationHandler InvocationHandler() {
// TODO Auto-generated method stub
return null;
}
@Override
public Connection getConnection(String username, String password) throws SQLException {
// TODO Auto-generated method stub
return null;
}
}
三：开源的数据库连接池
3-1：DBCP，Druid，C3P0数据库连接池
| DBCP |
c3p0 |
Druid |
|
|---|---|---|---|
| 用户名 |
username |
user |
username |
| 密码 |
password |
password |
password |
| URL |
url |
jdbcUrl |
jdbcUrl |
| 驱动类名 |
driverClassName |
driverClass |
driverClassName （若不指定，可通过jdbcUrl自动识别） |
| 最小连接数 |
minIdle(0) |
minPoolSize(3) |
minIdle(0) |
| 初始化连接数 |
initialSize(0) |
initialPoolSize(3) |
initialSize(0) |
| 最大连接数 |
maxTotal(8) |
maxPoolSize(15) |
maxActive(8) |
| 最大等待时间 |
maxWaitMillis(毫秒) |
maxIdleTime(0秒) |
maxWait(毫秒) |
| 开启缓存功能 |
poolPreparedStatements |
maxStatements |
poolPreparedStatements |
| 单个连接拥有的最大缓存数 |
maxOpenPrepared- Statements |
maxStatementsPer- Connection |
maxOpenPrepared- Statements |
| 申请连接检测 |
testOnBorrow |
testConnectionOnCheckin |
testOnBorrow |
| 是否超时检测 |
testWhileIdle |
testWhileIdle |
|
| 空闲时间 |
timeBetweenEvictionRunsMillis |
idleConnectionTestPeriod |
timeBetweenEvictionRunsMillis |
| 校验用sql语句 |
validationQuery |
preferredTestQuery |
validationQuery |
| 归还连接检测 |
testOnReturn |
testConnectionOnCheckout |
testOnReturn |
| 重连次数 |
acquireRetryAttempts |
||
| 间隔时间 |
acquireRetryDelay |
3-2配置详情
3-2-1 DBCP 属性说明表
| 属性(Parameter) |
默认值(Default) |
描述(Description) |
| username |
|
传递给JDBC驱动的用于建立连接的用户名(The connection username to be passed to our JDBC driver to establish a connection.) |
| password |
|
传递给JDBC驱动的用于建立连接的密码(The connection password to be passed to our JDBC driver to establish a connection.) |
| url |
|
传递给JDBC驱动的用于建立连接的URL(The connection URL to be passed to our JDBC driver to establish a connection.) |
| driverClassName |
|
使用的JDBC驱动的完整有效的java 类名(The fully qualified Java class name of the JDBC driver to be used.) |
| defaultAutoCommit |
driver default |
连接池创建的连接的默认的auto-commit状态,没有设置则不会自动提交(The default auto-commit state of connections created by this pool. If not set then the setAutoCommit method will not be called.) |
| initialSize |
0 |
初始化连接:连接池启动时创建的初始化连接数量(The initial number of connections that are created when the pool is started. |
| maxTotal |
8 |
最大活动连接:连接池在同一时间能够分配的最大活动连接的数量, 如果设置为非正数则表示不限制(The maximum number of active connections that can be allocated from this pool at the same time, or negative for no limit.) |
| maxIdle |
8 |
最大空闲连接:连接池中容许保持空闲状态的最大连接数量,超过的空闲连接将被释放,如果设置为负数表示不限制(The maximum number of connections that can remain idle in the pool, without extra ones being released, or negative for no limit.) |
| minIdle |
0 |
最小空闲连接:连接池中容许保持空闲状态的最小连接数量,负数表示没有现在(The maximum number of connections that can remain idle in the pool, without extra ones being released, or negative for no limit.) |
| 注意：如果在某些负载比较大的系统中将maxIdel设置过小时，很可能会出现连接关闭的同时新连接马上打开的情况.这是由于关闭连接的线程比打开的快导致的.所以，对于这种系统中,maxIdle的设定值是不同的但是通常首选默认值 |
||
| (NOTE: If maxIdle is set too low on heavily loaded systems it is possible you will see connections being closed and almost immediately new connections being opened. This is a result of the active threads momentarily closing connections faster than they are opening them, causing the number of idle connections to rise above maxIdle. The best value for maxIdle for heavily loaded system will vary but the default is a good starting point.) |
||
| maxWaitMillis |
indefinitely |
最大等待时间:当没有可用连接时,连接池等待连接被归还的最大时间(以毫秒计数),超过时间则抛出异常,如果设置为-1表示无限等待(The maximum number of milliseconds that the pool will wait (when there are no available connections) for a connection to be returned before throwing an exception, or -1 to wait indefinitely.) |
| validationQuery |
|
SQL查询,用来验证从连接池取出的连接,在将连接返回给调用者之前.如果指定,则查询必须是一个SQL SELECT并且必须返回至少一行记录(The SQL query that will be used to validate connections from this pool before returning them to the caller. If specified, this query MUST be an SQL SELECT statement that returns at least one row. If not specified, connections will be validation by calling the isValid() method.) |
| testOnCreate |
false |
指明是否在建立连接之后进行验证,如果验证失败,则尝试重新建立连接(The indication of whether objects will be validated after creation. If the object fails to validate, the borrow attempt that triggered the object creation will fail.) |
| testOnBorrow |
true |
指明是否在从池中取出连接前进行检验,如果检验失败,则从池中去除连接并尝试取出另一个. 注意: 设置为true后如果要生效,validationQuery参数必须设置为非空字符串(The indication of whether objects will be validated before being borrowed from the pool. If the object fails to validate, it will be dropped from the pool, and we will attempt to borrow another.) |
| testOnReturn |
false |
指明是否在归还到池中前进行检验(The indication of whether objects will be validated before being returned to the pool.) |
| testWhileIdle |
false |
指明连接是否被空闲连接回收器(如果有)进行检验.如果检测失败,则连接将被从池中去除. 注意: 设置为true后如果要生效,validationQuery参数必须设置为非空字符串(The indication of whether objects will be validated by the idle object evictor (if any). If an object fails to validate, it will be dropped from the pool.) |
| timeBetweenEviction- RunsMillis |
-1 |
在空闲连接回收器线程运行期间休眠的时间值,以毫秒为单位.如果设置为非正数,则不运行空闲连接回收器线程(The number of milliseconds to sleep between runs of the idle object evictor thread. When non-positive, no idle object evictor thread will be run.) |
| numTestsPerEvictionRun |
3 |
在每次空闲连接回收器线程(如果有)运行时检查的连接数量(The number of objects to examine during each run of the idle object evictor thread (if any).) |
| minEvictableIdleTime-Millis |
1000*60*30 |
连接在池中保持空闲而不被空闲连接回收器线程(如果有)回收的最小时间值，单位毫秒(The minimum amount of time an object may sit idle in the pool before it is eligable for eviction by the idle object evictor (if any).) |
| softMiniEvictableIdle- TimeMillis |
-1 |
说明(The minimum amount of time a connection may sit idle in the pool before it is eligible for eviction by the idle connection evictor, with the extra condition that at least "minIdle" connections remain in the pool. When miniEvictableIdleTimeMillis is set to a positive value, miniEvictableIdleTimeMillis is examined first by the idle connection evictor - i.e. when idle connections are visited by the evictor, idle time is first compared against miniEvictableIdleTimeMillis (without considering the number of idle connections in the pool) and then against softMinEvictableIdleTimeMillis, including the minIdle constraint.) |
| maxConnLifetimeMillis |
-1 |
说明(The maximum lifetime in milliseconds of a connection. After this time is exceeded the connection will fail the next activation, passivation or validation test. A value of zero or less means the connection has an infinite lifetime.) |
| logExpiredConnections |
true |
说明(Flag to log a message indicating that a connection is being closed by the pool due to maxConnLifetimeMillis exceeded. Set this property to false to suppress expired connection logging that is turned on by default. |
| connectionInitSqls |
null |
说明(A Collection of SQL statements that will be used to initialize physical connections when they are first created. These statements are executed only once - when the configured connection factory creates the connection.) |
| info |
true |
说明(True means that borrowObject returns the most recently used ("last in") connection in the pool (if there are idle connections available). False means that the pool behaves as a FIFO queue - connections are taken from the idle instance pool in the order that they are returned to the pool.) |
| poolPreparedState-ments |
false |
开启池的prepared statement 池功能(Enable prepared statement pooling for this pool.) |
| maxOpenPreparedState-ments |
unlimited |
statement池能够同时分配的打开的statements的最大数量, 如果设置为0表示不限制(The maximum number of open statements that can be allocated from the statement pool at the same time, or negative for no limit.) |
| NOTE - Make sure your connection has some resources left for the other statements. Pooling PreparedStatements may keep their cursors open in the database, causing a connection to run out of cursors, especially if maxOpenPreparedStatements is left at the default (unlimited) and an application opens a large number of different PreparedStatements per connection. To avoid this problem, maxOpenPreparedStatements should be set to a value less than the maximum number of cursors that can be open on a Connection. |
||
| accessToUnderlyingConnectionAllowed |
false |
控制PoolGuard是否容许获取底层连接(Controls if the PoolGuard allows access to the underlying connection.) 默认false不开启, 这是一个有潜在危险的功能, 不适当的编码会造成伤害.(关闭底层连接或者在守护连接已经关闭的情况下继续使用它).请谨慎使用,并且仅当需要直接访问驱动的特定功能时使用.注意: 不要关闭底层连接, 只能关闭前面的那个. Default is false, it is a potential dangerous operation and misbehaving programs can do harmful things. (closing the underlying or continue using it when the guarded connection is already closed) Be careful and only use when you need direct access to driver specific extensions. NOTE: Do not close the underlying connection, only the original one. |
| removeAbandoned |
false |
标记是否删除泄露的连接,如果他们超过了removeAbandonedTimout的限制.如果设置为true, 连接被认为是被泄露并且可以被删除,如果空闲时间超过removeAbandonedTimeout. 设置为true可以为写法糟糕的没有关闭连接的程序修复数据库连接. (Flags to remove abandoned connections if they exceed the removeAbandonedTimout. A connection is considered abandoned and eligible for removal if it has not been used for longer than removeAbandonedTimeout. Setting one or both of these to true can recover db connections from poorly written applications which fail to close connections.) |
| removeAbandonedTimeout |
300 |
泄露的连接可以被删除的超时值, 单位秒(Timeout in seconds before an abandoned connection can be removed.) |
| logAbandoned |
false |
标记当Statement或连接被泄露时是否打印程序的stack traces日志。被泄露的Statements和连接的日志添加在每个连接打开或者生成新的Statement,因为需要生成stack trace。(Flag to log stack traces for application code which abandoned a Statement or Connection. Logging of abandoned Statements and Connections adds overhead for every Connection open or new Statement because a stack trace has to be generated.) |
| abandonedUsageTracking |
false |
如果为true, 那么连接池会记录每个方法调用时候的堆栈信息以及废弃连接的调试信息(If true, the connection pool records a stack trace every time a method is called on a pooled connection and retains the most recent stack trace to aid debugging of abandoned connections. There is significant overhead added by setting this to true.) |
| 注:如果开启"removeAbandoned",那么连接在被认为泄露时可能被池回收. 这个机制在(getNumIdle() < 2)and (getNumActive() > getMaxActive() - 3)时被触发. 举例当maxActive=20, 活动连接为18,空闲连接为1时可以触发"removeAbandoned".但是活动连接只有在没有被使用的时间超过"removeAbandonedTimeout"时才被删除,默认300秒.在resultset中游历不被计算为被使用. |
||
| If you have enabled removeAbandonedOnMaintenance or removeAbandonedOnBorrow then it is possible that a connection is reclaimed by the pool because it is considered to be abandoned. This mechanism is triggered when (getNumIdle() < 2) and (getNumActive() > getMaxTotal() - 3) and removeAbandonedOnBorrow is true; or after eviction finishes and removeAbandonedOnMaintenance is true. For example, maxTotal=20 and 18 active connections and 1 idle connection would trigger removeAbandonedOnBorrow, but only the active connections that aren't used for more then "removeAbandonedTimeout" seconds are removed (default 300 sec). Traversing a resultset doesn't count as being used. Creating a Statement, PreparedStatement or CallableStatement or using one of these to execute a query (using one of the execute methods) resets the lastUsed property of the parent connection. |
||
3-2-2 C3P0 属性说明表
| 属性(Parameter) |
默认值(Default) |
描述(Description) |
| user |
|
同DBCP中的username属性 |
| password |
|
同DBCP中的password属性 |
| jdbcUrl |
|
同DBCP中的jdbcUrl属性 |
| driverClass |
|
同DBCP中的driverClass属性 |
| autoCommitOnClose |
false |
默认值false表示回滚任何未提交的任务,设置为true则全部提交,而不是在关闭连接之前回滚 (C3P0's default policy is to rollback any uncommitted, pending work. Setting autoCommitOnClose to true causes uncommitted pending work to be committed, rather than rolled back on Connection close.) *参见DBCP中的defaultAutoCommit属性 |
| initialPoolSize |
3 |
初始化连接:连接池启动时创建的初始化连接数量(The initial number of connections that are created when the pool is started. *参见DBCP中的initialSize属性 |
| maxPoolSize |
15 |
连接池中保留的最大连接数(Maximum number of Connections a pool will maintain at any given time.) *参见DBCP中的maxIdle属性 |
| minPoolSize |
3 |
连接池中保留的最小连接数(Minimum number of Connections a pool will maintain at any given time.) *参见DBCP中的maxIdle属性 |
| maxIdleTime |
0 |
最大等待时间:当没有可用连接时,连接池等待连接被归还的最大时间(以秒计数),超过时间则抛出异常,如果设置为0表示无限等待(Seconds a Connection can remain pooled but unused before being discarded. Zero means idle connections never expire.) *参见DBCP中maxWaitMillis 属性 |
| preferredTestQuery |
null |
定义所有连接测试都执行的测试语句。在使用连接测试的情况下这个一显著提高测试速度。注意：测试的表必须在初始数据源的时候就存在。(Defines the query that will be executed for all connection tests, if the default ConnectionTester (or some other implementation of QueryConnectionTester, or better yet FullQueryConnectionTester) is being used. Defining a preferredTestQuery that will execute quickly in your database may dramatically speed up Connection tests.) |
| testConnectionOn- Checkin |
false |
如果设为true那么在取得连接的同时将校验连接的有效性。(If true, an operation will be performed asynchronously at every connection checkin to verify that the connection is valid. Use in combination with idleConnectionTestPeriod for quite reliable, always asynchronous Connection testing.) *参见DBCP中的testOnBorrow属性 |
| testConnectionOn- Checkout |
false |
如果设为true那么在每个connection提交的时候都将校验其有效性,但是要确保配置的preferredTestQuery的有效性(If true, an operation will be performed at every connection checkout to verify that the connection is valid. Be sure to set an efficient preferredTestQuery or automaticTestTable if you set this to true.) *参见DBCP中的testOnBorrow属性 |
| idleConnectionTest- Period |
0 |
如果设置大于0,表示过了多少秒检查一次空闲连接,结合testConnectionOnCheckin以及testConnectionOnCheckout使用(If this is a number greater than 0, c3p0 will test all idle, pooled but unchecked-out connections, every this number of seconds.) |
| acquireRetryAttempts |
30 |
定义在从数据库获取新连接失败后重复尝试的次数, 如果小于0则表示无限制的连接。(Defines how many times c3p0 will try to acquire a new Connection from the database before giving up. If this value is less than or equal to zero, c3p0 will keep trying to fetch a Connection indefinitely.) |
| acquireRetryDelay |
1000 |
两次连接中的间隔时间，单位毫秒。(Milliseconds, time c3p0 will wait between acquire attempts.) |
| breakAfterAcquire- Failure |
false |
获取连接失败将会引起所有等待连接池来获取连接的线程抛出异常。但是数据源仍有效保留，并在下次调用 getConnection() 的时候继续尝试获取连接。如果为 true，那么在尝试获取连接失败后该数据源将声明已断开并永久关闭。(If true, a pooled DataSource will declare itself broken and be permanently closed if a Connection cannot be obtained from the database after making acquireRetryAttempts to acquire one. If false, failure to obtain a Connection will cause all Threads waiting for the pool to acquire a Connection to throw an Exception, but the DataSource will remain valid, and will attempt to acquire again following a call to getConnection().) |
| checkoutTimeout |
0 |
当连接池用完时客户端调用 getConnection() 后等待获取新连接的时间，潮湿后将抛出SQLException，如设为0，则为无限期等待。单位毫秒。(The number of milliseconds a client calling getConnection() will wait for a Connection to be checked-in or acquired when the pool is exhausted. Zero means wait indefinitely. Setting any positive value will cause the getConnection() call to time-out and break with an SQLException after the specified number of milliseconds.) |
| maxStatements |
0 |
控制数据源内加载的PreparedStatements数量(Enable prepared statement pooling for this pool.) |
| maxStatementsPer- Connection |
0 |
定义了连接池内单个连接所拥有的最大缓存statements数(The maximum number of open statements that can be allocated from the statement pool at the same time, or negative for no limit.) |
3-2-3 DRUID 属性说明表
| 属性(Parameter) |
默认值(Default) |
描述(Description) |
| username |
|
连接数据库的用户名 |
| password |
|
连接数据库的密码 |
| jdbcUrl |
|
同DBCP中的jdbcUrl属性 |
| driverClassName |
根据url自动识别 |
这一项可配可不配，如果不配置druid会根据url自动识别dbType，然后选择相应的driverClassName |
| initialSize |
0 |
初始化时建立物理连接的个数。初始化发生在显示调用init方法，或者第一次getConnection时 *参见DBCP中的initialSize属性 |
| maxActive |
8 |
最大连接池数量(Maximum number of Connections a pool will maintain at any given time.) *参见DBCP中的maxTotal属性 |
| maxIdle |
8 |
已经不再使用，配置了也没效果 *参见DBCP中的maxIdle属性 |
| minIdle |
|
最小连接池数量 |
| maxWait |
|
获取连接时最大等待时间，单位毫秒。配置了maxWait之后，缺省启用公平锁，并发效率会有所下降，如果需要可以通过配置useUnfairLock属性为true使用非公平锁。 |
| poolPreparedState- ments |
false |
是否缓存preparedStatement，也就是PSCache。PSCache对支持游标的数据库性能提升巨大，比如说oracle。 |
| maxOpenPrepared- Statements |
-1 |
要启用PSCache，必须配置大于0，当大于0时，poolPreparedStatements自动触发修改为true。 在Druid中，不会存在Oracle下PSCache占用内存过多的问题，可以把这个数值配置大一些，比如说100 |
| testOnBorrow |
true |
申请连接时执行validationQuery检测连接是否有效，做了这个配置会降低性能。 |
| testOnReturn |
false |
归还连接时执行validationQuery检测连接是否有效，做了这个配置会降低性能 |
| testWhileIdle |
false |
建议配置为true，不影响性能，并且保证安全性。申请连接的时候检测，如果空闲时间大于timeBetweenEvictionRunsMillis，执行validationQuery检测连接是否有效。 |
| validationQuery |
|
用来检测连接是否有效的sql，要求是一个查询语句。如果validationQuery为null，testOnBorrow、testOnReturn、testWhileIdle都不会其作用。在mysql中通常为select 'x'，在oracle中通常为select 1 from dual |
| timeBetweenEviction-RunsMillis |
|
1) Destroy线程会检测连接的间隔时间 2) testWhileIdle的判断依据 |
| minEvictableIdle- TimeMillis |
|
Destory线程中如果检测到当前连接的最后活跃时间和当前时间的差值大于minEvictableIdleTimeMillis，则关闭当前连接。 |
| removeAbandoned |
|
对于建立时间超过removeAbandonedTimeout的连接强制关闭 |
| removeAbandoned-Timeout |
|
指定连接建立多长时间就需要被强制关闭 |
| logAbandoned |
false |
指定发生removeabandoned的时候，是否记录当前线程的堆栈信息到日志中 |
| filters |
|
属性类型是字符串，通过别名的方式配置扩展插件，常用的插件有： 1）监控统计用的filter:stat 2）日志用的filter:log4j 3）防御sql注入的filter:wall |