从零开发高并发秒杀系统(一)DAO层

建议从官网获取配置,项目用到的官方文档地址:

logback配置:http://logback.qos.ch/manual/configuration.html

spring配置:http://docs.spring.io/spring/docs/

mybatis配置:http://mybatis.github.io/mybatis-3/zh/index.html

项目使用环境:eclipse+maven+mysql+spring+springmvc+mybatis+redis

一、项目依赖

1、单元测试相关依赖:建议Junit依赖的版本使用4.0以上,因为Junit3.0默认使用编程的方式运行Junit,而Junit4.0默认使用注解的方式运行Junit,如下

<dependency>
  <!-- 使用junit4 -->
  <groupId>junit</groupId>
  <artifactId>junit</artifactId>
  <version>4.11</version>
  <scope>test</scope>
</dependency>

2、日志相关依赖:使用slf4j+logback。java日志包有slf4j、logback、log4j、commons-logging,slf4j是接口/规范,针对我们编程,即我们的应用程序中import的类都是slf4j的类,logback、log4j、commons-logging则是slf4j是接口/规范的具体日志实现。

<dependency>
  <groupId>org.slf4j</groupId>
  <artifactId>slf4j-api</artifactId>
  <version>1.7.12</version>
</dependency>
<dependency>
  <groupId>ch.qos.logback</groupId>
  <artifactId>logback-core</artifactId>
  <version>1.1.1</version>
</dependency>
<!-- 实现slf4j接口并整合 -->
<dependency>
  <groupId>ch.qos.logback</groupId>
  <artifactId>logback-classic</artifactId>
  <version>1.1.1</version>
</dependency>

3、数据库相关依赖:采用c3p0数据库连接池。因为mysql数据库驱动只有在运行时才会用到,所以把范围设置为runtime

<dependency>
  <groupId>mysql</groupId>
  <artifactId>mysql-connector-java</artifactId>
  <version>5.1.35</version>

  <scope>runtime</scope>

</dependency>
<!-- 数据库连接池 -->
<dependency>
  <groupId>c3p0</groupId>
  <artifactId>c3p0</artifactId>
  <version>0.9.1.2</version>
</dependency>

4、mybatis依赖

<dependency>
  <groupId>org.mybatis</groupId>
  <artifactId>mybatis</artifactId>
  <version>3.3.0</version>
</dependency>
<!-- mybatis自身实现的spring整合依赖 -->
<dependency>
  <groupId>org.mybatis</groupId>
  <artifactId>mybatis-spring</artifactId>
  <version>1.2.3</version>
</dependency>

5、Servlet web相关依赖

<dependency>
  <groupId>taglibs</groupId>
  <artifactId>standard</artifactId>
  <version>1.1.2</version>
</dependency>
<dependency>
  <groupId>jstl</groupId>
  <artifactId>jstl</artifactId>
  <version>1.2</version>
</dependency>
<dependency>
  <groupId>com.fasterxml.jackson.core</groupId>
  <artifactId>jackson-databind</artifactId>
  <version>2.5.4</version>
</dependency>
<dependency>
  <groupId>javax.servlet</groupId>
  <artifactId>servlet-api</artifactId>
  <version>3.1.0</version>
</dependency>

6、spring相关依赖:使用4.1.7.RELEASE版本

(1)spring核心依赖

<dependency>
  <groupId>org.springframework</groupId>
  <artifactId>spring-core</artifactId>
  <version>4.1.7.RELEASE</version>
</dependency>
<dependency>
  <groupId>org.springframework</groupId>
  <artifactId>spring-beans</artifactId>
  <version>4.1.7.RELEASE</version>
</dependency>
<dependency>
  <groupId>org.springframework</groupId>
  <artifactId>spring-context</artifactId>
  <version>4.1.7.RELEASE</version>
</dependency>
(2)spring dao层依赖 
<dependency>
  <groupId>org.springframework</groupId>
  <artifactId>spring-jdbc</artifactId>
  <version>4.1.7.RELEASE</version>
</dependency>
<dependency>
  <groupId>org.springframework</groupId>
  <artifactId>spring-tx</artifactId>
  <version>4.1.7.RELEASE</version>
</dependency>
(3)spring web层依赖 
<dependency>
  <groupId>org.springframework</groupId>
  <artifactId>spring-web</artifactId>
  <version>4.1.7.RELEASE</version>
</dependency>
<dependency>
  <groupId>org.springframework</groupId>
  <artifactId>spring-webmvc</artifactId>
  <version>4.1.7.RELEASE</version>
</dependency>
 (4)spring test相关依赖
<dependency>
  <groupId>org.springframework</groupId>
  <artifactId>spring-test</artifactId>
  <version>4.1.7.RELEASE</version>
</dependency>

7、jsp页面相关依赖(如果报错:Multiple annotations found at this line:- javax.servlet.jsp cannot be resolved to a type添加此依赖)

<dependency>
  <groupId>javax.servlet.jsp</groupId>
  <artifactId>jsp-api</artifactId>
  <version>2.2</version>
  <scope>provided</scope>
</dependency>

二、秒杀业务分析

秒杀业务的核心:库存的处理

秒杀业务:      1、减库存  2、记录购买明细   构成一个完整事务,最后进行数据落地,即所有相关数据都更新或插入到mysql中,因为事务机制依然是目前最可靠的数据落地方案。

秒杀业务的难点:热点商品的高并发竞争,反映到技术上就是 Mysql的事务+行级锁

秒杀的事务分析:start Transaction -> update 库存数量 -> insert 购买明细 -> commit/rollback

        竞争出现在   update 库存数量

秒杀的难点:如何高效的处理竞争

三、数据库表设计

--数据库初始化脚本
--创建数据库
create database `seckill`;
--使用数据库
use seckill;
--创建秒杀库存表
create table seckill(
`seckill_id` bigint not null auto_increment comment '商品id',
`name` varchar(120) not null comment '商品名称',
`number` int not null comment '库存数量',
`start_time` timestamp not null comment '秒杀开启时间',
`end_time` timestamp not null comment '秒杀结束时间',
`create_time` timestamp not null default current_timestamp comment '创建时间',
primary key(seckill_id),
key idx_start_time(start_time),
key idx_end_time(end_time),
key idx_create_time(create_time),
)engine=InnoDB auto_increment = 1000 default charset=utf8 comment='秒杀库存表';
--初始化数据
insert into
seckill(name,number,start_time,end_time)
values
(
'1000元秒杀iphone8',100,'2018-05-01 00:00:00','2018-05-02 00:00:00',
'500元秒杀ipad',200,'2018-05-01 00:00:00','2018-05-02 00:00:00',
'100000元秒杀奔驰',10,'2018-05-01 00:00:00','2018-05-02 00:00:00',
'200元秒杀红米note',300,'2018-05-01 00:00:00','2018-05-02 00:00:00',
);


--秒杀成功明细表
create table success_killed(
`seckill_id` bigint not null comment '商品id',
`user_phone` bigint not null comment '用户手机号',
`state` tinyint not null default comment '状态标识 -1:无效 0:成功 1:已付款',
`create_time` timestamp not null '创建时间',
primary key(seckill_id,user_phone),/*联合主键:防止重复秒杀*/
key idx_create_time(create_time),
)engine=InnoDB default charset=utf8 comment='秒杀成功明细表';

四、DAO层实体和接口编码

实体类

package com.jiangwangxiang.entity;

import java.util.Date;

/**
* 秒杀商品
*/
public class Seckill {
  private long seckillId;
  private String name;
  private int number;
  private Date startTime;
  private Date endTime;
  private Date createTime;

  public long getSeckillId() {
    return seckillId;
  }
  public void setSeckillId(long seckillId) {
    this.seckillId = seckillId;
  }
  public String getName() {
    return name;
  }
  public void setName(String name) {
    this.name = name;
  }
  public int getNumber() {
    return number;
  }
  public void setNumber(int number) {
    this.number = number;
  }
  public Date getStartTime() {
    return startTime;
  }
  public void setStartTime(Date startTime) {
    this.startTime = startTime;
  }
  public Date getEndTime() {
    return endTime;
  }
  public void setEndTime(Date endTime) {
    this.endTime = endTime;
  }
  public Date getCreateTime() {
    return createTime;
  }
  public void setCreateTime(Date createTime) {
    this.createTime = createTime;
  }

  @Override
  public String toString() {
    return "Seckill [seckillId=" + seckillId + ", name=" + name + ", number=" + number + ", startTime=" + startTime
      + ", endTime=" + endTime + ", createTime=" + createTime + "]";
  }
}

package com.jiangwangxiang.entity;

import java.util.Date;

/**
* 成功秒杀实体
*/
public class SuccessKilled {
  private long seckillId;
  private long userPhone;
  private short state;
  private Date creteTime;
  // 多对一的复合属性
  private Seckill seckill;

  public long getSeckillId() {
    return seckillId;
  }
  public void setSeckillId(long seckillId) {
    this.seckillId = seckillId;
  }
  public long getUserPhone() {
    return userPhone;
  }
  public void setUserPhone(long userPhone) {
    this.userPhone = userPhone;
  }
  public short getState() {
    return state;
  }
  public void setState(short state) {
    this.state = state;
  }
  public Date getCreteTime() {
    return creteTime;
  }
  public void setCreteTime(Date creteTime) {
    this.creteTime = creteTime;
  }
  public Seckill getSeckill() {
    return seckill;
  }
  public void setSeckill(Seckill seckill) {
    this.seckill = seckill;
  }

  @Override
  public String toString() {
    return "SuccessKilled [seckillId=" + seckillId + ", userPhone=" + userPhone + ", state=" + state
      + ", creteTime=" + creteTime + "]";
  }
}

dao接口

注意:java没有保存形参的记录,所以像 int reduceNumber(long seckillId, Date killTime); 这样的方法中的seckillId会被arg0代替,killTime会被arg1代替(只有一个方法的参数不会出现这样的问题),依次类推下去,这样会

导致mybatis的mapper文件中的sql语句中无法绑定seckillId、killTime等这样的参数从而执行sql出错

解决方法:使用param注解,并在注解中设置形参,像这样 

是使用

package com.jiangwangxiang.dao;

import java.util.Date;
import java.util.List;

import com.jiangwangxiang.entity.Seckill;

//秒杀库存DAO接口
public interface SeckillDao {
  //减库存
  int reduceNumber(@Param("seckillId") long seckillId, @Param("killTime") Date killTime);
  //根据id查询秒杀对象
  Seckill queryById(long seckillId);
  //根据偏移量查询秒杀商品列表
  List<Seckill> queryAll(@Param("offset") int offset, @Param("limit") int limit);
}

package com.jiangwangxiang.dao;

import com.jiangwangxiang.entity.SuccessKilled;

public interface SuccessKilledDao {
  //插入购买明细,可过滤重复
  int insertSuccessKilled(@Param("seckillId") long seckillId, @Param("userPhone") long userPhone);
  //根据id查询SuccessKilled并携带秒杀产品对象实体
  SuccessKilled queryByIdWithSeckill(@Param("seckillId") long seckillId, @Param("userPhone") long userPhone);
}

基于mybatis实现DAO

mybatis配置文件mybatis-config.xml

<?xml version="1.0" encoding="UTF-8" ?>
<!DOCTYPE configuration
PUBLIC "-//mybatis.org//DTD Config 3.0//EN"
"http://mybatis.org/dtd/mybatis-3-config.dtd">
<configuration>
  <!-- 配置全局属性 -->
  <settings>
    <!-- 使用jdbc的getGeneratedKeys获取数据库自增主键值 -->
    <setting name="useGeneratedKeys" value="true" />
    <!-- 使用列别名替换列名 默认:true -->
    <setting name="useColumnLabel" value="true" />
    <!-- 开启驼峰命名转换:Table{create_time} -> Entity{createTime} -->
    <setting name="mapUnderscoreToCamelCase" value="true" />
  </settings>
</configuration>

DAO接口对应的mapper文件

SeckillDao.xml   注意:xml中不允许直接写<=,必须进行转换,方法为: <![CDATA[ <= ]]>

<?xml version="1.0" encoding="UTF-8" ?>
<!DOCTYPE mapper
  PUBLIC "-//mybatis.org//DTD Mapper 3.0//EN"
  "http://mybatis.org/dtd/mybatis-3-mapper.dtd">
<mapper namespace="com.jiangwangxiang.dao.SeckillDao">
  <!-- 目的:为dao接口方法提供sql语句配置 -->
  <update id="reduceNumber">
    <!-- 具体的sql -->
    UPDATE seckill
      SET number = number - 1
    WHERE
      seckill_id = #{seckillId}
    AND start_time <![CDATA[ <= ]]> #{killTime}
    AND end_time >= #{killTime}
    AND number > 0
  </update>

  <select id="queryById" resultType="Seckill" parameterType="long">
    SELECT
      seckill_id,
      NAME,
      number,
      start_time,
      end_time,
      create_time
    FROM
      seckill
    WHERE
      seckill_id = #{seckillId}
  </select>

  <select id="queryAll" resultType="Seckill">
    SELECT
      seckill_id,
      NAME,
      number,
      start_time,
      end_time,
      create_time
    FROM
      seckill
    ORDER BY
      create_time DESC
    LIMIT #{offset},#{limit}
  </select>
</mapper>

SuccessKilledDao.xml    注意:insert语句如果主键冲突会报错,所以使用 INSERT ignore ,这样的话即使主键冲突也不会报错,只是插入不会成功而已

<?xml version="1.0" encoding="UTF-8" ?>
<!DOCTYPE mapper
  PUBLIC "-//mybatis.org//DTD Mapper 3.0//EN"
  "http://mybatis.org/dtd/mybatis-3-mapper.dtd">
<mapper namespace="com.jiangwangxiang.dao.SuccessKilledDao">
  <insert id="insertSuccessKilled">
    <!-- 主键冲突,报错 -->
    INSERT ignore INTO success_killed (seckill_id, user_phone, state)
    VALUES (#{seckillId}, #{userPhone}, 0)
  </insert>

  <select id="queryByIdWithSeckill" resultType="SuccessKilled">
    <!-- 如何告诉MyBatis把结果映射到SuccessKilled同时映射seckill属性 -->
    <!-- 可以自由控制SQL -->
    SELECT
      sk.seckill_id,
      sk.user_phone,
      sk.create_time,
      sk.state,
      s.seckill_id "seckill.seckill_id",
      s.`name` "seckill.name",
      s.number "seckill.number",
      s.start_time "seckill.start_time",
      s.end_time "seckill.end_time",
      s.create_time "seckill.create_time"
    FROM
      success_killed sk
    INNER JOIN seckill s ON sk.seckill_id = s.seckill_id
    WHERE
      sk.seckill_id = #{seckillId}
    AND sk.user_phone = #{userPhone}
  </select>
</mapper>

mybatis整合spring       XML提供SQL+DAO接口Mapper

spring-dao.xml     注意:src/main/java 和 src/main/resources目录都是classpath

<?xml version="1.0" encoding="UTF-8"?>
<beans xmlns="http://www.springframework.org/schema/beans"
  xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
  xmlns:context="http://www.springframework.org/schema/context"
  xsi:schemaLocation="http://www.springframework.org/schema/beans
    http://www.springframework.org/schema/beans/spring-beans.xsd
    http://www.springframework.org/schema/context
    http://www.springframework.org/schema/context/spring-context.xsd">
  <!-- 配置整合mybatis过程 -->
  <!-- 1.配置数据库相关参数properties的属性:${url} -->
  <context:property-placeholder location="classpath:jdbc.properties" />

  <!-- 2.数据库连接池 -->
  <bean id="dataSource" class="com.mchange.v2.c3p0.ComboPooledDataSource">
    <!-- 配置连接池属性 -->
    <property name="driverClass" value="${jdbc.driver}" />
    <property name="jdbcUrl" value="${jdbc.url}" />
    <property name="user" value="${jdbc.username}" />
    <property name="password" value="${jdbc.password}" />

    <!-- c3p0连接池的私有属性 -->
    <property name="maxPoolSize" value="30" />
    <property name="minPoolSize" value="10" />
    <!-- 关闭连接后不自动commit -->
    <property name="autoCommitOnClose" value="false" />
    <!-- 获取连接超时时间 -->
    <property name="checkoutTimeout" value="10000" />
    <!-- 当获取连接失败重试次数 -->
    <property name="acquireRetryAttempts" value="2" />
  </bean>

  <!-- 3.配置SqlSessionFactory对象 -->
  <bean id="sqlSessionFactory" class="org.mybatis.spring.SqlSessionFactoryBean">
    <!-- 注入数据库连接池 -->
    <property name="dataSource" ref="dataSource" />
    <!-- 配置MyBaties全局配置文件:mybatis-config.xml -->
    <property name="configLocation" value="classpath:mybatis-config.xml" />
    <!-- 扫描entity包 使用别名 -->
    <property name="typeAliasesPackage" value="com.jiangwangxiang.entity" />
    <!-- 扫描sql配置文件:mapper需要的xml文件 -->
    <property name="mapperLocations" value="classpath:mapper/*.xml" />
  </bean>

  <!-- 4.配置扫描Dao接口包,动态实现Dao接口,注入到spring容器中 -->
  <bean class="org.mybatis.spring.mapper.MapperScannerConfigurer">
    <!-- 注入sqlSessionFactory -->
    <property name="sqlSessionFactoryBeanName" value="sqlSessionFactory" />
    <!-- 给出需要扫描Dao接口包 -->
    <property name="basePackage" value="com.jiangwangxiang.dao" />
  </bean>

</beans>

五、DAO层单元测试

@RunWith(SpringJUnit4ClassRunner.class)的意思是junit启动时加载springIOC容器

@ContextConfiguration({ "classpath:spring/spring-dao.xml", "classpath:spring/spring-service.xml" })的意思是告诉junit spring配置文件的位置

 

package com.jiangwangxiang.seckill;

import java.util.Date;
import java.util.List;

import javax.annotation.Resource;

import org.junit.Test;
import org.junit.runner.RunWith;
import org.springframework.test.context.ContextConfiguration;
import org.springframework.test.context.junit4.SpringJUnit4ClassRunner;

/**
* 配置spring和junit整合,junit启动时加载springIOC容器 spring-test,junit
*/
@RunWith(SpringJUnit4ClassRunner.class)
// 告诉junit spring配置文件
@ContextConfiguration({ "classpath:spring/spring-dao.xml" })
public class SeckillDaoTest {
  //注入Dao实现类依赖
  @Resource
  private SeckillDao seckillDao;

  @Test
  public void testQueryById() throws Exception {
    long id = 1000;
    Seckill seckill = seckillDao.queryById(id);
    System.out.println(seckill.getName());
    System.out.println(seckill);
  }

  @Test
  public void testQueryAll() throws Exception {
    List<Seckill> seckills = seckillDao.queryAll(0, 100);
    for (Seckill seckill : seckills) {
      System.out.println(seckill);
    }
  }

  @Test
  public void testReduceNumber() throws Exception {
    Date killTime = new Date();
    int updateCount = seckillDao.reduceNumber(1000L, killTime);
    System.out.println("updateCount=" + updateCount);
  }
}

 

package com.jiangwangxiang.seckill;

import java.util.Date;
import java.util.List;

import javax.annotation.Resource;

import org.junit.Test;
import org.junit.runner.RunWith;
import org.springframework.test.context.ContextConfiguration;
import org.springframework.test.context.junit4.SpringJUnit4ClassRunner;

/**
* 配置spring和junit整合,junit启动时加载springIOC容器 spring-test,junit
*/
@RunWith(SpringJUnit4ClassRunner.class)
// 告诉junit spring配置文件
@ContextConfiguration({ "classpath:spring/spring-dao.xml" })
public class SuccessKilledDaoTest {
  @Resource
  private SuccessKilledDao successKilledDao;

  @Test
  public void testInsertSuccessKilled() throws Exception {
    /**
    * 第一次:insertCount=1
    * 第二次:insertCount=0
    */
    long id = 1001;
    ong phone = 13631231234L;
    int insertCount = successKilledDao.insertSuccessKilled(id, phone);
    System.out.println("insertCount=" + insertCount);
  }

  @Test
  public void testQueryByIdWithSeckill() throws Exception {
    long id = 1001;
    long phone = 13631231234L;
    SuccessKilled successKilled = successKilledDao.queryByIdWithSeckill(id, phone);
    System.out.println(successKilled);
    System.out.println(successKilled.getSeckill());
  }
}

posted @ 2018-03-06 00:57  将王相  阅读(136)  评论(0)    收藏  举报