Understanding virtualxid && transactionid

对pg_locks视图中的virtualxid和transactionid字段感到困惑，经查阅资料，特此在此整理一下学习内容：

pg_locks Columns

Name	Type	References	Description
locktype	text		Type of the lockable object: relation, extend, page, tuple, transactionid, virtualxid, object, userlock, or advisory
database	oid	pg_database.oid	OID of the database in which the lock target exists, or zero if the target is a shared object, or null if the target is a transaction ID
relation	oid	pg_class.oid	OID of the relation targeted by the lock, or null if the target is not a relation or part of a relation
page	integer		Page number targeted by the lock within the relation, or null if the target is not a relation page or tuple
tuple	smallint		Tuple number targeted by the lock within the page, or null if the target is not a tuple
virtualxid	text		Virtual ID of the transaction targeted by the lock, or null if the target is not a virtual transaction ID
transactionid	xid		ID of the transaction targeted by the lock, or null if the target is not a transaction ID
classid	oid	pg_class.oid	OID of the system catalog containing the lock target, or null if the target is not a general database object
objid	oid	any OID column	OID of the lock target within its system catalog, or null if the target is not a general database object
objsubid	smallint		Column number targeted by the lock (the classid and objid refer to the table itself), or zero if the target is some other general database object, or null if the target is not a general database object
virtualtransaction	text		Virtual ID of the transaction that is holding or awaiting this lock
pid	integer		Process ID of the server process holding or awaiting this lock, or null if the lock is held by a prepared transaction
mode	text		Name of the lock mode held or desired by this process (see Section 13.3.1 and Section 13.2.3)
granted	boolean		True if lock is held, false if lock is awaited
fastpath	boolean		True if lock was taken via fast path, false if taken via main lock table

 

从字义上来看，一个是虚拟事务号，一个是事务号。

实际上他们表达的意思也是不一样的，虚拟事务号由两个部分组成，分别是backendid和local transaction id。

查看src/include/storage/lock.h，可以看到对virtualxid结构的定义：

 virtualxid不是针对pg实例整体来将的。

/*
 * Top-level transactions are identified by VirtualTransactionIDs comprising
 * the BackendId of the backend running the xact, plus a locally-assigned
 * LocalTransactionId.    These are guaranteed unique over the short term,
 * but will be reused after a database restart; hence they should never
 * be stored on disk.
 *
 * Note that struct VirtualTransactionId can not be assumed to be atomically
 * assignable as a whole.  However, type LocalTransactionId is assumed to
 * be atomically assignable, and the backend ID doesn't change often enough
 * to be a problem, so we can fetch or assign the two fields separately.
 * We deliberately refrain from using the struct within PGPROC, to prevent
 * coding errors from trying to use struct assignment with it; instead use
 * GET_VXID_FROM_PGPROC().
 */
typedef struct
{
    BackendId    backendId;        /* determined at backend startup */
    LocalTransactionId localTransactionId;        /* backend-local transaction
                                                 * id */
} VirtualTransactionId;

 

本地事务号和事务号又有什么分别呢？实际上一个是用来表示本地事务的，并且本地事务号不会存储在磁盘中，只存在于内存中。而事务号则是存储在磁盘中的，属于持久化的值。

获得本地事务号的函数如下，不需要vacuum，因为不会持久化到磁盘，也不用于MVCC，所以直接轮询使用是没问题的，见如下函数：

src/backend/storage/ipc/sinvaladt.c

/*
 * GetNextLocalTransactionId --- allocate a new LocalTransactionId
 *
 * We split VirtualTransactionIds into two parts so that it is possible
 * to allocate a new one without any contention for shared memory, except
 * for a bit of additional overhead during backend startup/shutdown.
 * The high-order part of a VirtualTransactionId is a BackendId, and the
 * low-order part is a LocalTransactionId, which we assign from a local
 * counter.  To avoid the risk of a VirtualTransactionId being reused
 * within a short interval, successive procs occupying the same backend ID
 * slot should use a consecutive sequence of local IDs, which is implemented
 * by copying nextLocalTransactionId as seen above.
 */
LocalTransactionId
GetNextLocalTransactionId(void)
{
    LocalTransactionId result;

    /* loop to avoid returning InvalidLocalTransactionId at wraparound */
    do
    {
        result = nextLocalTransactionId++;
    } while (!LocalTransactionIdIsValid(result));

    return result;
}

 

那么虚拟事务号到底有什么用呢？

举一些例子，

1. 因为虚拟事务号是在内存中管理的，所以在处理锁冲突时效率更高，可以用于唯一标示发生锁冲突的事务对象。

见

src/backend/storage/lmgr/lock.c

VirtualTransactionId *
GetLockConflicts(const LOCKTAG *locktag, LOCKMODE lockmode)
{
。。。。。。

2. 同时应用于standby的查询和恢复的锁冲突标示。

3. 还可以用于标示检查点和用户执行的查询之间的锁冲突。

总的来说，虚拟事务号就是用来标示锁冲突的对象的。

 

对视图pg_locks查看，就会产生virtualxid

swrd=# select * from pg_locks where locktype = 'virtualxid';
-[ RECORD 1 ]------+--------------
locktype           | virtualxid
database           | 
relation           | 
page               | 
tuple              | 
virtualxid         | 3/6510
transactionid      | 
classid            | 
objid              | 
objsubid           | 
virtualtransaction | 3/6510
pid                | 20682
mode               | ExclusiveLock
granted            | t
fastpath           | t

swrd=# 

 As long as you query pg_locks, you in fact run a query and hence start a transaction. It needs to acquire AccessShareLock on pg_locks, for instance. That's why virtualxid is allocated.

 

参考：

http://blog.163.com/digoal@126/blog/static/16387704020156136857214

http://stackoverflow.com/questions/32996020/understanding-the-virtualxid-transaction-type-in-postgres