摘要: Pytorch Transformer 中 Position Embedding 的实现 The Positional Encoding part in Transformer is a special part, it isn't part of the network module, it is 阅读全文
posted @ 2021-08-26 11:48 虾野百鹤 阅读(4355) 评论(0) 推荐(0)
摘要: 树状数组及其实现 引言 树状数组也是一种通过数组来表示树的结构,我们所熟悉的堆与完全二叉树通常也会使用这种方式实现,即,使用数组来表示树。至于完全二叉树(堆是一种特殊的完全二叉树),树中元素之间的关系较为简单,主要是父节点与子节点之间的关系,这种关系在数组中我们可以通过下标来实现。例如,如果用数组表 阅读全文
posted @ 2021-08-24 10:14 虾野百鹤 阅读(197) 评论(0) 推荐(0)
摘要: Leetcode Ugly Number The Problem Ugly Number II and Super Ugly Number , because I didn't write the Ugly Number I, so, I don't have any idea at first. 阅读全文
posted @ 2021-08-17 11:44 虾野百鹤 阅读(39) 评论(0) 推荐(0)
摘要: This Lab is mainly the part of the file system in the JOS. It is mainly related to the disk related to file storage, and the form of file storage on t 阅读全文
posted @ 2020-07-17 12:26 虾野百鹤 阅读(364) 评论(0) 推荐(0)
摘要: Copy-on-Write Fork As mentioned earlier, Unix provides the fork() system call as its primary process creation primitive. The fork() system call copies 阅读全文
posted @ 2020-07-14 16:48 虾野百鹤 阅读(708) 评论(0) 推荐(0)
摘要: Introduction In part A we should add multiprocessor support to JOS, implement round-robin scheduling, and add basic environment management system call 阅读全文
posted @ 2020-07-11 21:47 虾野百鹤 阅读(387) 评论(0) 推荐(0)
摘要: Monte Carlo Integration Monte Carlo integration uses a different perspective from Quadrature Integration to consider the problem of integration. Quadr 阅读全文
posted @ 2020-06-12 22:46 虾野百鹤 阅读(555) 评论(0) 推荐(0)
摘要: A strategy to quantify embedding layer Basic idea Embedding is mainly in the process of word pre-training. Two embedding methods, word2vec and GloVe, 阅读全文
posted @ 2020-06-11 10:04 虾野百鹤 阅读(169) 评论(0) 推荐(0)
摘要: From DFA to KMP algorithm DFA In the theory of computation, a branch of theoretical computer science, a deterministic finite automaton (DFA)—also know 阅读全文
posted @ 2020-06-05 14:26 虾野百鹤 阅读(444) 评论(0) 推荐(0)
摘要: A problem of dimension in Vector Space and It's nullspace A easy Problem This problem from a lemma that is Dimension Counting Theorem \[ dim(V) + dim( 阅读全文
posted @ 2020-05-30 07:26 虾野百鹤 阅读(134) 评论(0) 推荐(0)