Skip to content

Commit

Permalink
deploy: 1bde5b9
Browse files Browse the repository at this point in the history
  • Loading branch information
zhjwpku committed Mar 19, 2024
1 parent 9b3ae6a commit 0b999e8
Show file tree
Hide file tree
Showing 5 changed files with 14 additions and 6 deletions.
Binary file added assets/pdfs/lower-level-driven-compaction.pdf
Binary file not shown.
4 changes: 4 additions & 0 deletions databases/kv/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -154,6 +154,10 @@ <h2 id="kv-databases"><a class="header" href="#kv-databases">kv databases</a></h
<li><strong><a href="optimizing-space-amplification-in-rocksdb.html">Optimizing Space Amplification in RocksDB</a>, 2017</strong></li>
<li><strong><a href="/assets/pdfs/fast21-dong.pdf">Evolution of Development Priorities in Key-value Stores Serving Large-scale Applications: The RocksDB Experience</a>, 2021 <a href="/assets/pdfs/rocksdb-evolution-2021.pdf">a slightly more detailed version</a></strong></li>
<li><strong><a href="wisckey.html">WiscKey: Separating Keys from Values in SSD-Conscious Storage</a>, 2016</strong></li>
</ul>
<h3 id="further-readings"><a class="header" href="#further-readings">Further readings</a></h3>
<ul>
<li><a href="/assets/pdfs/lower-level-driven-compaction.pdf">LDC: A Lower-Level Driven Compaction Method to Optimize SSD-Oriented Key-Value Stores</a>, 2019</li>
</ul>

</main>
Expand Down
12 changes: 8 additions & 4 deletions print.html
Original file line number Diff line number Diff line change
Expand Up @@ -623,6 +623,10 @@ <h3 id="思考"><a class="header" href="#思考">思考</a></h3>
<li><strong><a href="databases/kv//assets/pdfs/fast21-dong.pdf">Evolution of Development Priorities in Key-value Stores Serving Large-scale Applications: The RocksDB Experience</a>, 2021 <a href="databases/kv//assets/pdfs/rocksdb-evolution-2021.pdf">a slightly more detailed version</a></strong></li>
<li><strong><a href="databases/kv/wisckey.html">WiscKey: Separating Keys from Values in SSD-Conscious Storage</a>, 2016</strong></li>
</ul>
<h3 id="further-readings"><a class="header" href="#further-readings">Further readings</a></h3>
<ul>
<li><a href="databases/kv//assets/pdfs/lower-level-driven-compaction.pdf">LDC: A Lower-Level Driven Compaction Method to Optimize SSD-Oriented Key-Value Stores</a>, 2019</li>
</ul>
<div style="break-before: page; page-break-before: always;"></div><h3 id="a-hrefdatabaseskvassetspdfsp82-dong-cidr17pdfoptimizing-space-amplification-in-rocksdba"><a class="header" href="#a-hrefdatabaseskvassetspdfsp82-dong-cidr17pdfoptimizing-space-amplification-in-rocksdba"><a href="databases/kv/../../assets/pdfs/p82-dong-cidr17.pdf">Optimizing Space Amplification in RocksDB</a></a></h3>
<blockquote>
<p>CIDR 2017</p>
Expand Down Expand Up @@ -745,7 +749,7 @@ <h3 id="wisckey"><a class="header" href="#wisckey">WiscKey</a></h3>
files in the LSM-tree and a significant portion of the LSM-tree can be easily <strong>cached in memory</strong>.</p>
</blockquote>
<p>当然 k/v 分离也带来了一些挑战,最直观的挑战是当写入随机的键值对,然后进行 Range Query,导致查询到的 value 分布在 log file 的不同位置,文章提出用并发读来提高带宽。作者对其它挑战( Garbage Collection &amp; )也都提出了相应的解决方案,感兴趣的读者请阅读论文。</p>
<h4 id="further-readings"><a class="header" href="#further-readings">Further readings</a></h4>
<h4 id="further-readings-1"><a class="header" href="#further-readings-1">Further readings</a></h4>
<ul>
<li><a href="databases/kv//assets/pdfs/hashkv-atc18.pdf">HashKV: Enabling Efficient Updates in KV Storage via Hashing</a>, 2018. Section 2.2 对 WiscKey 的介绍值得一读</li>
</ul>
Expand Down Expand Up @@ -1562,7 +1566,7 @@ <h3 id="more-readings"><a class="header" href="#more-readings">More readings</a>
<li><strong><a href="datalayout/orc.html">Major Technical Advancements in Apache Hive</a></strong></li>
<li><strong><a href="datalayout/table-placement-methods.html">Table Placement Methods</a></strong></li>
</ul>
<h4 id="further-readings-1"><a class="header" href="#further-readings-1">Further readings</a></h4>
<h4 id="further-readings-2"><a class="header" href="#further-readings-2">Further readings</a></h4>
<p>[1] <a href="http://dbmsmusings.blogspot.com/2017/10/apache-arrow-vs-parquet-and-orc-do-we.html">Apache Arrow vs. Parquet and ORC: Do we really need a third Apache project for columnar data representation?</a> by Daniel Abadi, 2017<br></p>
<div style="break-before: page; page-break-before: always;"></div><h3 id="a-hrefdatalayoutassetspdfscstore-vldb05pdfc-store-a-column-oriented-dbmsa"><a class="header" href="#a-hrefdatalayoutassetspdfscstore-vldb05pdfc-store-a-column-oriented-dbmsa"><a href="datalayout/../assets/pdfs/cstore-vldb05.pdf">C-Store: A Column-oriented DBMS</a></a></h3>
<blockquote>
Expand Down Expand Up @@ -2443,7 +2447,7 @@ <h4 id="references-8"><a class="header" href="#references-8">References:</a></h4
<li><strong><a href="distributedsystem/consensus/raft.html">In Search of an Understandable Consensus Algorithm</a></strong></li>
<li><strong><a href="distributedsystem/consensus/paxos-vs-raft.html">Paxos vs Raft: have we reached consensus on distributed consensus?</a></strong></li>
</ul>
<h4 id="further-readings-2"><a class="header" href="#further-readings-2">Further readings</a></h4>
<h4 id="further-readings-3"><a class="header" href="#further-readings-3">Further readings</a></h4>
<p>[1] <a href="distributedsystem/consensus/../../assets/pdfs/disk-paxos.pdf">Disk Paxos</a> by Eli Gafni &amp; Leslie Lamport, 2002<br>
[2] <a href="distributedsystem/consensus/../../assets/pdfs/paxos-abcd.pdf">The ABCD’s of Paxos</a> by Butler W. Lampson, PODC 2001<br>
[3] Paxos for System Builders: <a href="distributedsystem/consensus/../../assets/pdfs/paxos-for-system-builders-an-overview.pdf">An Overview</a> and <a href="distributedsystem/consensus/../../assets/pdfs/paxos_for_system_builders.pdf">The Complete Specification</a> by Yair Amir and Jonathan Kirsch, 2008<br>
Expand Down Expand Up @@ -3125,7 +3129,7 @@ <h4 id="evaluating-global-predicates"><a class="header" href="#evaluating-global
<p>由于相对较难理解,还没深入看 :()</p>
<h4 id="detecting-behavioral-patterns"><a class="header" href="#detecting-behavioral-patterns">Detecting Behavioral Patterns</a></h4>
<p>由于相对较难理解,还没深入看 :()</p>
<h4 id="further-readings-3"><a class="header" href="#further-readings-3">Further readings</a></h4>
<h4 id="further-readings-4"><a class="header" href="#further-readings-4">Further readings</a></h4>
<p>[1] <a href="https://fileadmin.cs.lth.se/cs/Personal/Amr_Ergawy/dist-algos-papers/4.pdf">Timestamps in Message-Passing Systems That Preserve the Partial Ordering</a></p>
<div style="break-before: page; page-break-before: always;"></div><h3 id="a-hrefdistributedsystemassetspdfschandypdfdistributed-snapshots-determining-global-states-of-distributed-systemsa"><a class="header" href="#a-hrefdistributedsystemassetspdfschandypdfdistributed-snapshots-determining-global-states-of-distributed-systemsa"><a href="distributedsystem/../assets/pdfs/chandy.pdf">Distributed Snapshots: Determining Global States of Distributed Systems</a></a></h3>
<blockquote>
Expand Down
2 changes: 1 addition & 1 deletion searchindex.js

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion searchindex.json

Large diffs are not rendered by default.

0 comments on commit 0b999e8

Please sign in to comment.