Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

merge from facebook/rocksdb #5

Merged
merged 121 commits into from
Dec 17, 2019
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
121 commits
Select commit Hold shift + click to select a range
aa63abf
Auto-GarbageCollect on PurgeOldBackups and DeleteBackup (#6015)
pdillinger Nov 9, 2019
8e7aa62
BlobDB: Maintain mapping between blob files and SSTs (#6020)
ltamasi Nov 11, 2019
c17384f
Cascade TTL Compactions to move expired key ranges to bottom levels f…
sagar0 Nov 11, 2019
f29e6b3
bugfix: MemTableList::RemoveOldMemTables invalid iterator after remov…
Nov 11, 2019
03ce7fb
Fix a buffer overrun problem in BlockBasedTable::MultiGet (#6014)
Nov 12, 2019
a19de78
db_stress to cover SeekForPrev() (#6022)
siying Nov 12, 2019
6c7b1a0
Batched MultiGet API for multiple column families (#5816)
Nov 12, 2019
42b5494
Fix BloomFilterPolicy changes for unsigned char (ARM) (#6024)
pdillinger Nov 12, 2019
bb23bfe
Fix a regression bug on total order seek with prefix enabled and rang…
siying Nov 13, 2019
f382f44
fix typo (#6025)
4fath Nov 13, 2019
f059c7d
New Bloom filter implementation for full and partitioned filters (#6007)
pdillinger Nov 14, 2019
e8e7fb1
More fixes to auto-GarbageCollect in BackupEngine (#6023)
pdillinger Nov 14, 2019
6123611
crash_test: use large max_manifest_file_size most of the time. (#6034)
siying Nov 14, 2019
00d58a3
Abandon use of folly::Optional (#6036)
pdillinger Nov 14, 2019
0058dae
Disable SmallestUnCommittedSeq in Valgrind run (#6035)
Nov 14, 2019
f65ec09
Fix IngestExternalFile's bug with two_write_queue (#5976)
Little-Wallace Nov 15, 2019
5b9233b
Fix a test failure on systems that don't have Snappy compression libr…
Nov 18, 2019
a150604
db_stress to cover total order seek (#6039)
siying Nov 18, 2019
279c488
Mark blob files not needed by any memtables/SSTs obsolete (#6032)
ltamasi Nov 19, 2019
ac498cd
Remove a few unnecessary includes
pdillinger Nov 19, 2019
38cc611
Fix test failure in LITE mode (#6050)
Nov 19, 2019
20b48c6
Fix blob context when db_iter uses seek (#6051)
tabokie Nov 19, 2019
4e0dcd3
db_stress sometimes generates keys close to SST file boundaries (#6037)
siying Nov 19, 2019
019eb1f
Disable blob iterator test with max_sequential_skip_in_iterations==0 …
ltamasi Nov 19, 2019
ec3e3c3
Fix corruption with intra-L0 on ingested files (#5958)
Little-Wallace Nov 19, 2019
0306e01
Fixes for g++ 4.9.2 compatibility (#6053)
pdillinger Nov 19, 2019
27ec3b3
Sanitize input in DB::MultiGet() API (#6054)
siying Nov 20, 2019
3cd7573
Add operator[] to autovector::iterator_impl. (#6047)
StephanTLavavej Nov 20, 2019
c0983d0
Add asserts in transaction example (#6055)
nccx Nov 20, 2019
0ce0edb
Fix a data race between GetColumnFamilyMetaData and MarkFilesBeingCom…
riversand963 Nov 21, 2019
e50b64b
fix unstable unittest caused by #5958 (#6061)
Little-Wallace Nov 21, 2019
adcf920
Compatible changes for cmake (#6045)
Nov 22, 2019
d8c28e6
Support options.ttl with options.max_open_files = -1 (#6060)
siying Nov 23, 2019
75dfc78
Fix the constness issues around autovector::iterator_impl's dereferen…
ltamasi Nov 23, 2019
669ea77
Support ttl in Universal Compaction (#6071)
sagar0 Nov 23, 2019
0bc8744
Update HISTORY.md for forward compatibility (#6085)
siying Nov 25, 2019
fcd7e03
Ignore value of BackupableDBOptions::max_valid_backups_to_open when B…
sebastianopeluso Nov 25, 2019
77eab5c
Make default value of options.ttl to be 30 days when it is supported.…
siying Nov 26, 2019
382b154
Update 3rd-party libraries used by RocksJava (#6084)
adamretter Nov 26, 2019
4f17d33
Remove unused/undefined ImmutableCFOptions() (#6086)
pdillinger Nov 26, 2019
7f14519
Small improvements to Docker build for RocksJava (#6079)
adamretter Nov 26, 2019
1bf316e
Fix naming of library on PPC64LE (#6080)
adamretter Nov 26, 2019
771e172
Use lowercase for shlwapi.lib rpcrt4.lib (#6076)
Ericson2314 Nov 26, 2019
72daa92
Refactor blob file creation logic (#6066)
ltamasi Nov 26, 2019
57f3032
Allow fractional bits/key in BloomFilterPolicy (#6092)
pdillinger Nov 26, 2019
d9314a9
Refactor and clean up the code that reads a blob from a file (#6093)
ltamasi Nov 27, 2019
8ae149e
Add shared library for musl-libc (#3143)
double16 Nov 27, 2019
6d58ea9
Fix compilation under MSVC VS2015 (#6081)
adamretter Nov 27, 2019
ca3b6c2
Expose and elaborate FilterBuildingContext (#6088)
pdillinger Nov 27, 2019
496a6ae
Fix HISTORY.md for 6.6.0 (#6096)
Nov 27, 2019
aa1857e
Support options.max_open_files = -1 with periodic_compaction_seconds …
siying Nov 27, 2019
c16b087
Work around weird unused errors with Mingw (#6075)
Ericson2314 Nov 27, 2019
0695793
Update format_version comment for 6.6.0
pdillinger Nov 27, 2019
9befbe9
fix typo (#6099)
acelyc111 Nov 27, 2019
a61ec9a
Fix BlobDB compilation on older GCC versions
adamretter Nov 27, 2019
f19faf7
Add format_version=5 to db_crashtest (#6102)
pdillinger Nov 27, 2019
09fcf4f
Fix a potential bug scheduling unnecessary threads (#6104)
riversand963 Nov 27, 2019
e8f997c
Update comment on max_valid_backups_to_open (#6105)
pdillinger Nov 27, 2019
048472f
Add missing DataBlock-releated functions to the C-API (#6101)
dvdplm Dec 2, 2019
16fa6fd
Remove key length assertion LRUHandle::CalcTotalCharge (#6115)
Dec 2, 2019
fe1147d
Let DBSecondary close files after catch up (#6114)
riversand963 Dec 3, 2019
f32a311
Fix compliation error on GCC4.8.2 (#6106)
Connor1996 Dec 3, 2019
4edb428
Make folly-related targets comply with verbosity (#6120)
riversand963 Dec 4, 2019
cdc431e
build_tools/precommit_checker.py: don't hard-code a platform-afflicte…
meyering Dec 5, 2019
100b5e6
Fix build failure for db_stress tool when building with CMake (#6117)
simpkins Dec 5, 2019
ad528fe
Disable folly_synchronization_distributed_mutex_test on ARM for now (…
pdillinger Dec 5, 2019
6db57bc
Disable new Bloom filter assertion (#6128)
pdillinger Dec 6, 2019
e3a82bb
PosixRandomAccessFile::MultiRead() to use I/O uring if supported (#5881)
siying Dec 8, 2019
bac38c9
Isolate building db_bench from tests with `WITH_BENCHMARK_TOOLS` opti…
Dec 9, 2019
7d79b32
Break db_stress_tool.cc to a list of source files (#6134)
siying Dec 9, 2019
3a6d943
Use SpecialSkipListFactory in RecalculateScoreAfterPicking (#6125)
pdillinger Dec 9, 2019
d1ae2c3
Fix an asan warning caused by the recent io_uring change (#6135)
siying Dec 9, 2019
7e2f831
Fix wrong ExtractUserKey usage in BlockBasedTableBuilder::EnterUnbuff…
yzygitzh Dec 9, 2019
3c34782
Fix thread_local_test failure caused by recent io_uring change (#6136)
siying Dec 9, 2019
e43d2c4
Fix & test rocksdb_filterpolicy_create_bloom_full (#6132)
pdillinger Dec 9, 2019
a960287
db_stress: Some code style improvements (#6137)
siying Dec 9, 2019
a68dff5
Apply formatter to some recent commits (#6138)
siying Dec 9, 2019
6380df5
Vary bloom_bits in db_crashtest (#6103)
pdillinger Dec 10, 2019
1dd3194
Fix compile error "folly/xx.h file not found" on Mac OS (#6145)
javeme Dec 10, 2019
14c38ba
db_stress: sometimes validate compact range data (#6140)
siying Dec 10, 2019
2b060c1
Use Env::GetChildren() instead of readdir (#6139)
riversand963 Dec 10, 2019
2bb5fc1
Add an option to the CMake build to disable building shared libraries…
simpkins Dec 10, 2019
a653857
Add PauseBackgroundWork() to db_stress (#6148)
pdillinger Dec 10, 2019
984b6e7
Add Visual Studio 2015 to AppVeyor (#5446)
adamretter Dec 11, 2019
7a99162
db_stress: sometimes call CancelAllBackgroundWork() and Close() befor…
siying Dec 11, 2019
383f507
Add SyncWAL to db_stress (#6149)
riversand963 Dec 11, 2019
77565d7
Add example to show the effect of Get in snapshot isolation (#6059)
nccx Dec 11, 2019
05a8631
Remove unused low_pri_write_rate_limiter_ (#6068)
Dec 11, 2019
afdc58d
Fix typos in history
ferhatelmas Dec 11, 2019
3717a88
Fix UniversalCompaction trivial move bug (#6067)
mm304321141 Dec 11, 2019
d0ad3c5
Fix c_test:filter for various CACHE_LINE_SIZEs (#6153)
pdillinger Dec 11, 2019
1ad6fa9
Enable txn in crash tests (#6155)
Dec 11, 2019
e1dfe80
Mark BlobIndex::DebugString const
ltamasi Dec 12, 2019
8613ee2
Enable all txn write policies in crash test (#6158)
Dec 12, 2019
3b60761
Do not update SST <-> blob file mapping if compaction failed
ltamasi Dec 12, 2019
b433bbe
Add missing mutable DBOptions to RocksJava (#6152)
adamretter Dec 12, 2019
a796c06
Fix build breakage from lock_guard error (#6161)
Dec 12, 2019
814d4e7
Improve instructions to install formatter (#6162)
siying Dec 12, 2019
a844591
wait pending memtable writes on file ingestion or compact range (#6113)
Connor1996 Dec 12, 2019
c4ce8e6
Fix RangeDeletion bug (#6062)
mm304321141 Dec 12, 2019
4b74035
Correct java docs of RocksDB options (#6123)
Myasuka Dec 13, 2019
c2029f9
Support concurrent CF iteration and drop (#6147)
javeme Dec 13, 2019
583c695
Move out valid blobs from the oldest blob files during compaction (#6…
ltamasi Dec 13, 2019
fec7302
Enable unordered_write in stress tests (#6164)
Dec 13, 2019
ac304ad
cmake: do not build tests for Release build and cleanups (#5916)
tchaikov Dec 13, 2019
6d54eb3
Do not create/install new SuperVersion if nothing was deleted during …
ltamasi Dec 13, 2019
58d46d1
Add useful idioms to Random API (OneInOpt, PercentTrue) (#6154)
pdillinger Dec 13, 2019
afa2420
Introduce a new storage specific Env API (#5761)
Dec 13, 2019
0d2172f
Make it possible to enable periodic compactions for BlobDB (#6172)
ltamasi Dec 13, 2019
edbf0e2
Env should also load the native library (#6167)
adamretter Dec 14, 2019
349bd3e
CancelAllBackgroundWork before Close in db stress (#6174)
Dec 14, 2019
bd8404f
Do not schedule memtable trimming if there is no history (#6177)
ltamasi Dec 14, 2019
4b97812
Add long-running snapshots to stress tests (#6171)
Dec 14, 2019
ad34fab
Fix unity test (#6178)
Dec 14, 2019
a92bd0a
Optimize memory and CPU for building new Bloom filter (#6175)
pdillinger Dec 16, 2019
db7c687
Fix a data race related to memtable trimming (#6187)
ltamasi Dec 16, 2019
fbda25f
db_stress: generate the key based on Zipfian distribution (hot key) (…
zhichao-cao Dec 16, 2019
35126dd
db_stress: preserve all historic manifest files (#6142)
siying Dec 16, 2019
2d095b4
Update HISTORY.md with the recent memtable trimming fixes
ltamasi Dec 16, 2019
bcc372c
Add some new options to crash_test (#6176)
siying Dec 16, 2019
cddd637
Merge adjacent file block reads in RocksDB MultiGet() and Add uncompr…
zhichao-cao Dec 16, 2019
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .travis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ matrix:
# https://docs.travis-ci.com/user/caching/#ccache-cache
install:
- if [ "${TRAVIS_OS_NAME}" == osx ]; then
brew install ccache zstd lz4 snappy xz;
brew install ccache gflags zstd lz4 snappy xz;
PATH=$PATH:/usr/local/opt/ccache/libexec;
fi
- if [ "${JOB_NAME}" == cmake-gcc8 ]; then
Expand Down Expand Up @@ -113,7 +113,7 @@ script:
;;
cmake-mingw)
sudo update-alternatives --set x86_64-w64-mingw32-g++ /usr/bin/x86_64-w64-mingw32-g++-posix;
mkdir build && cd build && cmake -DJNI=1 .. -DCMAKE_C_COMPILER=x86_64-w64-mingw32-gcc -DCMAKE_CXX_COMPILER=x86_64-w64-mingw32-g++ -DCMAKE_SYSTEM_NAME=Windows && make -j4 rocksdb rocksdbjni
mkdir build && cd build && cmake -DJNI=1 -DWITH_GFLAGS=OFF .. -DCMAKE_C_COMPILER=x86_64-w64-mingw32-gcc -DCMAKE_CXX_COMPILER=x86_64-w64-mingw32-g++ -DCMAKE_SYSTEM_NAME=Windows && make -j4 rocksdb rocksdbjni
;;
cmake*)
mkdir build && cd build && cmake -DJNI=1 .. -DCMAKE_BUILD_TYPE=Release && make -j4 rocksdb rocksdbjni
Expand Down
Loading