Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Riak mam base #452

Merged
merged 45 commits into from
Oct 13, 2015
Merged

Riak mam base #452

merged 45 commits into from
Oct 13, 2015

Conversation

michalwski
Copy link
Contributor

Adds Riak backend for MAM.
Archive is organised in weekly buckets with Riak 2.0 search to easily fetch messages.

@mongoose-im
Copy link
Collaborator

travis is using test branch riak-mam-base from https://github.com/esl/ejabberd_tests/tree/riak-mam-base

@michalwski michalwski mentioned this pull request Jun 3, 2015
Closed
@michalwski michalwski added this to the MongooseIM 1.6 milestone Sep 14, 2015
@michalwski michalwski force-pushed the riak-mam-base branch 2 times, most recently from 8b8a26c to 6a3cd65 Compare October 9, 2015 12:20
@michalwski
basic archive and lookup implementation
d9855ff
@michalwski
improve message lookup
aa92c41
@michalwski
message purging in Riak
e733ef0
@michalwski
check size of output
23733b6
@michalwski
mam archive and lookup times
1f77b1a 
Conflicts:
	apps/ejabberd/src/mongoose_metrics.erl
@michalwski
app desc as string
2ff0937
@michalwski
run mam_drop_message hook when write failed
0e6a968
@michalwski
put msgs to weekly buckets
d116c84
@michalwski
add test for puting mam messages into specific buckets
6784886
@michalwski
fold thorugh many buckets until limit or end is reached
044aa39
@michalwski
test reading archive from many buckets
9c69fcf
@michalwski
fold over all buckets
62ab210
@michalwski
correctly convert microseconds to date
fb174f1
@michalwski
extend mam in riak tests (read)
439c2b0
@michalwski
fix jid keyfileter
ff3fc51
@michalwski
return only requested number of messages
ba8104b
@michalwski
move mam lookup and archive metrics update to mod_mam
654debb
@michalwski
measure mapred time
6180bef
@michalwski
add mocking to riak_SUITE
982a647
@michalwski
fetch only required messages from MAM
4a6c85f
@michalwski
MAM buckets per user
eb97971 
in cooperation with @studzien
@michalwski
fetch only required keys
a00fbb6
@michalwski
use mapred from mongoose_riak
56235ae
@michalwski
fix mongoose_riak_stop and add search function to mongoose_riak
d1d7075
@michalwski
first version of MAM with Riak search
a55d773
@michalwski
add riak mam search scheam
be0e993
@michalwski
improve key removing
8f3d05c
@michalwski
rename search index and bucket type
3090ba5
@michalwski
minimize search schema
4933567
@michalwski
create search schema and index in setup script
ce049a7
@michalwski
only riak preset on travis
b21705e
@michalwski
wait for index to be created
439aaeb
@michalwski
add RSM functionality
31a5cbd
@michalwski
count simple lookup queries
31497d1
@michalwski
remove unused function
2facae9
@michalwski
mod_mam_riak_timed_arch_yz code clean-up
fa19595
@michalwski
remove mapred based MAM riak backend
98b356f
@michalwski
remove user buckets MAM implementation
f4726e4
@michalwski
restore other jobs on travis
bacac6d
@michalwski
fix metrcis api
58f250b
@michalwski
apply changes from esl/ejabberd_tests#120
a18df5f
@michalwski
fix dialyzer errors
27b2e8d
@michalwski
restore accidentally removed db setup on travis
112de68
@michalwski
[tests] improve mam_SUITE for riak stability
57a59c4
@michalwski michalwski force-pushed the riak-mam-base branch 2 times, most recently from 9c75e7e to 0c64e2d Compare October 12, 2015 12:58
ppikula added a commit that referenced this pull request Oct 13, 2015
@ppikula
Merge pull request #452 from esl/riak-mam-base
ff6d368 
Riak mam base
@ppikula ppikula merged commit ff6d368 into master Oct 13, 2015
@ppikula ppikula deleted the riak-mam-base branch October 13, 2015 07:27
@michalwski michalwski mentioned this pull request Oct 15, 2015
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@ppikula ppikula

Labels
None yet
Projects
None yet
Milestone
MongooseIM 1.6
Development

Successfully merging this pull request may close these issues.
3 participants
@michalwski @mongoose-im @ppikula