-
Notifications
You must be signed in to change notification settings - Fork 10
FBU Queries (PDSW19)
KDahlgren edited this page Aug 12, 2019
·
8 revisions
- Clone and build skyhook.
cd build/
- Get the data sets.
wget //
- Write a data set into a ceph object. See the following syntax.
parameter | description |
---|---|
--filename | the name of the file containing the pipe-delimited relation to save in ceph |
--write_type | rows or cols? |
--debug | yes or no? |
--schema_datatypes | comma-delimited list of data types. must match table schema |
--schema_attnames | comma-delimited list of attribute names |
--table_name | name you want to give the table |
--nrows | number of rows in the input file |
--ncols | number of columns in the input file |
--targetoid | name of the ceph object this is going to occupy |
--targetpool | name of the ceph pool to use |
--writeto | ceph or disk? |
--targetformat | SFT_FLATBUF_UNION_ROW or SFT_FLATBUF_UNION_COL? |
# FBU_Rows arity-3 1mb (50,000 rows) => obj.0
bin/fbwriter_fbu --filename dataset_arity3_50000_rows.txt --write_type rows --debug yes --schema_datatypes int,float,string --schema_attnames att0,att1,att2 --table_name arity3_1mb --nrows 50000 --ncols 3 --targetoid obj.0 --targetpool tpchflatbuf --writeto ceph --targetformat SFT_FLATBUF_UNION_ROW ;
Concepts
> Architecture
> Data formats
> > Flatbuffers
> > Arrow
> Test Integration
Tutorials
> Build
> Dev/Test environment
> Run test queries
> Ceph-SkyhookDM cluster setup
Technical Reports
> Google Summer of Code 2019 Report
> Google Summer of Code 2020 Report
> Flatbuffers and Flexbuffers access experiments
Archives
> CloudLab Ceph Deployment Notes
> Deploy Notes
> Running CloudLab Experiments
> Installing a Non Release Fork on CloudLab
> Installing with Skyhook-Ansible
> FBU Queries (PDSW19)
> Paper Experiments
> Skyhook Development on CloudLab
> Building Deb Files for Cloudlab Installs (Sp2019)
> CephFS FUSE on CloudLab