Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[doc] Improve the detailed explanation about how LeoFS works #532

Open
79 tasks
mocchira opened this issue Dec 7, 2016 · 2 comments
Open
79 tasks

[doc] Improve the detailed explanation about how LeoFS works #532

mocchira opened this issue Dec 7, 2016 · 2 comments
Assignees
@yosukehara @mocchira
Labels
Document Improve Priority-MIDDLE Request
Milestone
v1 docs

Comments

@mocchira
Copy link
Member

mocchira commented Dec 7, 2016 •
edited by yosukehara
Loading

Draft - How it works

  • Cluster - leofs_docs/issues/29
    • Network Toporogy
    • Monitor
    • Recover
    • Update (Attach|Detach)
      • Rebalance
      • Takeover
  • Storage
    • Raw File Format
      • Object Storage - AVS
      • Metadata Storage
        • LevelDB
      • Mnesia (used by only managers
    • Large Object
      • Children
      • Grand Children
      • Caveats
        • leo_gateway settings affect the storage layout
        • Protocol used by PUT affect the storage layout
        • Multiple leo_gateways with different mode|chunked_obj_size
    • ACID
    • Compaction
      • Concurrent
      • Pararrel
      • little bit STW
    • Detect corruption
  • Eventual Consistency
  • Anti Entropy
  • Cache on leo_gateway
    • Memory
    • Disk
  • Protocol
    • External
      • S3|REST between client and leo_gateway
      • NFS between client and leo_gateway
    • Internal
      • RPC between leo_gateway and leo_storage
      • RPC between leo_storages
      • Rebalance between leo_storages
      • Erlang RPC Limitation
      • Multi-DC replication between DCs
  • Data Flow
    • PUT/write
      • PUT via REST|S3
      • Write via NFS
    • GET/read
      • GET via REST|S3
      • Read via NFS
      • Readdir(|plus3) via NFS or listing objects via S3
  • Watchdog
    • CPU(Load)
    • Disk I/O(Bandwidth)
    • Rex
    • Erlang Internal I/O
    • Cluster
  • Security
    • Authentication
    • Access Control
    • Audit
      • Operation Log
  • Multi tenancy
@mocchira mocchira added this to the 1.3.2 milestone Dec 7, 2016
@mocchira mocchira mentioned this issue Dec 14, 2016
Open
@mocchira mocchira changed the title [doc] Improve the explanation about how settings in leo_gateway affect the disk usage [doc] Improve the detailed explanation about how LeoFS works Dec 15, 2016
@yosukehara yosukehara modified the milestones: 1.3 docs, 1.3.2 Dec 19, 2016
@mocchira mocchira mentioned this issue Dec 21, 2016
Closed
@mocchira
Copy link
Member Author

@yosukehara @windkit
Totally refactored and covered as much topics as possible based on my understanding.
feel free to add|modify contents if you find something missing|wrong.

@mocchira
Copy link
Member Author

Updated based on FB from Vladimir on ML.

  • Add file:fsync on ACID section
  • Add scrub tool on Anti Entropy section

@yosukehara yosukehara removed the v1.3 label Feb 25, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yosukehara yosukehara

@mocchira mocchira

Labels
Document Improve Priority-MIDDLE Request
Projects
None yet
Milestone
v1 docs
Development

No branches or pull requests
3 participants
@yosukehara @mocchira @windkit