Skip to content

This repository contains information about graph processing.

Notifications You must be signed in to change notification settings

dnasc/graph-processing

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 

Repository files navigation

Graph Processing Platforms

Efficient processing of large graphs is challenging. With current data availability, real network traces are increasing in variety and volume, making it imperative to design solutions and systems based on parallel and distributed technologies. High-performance methodologies have the potential to benefit the graph processing community in much the same way they have advanced scientific computing. However, despite the success of high-performance computing in demanding scientific applications, graph analytics faces unique difficulties due to its data-driven nature, such as a high data-access to computing ratio and poor memory access locality.

Moreover, as the complexity of analysis increases, developing new solutions from scratch becomes increasingly demanding. This necessity underscores the importance of adopting software platforms—such as DBMS, frameworks, and libraries—to ease the development burden. Consequently, many data-oriented and graph-specific platforms have been proposed. We estimate that there are currently more than 180 platforms available for use in graph analytic tasks.

Platform Reference Year
LUMOS: Dependency-Driven Disk-based Graph Processing 2019
Fbsgraph: Accelerating Asynchronous Graph Processing Via Forward And Backward Sweeping 2018
GrapH: Traffic-Aware Graph Processing 2018
GraphD: Distributed Vertex-Centric Graph Processing Beyond The Memory Limit 2018
HyVE: Hybrid Vertex-Edge Memory Hierarchy For Energy-Efficient Graph Processing 2018
L-Powergraph: A Lightweight Distributed Graph-Parallel Communication Mechanism 2018
La3: A Scalable Link- And Locality-Aware Linear Algebra-Based Graph Analytics System 2018
Lazygraph: Lazy Data Coherency For Replicas In Distributed Graph-Parallel Computation 2018
SHMEMGraph: Efficient And Balanced Graph Processing Using One-Sided Communication 2018
Turbograph++: A Scalable And Fast Graph Analytics System 2018
Wonderland: A Novel Abstraction-Based Out-Of-Core Graph Processing System 2018
A Distributed Multi-GPU System For Fast Graph Processing 2017
BlockGraphChi: Enabling Block Update In Out-Of-Core Graph Processing 2017
Cypher-Based Graph Pattern Matching In Gradoop 2017
Foregraph Exploring Large Scale Graph Processing On Multi FPGA Architecture 2017
Frog: Asynchronous Graph Processing On Gpu With Hybrid Coloring Model 2017
G-Thinker: Big Graph Mining Made Easier And Faster 2017
Graphene: Fine-Grained Io Management For Graph Computing 2017
Graphflow: An Active Graph Database 2017
GraphH High Performance Big Graph Analytics In Small Clusters 2017
Graphmp An Efficient Semi External Memory Big Graph Processing System On A Single Machine 2017
GraphR Accelerating Graph Processing Using ReRAM 2017
Groute: An Asynchronous Multi-GPU Programming Model For Irregular Computations 2017
Hieroglyph: Locally-Sufficient Graph Processing Via Compute-Sync-Merge 2017
High Performance Graph Processing With Locality Oriented Design 2017
IncPregel: An Incremental Graph Parallel Computation Model 2017
Julienne A Framework For Parallel Graph Algorithms Using Work Efficient Bucketing 2017
Mosaic Processing A Trillion Edge Graph On A Single Machine 2017
Parallelizing Sequential Graph Computations 2017
Squeezing Out All The Value Of Loaded Data: An Out-Of-Core Graph Processing System With Reduced Disk IO 2017
Tink, A Temporal Graph Analytics Library For Apache Flink 2017
Tux2 Distributed Graph Computation For Machine Learning 2017
Wolfpath: Accelerating Iterative Traversing-Based Graph Processing Algorithms On GPU 2017
A Distributed Graph Parallel Computing System With Lightweight Communication Overhead 2016
An Edge Set Based Large Scale Graph Processing System 2016
Bladyg A Novel Block Centric Framework For The Analysis Of Large Dynamic Graphs 2016
DD-Graph A Highly Cost Effective Distributed Disk Based Graph Processing Framework 2016
Distributed Graph Processing An Approach Based On Overlay Composition 2016
epiCG A Graphunit Based Graph Processing Engine On epiC 2016
Exploring The Hidden Dimension In Graph Processing 2016
FOG: A Fast Out-Of-Core Graph Processing Framework 2016
G-Store: High-Performance Graph Store For Trillion-Edge Processing 2016
Gemini A Computation Centric Distributed Graph Processing System 2016
Grafalgo - A Library Of Graph Algorithms And Supporting Data Structures (revised) 2016
Graphframes An Integrated API For Mixing Graph And Relational Queries 2016
Graphicionado: A High Performance And Energy Efficient Accelerator For Graph Analytics 2016
Graphillion Software Library For Very Large Sets Of Labeled Graphs 2016
GraphIn: An Online High Performance Incremental Graph Processing Framework 2016
Graphine: Programming Graph Parallel Computation Of Large Natural Graphs For Multicore Clusters 2016
GraphP: Reducing Communication For Pim-Based Graph Processing With Efficient Data Partition 2016
GraphPad: Optimized Graph Primitives For Parallel And Distributed Platforms 2016
GraVF: A Vertex-Centric Distributed Graph Processing Framework On FPGAs 2016
GTS A Fast And Scalable Graph Processing Method Based On Streaming Topology To GPUs 2016
Gunrock: A High Performance Graph Processing Library On The GPU 2016
Husky: Towards A More Efficient And Expressive Distributed Computing Framework 2016
Hygraph: Fast Graph Processing On Hybrid Cpu-Gpu Platforms By Dynamic Load-Balancing 2016
LCC-Graph: A High Performance Graph Processing Framework With Low Communication Costs 2016
M-Flash Fast Billion Scale Graph Computation Using A Bimodal Block Processing Model 2016
Mini-Gunrock: A Lightweight Graph Analytics Framework On The GPU 2016
Mizan-RMA: Accelerating Mizan Graph Processing Framework With MPI RMA 2016
Quegel A General Purpose Query Centric Framework For Querying Big Graphs 2016
SGraph: A Distributed Streaming System For Processing Big Graphs 2016
SNAP: A General-Purpose Network Analysis and Graph-Mining Library 2016
SystemML: Declarative Machine Learning on Spark 2016
Arabesque A System For Distributed Graph Mining 2015
Chaos Scale Out Graph Processing From Secondary Storage 2015
Effective Techniques For Message Reduction And Load Balancing In Distributed Graph Computation 2015
Efficient Graph Computation On Hybrid Cpu And Gpu Systems 2015
Expregel A New Computational Model For Large Scale Graph Processing 2015
Giraph Unchained: Barrierless Asynchronous Parallel Execution In Pregel-Like Graph Processing Systems 2015
Gram Scaling Graph Computation To The Trillions 2015
Graphmat High Performance Graph Analytics Made Productive 2015
Graphq Graph Query Processing With Abstraction Refinement Scalable And Programmable Analytics Over Very Large Graphs On A Single Pc 2015
Graphreduce Processing Large Scale Graphs On Accelerator Based Systems 2015
Graphs Matrices And The Graphblas Seven Good Reasons 2015
Graphtwist: Fast Iterative Graph Computation With Two-Tier Optimizations 2015
Graphulo: Linear Algebra Graph Kernels For Nosql Databases 2015
Graphz A Key Value Store Based Scalable Graph Processing System 2015
Gridgraph Large Scale Graph Processing On A Single Machine Using 2 Level Hierarchical Partitioning 2015
HAGP A Hub Centric Asynchronous Graph Processing Framework For Scale Free Graph 2015
High Performance Graph Analytics On Manycore Processors 2015
MIPS A Graph Mining Library 2015
NScale Neighborhood Centric Analytics On Large Graphs 2015
NUMA-Aware Graph Structured Analytics 2015
NXgraph An Efficient Graph Processing System On A Single Machine 2015
PGX.D A Fast Distributed Graph Processing Engine 2015
Ringo Interactive Graph Analytics On Big Memory Machines 2015
ScaleGraph : A High-Performance Library For Billion-Scale Graph Analytics 2015
Smaller And Faster Parallel Processing Of Compressed Graphs With Ligra+ 2015
Sync Or Async Time To Fuse For Distributed Graph Parallel Computation 2015
The Gremlin Graph Traversal Machine And Language 2015
Venus Vertex Centric Streamlined Graph Computation On A Single PC 2015
An Efficient Graph Data Processing System For Large Scale Social Network Service Applications 2014
Blogel: A Block Centric Framework For Distributed Computation On Real World Graphs 2014
BPP: Large Graph Storage For Efficient Disk-Based Processing 2014
Chronos: A Graph Engine For Temporal Graph Analysis 2014
Computation And Communication Efficient Graph Processing With Distributed Immutable View 2014
epiC: An Extensible And Scalable System For Processing Big Data 2014
Explore Efficient Data Organization For Large Scale Graph Analytics And Storage 2014
Flashgraph Processing Billion Node Graphs On An Array Of Commodity SSDs 2014
GasCL: A Vertex Centric Graph Model For GPUs 2014
GoFFish A Sub Graph Centric Framework For Large Scale Graph Analytics 2014
Graph Analytics Using The Vertica Relational Database 2014
GraphGen: An FPGA Framework For Vertex-Centric Graph Computation 2014
GraphHP: A Hybrid Platform For Iterative Graph Processing 2014
Large Scale Graph Analytics In Aster 6 Bringing Context To Big Data Discovery 2014
Managing Large Graphs On Multi-Cores With Graph Awareness 2014
MOCgraph: Scalable Distributed Graph Processing Using Message Online Computing 2014
Networkit: A Tool Suite For Large Scale Complex Network Analysis 2014
PathGraph: A Path Centric Graph Processing System 2014
Replication-Based Fault-Tolerance For Large-Scale Graph Processing 2014
Scalable SIMD-Efficient Graph Processing On GPUs 2014
Seraph: An Efficient, Low-Cost System For Concurrent Graph Processing 2014
A Lightweight Infrastructure For Graph Analytics 2013
BC-BSP: A BSP-Based Parallel Iterative Processing System For Big Data On Cloud Architecture 2013
From Think Like A Vertex To Think Like A Graph 2013
Giraphx: Parallel Yet Serializable Large-Scale Graph Processing 2013
GPS: A Graph Processing System 2013
GraphX: Graph Processing In A Distributed Dataflow Framework 2013
GRE: A Graph Runtime Engine For Large-Scale Distributed Graph-Parallel Applications 2013
LFGraph: Simple And Fast Distributed Graph Analytics 2013
Ligra: A Lightweight Graph Processing Framework For Shared Memory 2013
Medusa Simplified Graph Processing On GPUs 2013
MMap: Fast Billion-Scale Graph Computation On A PC Via Memory Mapping 2013
Naiad: A Timely Dataflow System 2013
PAGE: A Partition Aware Engine For Parallel Graph Computation 2013
PowerLyra: Differentiated Graph Computation And Partitioning On Skewed Graphs 2013
Pregelix Bigger Graph Analytics On A Dataflow Engine 2013
Presto: Distributed Machine Learning And Graph Processing With Sparse Matrices 2013
Scale-Up Graph Processing: A Storage-Centric View 2013
Scalegraph A High Performance Library For Billion Scale Graph Analytics 2013
SociaLite: Datalog Extensions For Efficient Social Network Analysis 2013
The Graph Story Of The Sap HANA Database 2013
Towards Gpu-Accelerated Large-Scale Graph Processing In The Cloud 2013
TripleBit: A Fast And Compact System For Large Scale RDF Data 2013
Turbograph: A Fast Parallel Graph Engine Handling Billion Scale Graphs In A Single PC 2013
X-Stream: Edge-Centric Graph Processing Using Streaming Partitions 2013
A GPU Implementation Of Generalized Graph Processing Algorithm GIM-V 2012
Asynchronous Large-Scale Graph Processing Made Easy 2012
Giraph Unchained: Barrierless Asynchronous Parallel Execution In Pregel Like Graph Processing Systems 2012
GraphChi: Large Scale Graph Computation On Just A PC 2012
Green-Marl: A DSL For Easy And Efficient Graph Analysis 2012
Kineograph: Taking The Pulse Of A Fast Changing And Connected World 2012
Maiter: An Asynchronous Graph Processing Framework For Delta-Based Accumulative Iterative Computation 2012
Managing Large Graphs On Multi Cores With Graph Awareness 2012
Mizan: A System For Dynamic Load Balancing In Large Scale Graph Processing 2012
On Graphs, GPUS, And Blind Dating: A Workload To Processor Matchmaking Quest 2012
Powergraph: Distributed Graph Parallel Computation On Natural Graphs 2012
Resilient Distributed Datasets: A Fault Tolerant Abstraction For In Memory Cluster Computing 2012
STINGER: High Performance Data Structure For Streaming Graphs 2012
The STAPL Parallel Graph Library 2012
Trinity: A Distributed Graph Engine On A Memory Cloud 2012
A Flexible Open Source Toolbox For Scalable Complex Graph Analysis 2011
CIEL: A Universal Execution Engine For Distributed Data-Flow Computing 2011
DisNet: A Framework For Distributed Graph Computation 2011
GBASE: An Efficient Analysis Platform For Large Graphs 2011
HipG: Parallel Processing Of Large-Scale Graphs 2011
Hyracks: A Flexible And Extensible Foundation For Data Intensive Computing 2011
Ihadoop: Asynchronous Iterations For Mapreduce 2011
iMapReduce: A Distributed Computing Framework For Iterative Computation 2011
MapReduce in MPI for Large-scale graph algorithms 2011
MapReduce: simplified data processing on large clusters 2011
Parallelizing Machine Learning– Functionally: A Framework And Abstractions For Parallel Graph Processing 2011
Piccolo: Building Fast, Distributed Programs With Partitioned Tables 2011
Priter: A Distributed Framework For Prioritized Iterative Computations 2011
The Combinatorial Blas Design Implementation And Applications 2011
GraphLab: A New Framework For Parallel Machine Learning 2010
Haloop: Efficient Iterative Data Processing On Large Clusters 2010
Hama: An Efficient Matrix Computation With The Mapreduce Framework 2010
HypergraphDB: A Generalized Graph Database 2010
Infinitegraph: The Distributed Graph Database 2010
Nephele/PACTs: A Programming Model And Execution Framework For Web Scale Analytical Processing 2010
On The Efficiency And Programmability Of Large Graph Processing In The Cloud 2010
Pregel: A System For Large Scale Graph Processing 2010
Signal-Collect: Graph Algorithms For The (Semantic) Web 2010
Twister: A Runtime For Iterative Mapreduce 2010
PEGASUS: Mining Peta Scale Graphs 2009
The Stratosphere Platform For Big Data Analytics 2009
Dryad Distributed Data Parallel Programs From Sequential Building Blocks 2007
RDF Support In The Virtuoso DBMS 2007
Software And Algorithms For Graph Queries On Multithreaded Architectures 2007
The Parallel BGL: A Generic Library For Distributed Graph Computations 2005
The Boost Graph Library 2002

About

This repository contains information about graph processing.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published