This project is dicontinued. Although it was able to be faster than the default shared implementation, it's not faster than Kestrel's pool. More reasoning: https://blog.scooletz.com/2018/08/14/thruster-building-a-not-so-fast-memory-pool/

Thruster

Thruster is a fast and efficient implementation of a MemoryPool<T>

Design principles

Thruster is based on (some) understanding on nowadays CPUs and low level APIs provided by .NET. The most important desing principles are:

• padding - expanding an object or an array, to reduce a possibility of using the same CPU cache line by threads being run on different CPUs
• region memory mangagement - leasing chunks of memory from a specific region, which allows use of in-region addressing (offset, region number)
• no locks - for claiming and releasing memory when no resize is needed
• efficient data encoding - bitmasks used for leasing, are designed to use 1 CAS operation for renting (when no collisions) and one, branchless unconditional Interlocked.Add to release

Benchmarks

Some single threaded benchmarks run with awesome BenchmarkDotNet. The nesting level represents multiple .Rent operations.

BenchmarkDotNet=v0.11.0, OS=Windows 10.0.16299.547 (1709/FallCreatorsUpdate/Redstone3)
Intel Core i7-6700HQ CPU 2.60GHz (Max: 2.20GHz) (Skylake), 1 CPU, 8 logical and 4 physical cores
Frequency=2531250 Hz, Resolution=395.0617 ns, Timer=TSC
.NET Core SDK=2.1.302
  [Host]     : .NET Core 2.1.2 (CoreCLR 4.6.26628.05, CoreFX 4.6.26629.01), 64bit RyuJIT
  DefaultJob : .NET Core 2.1.2 (CoreCLR 4.6.26628.05, CoreFX 4.6.26629.01), 64bit RyuJIT

Method	Mean	Error	StdDev
Thruster_1_Rent	74.54 ns	1.557 ns	4.048 ns
Thruster_2_nested_Rents	139.32 ns	2.765 ns	2.958 ns
Thruster_3_nested_Rents	207.78 ns	3.479 ns	3.255 ns
Shared_1_Rent	91.73 ns	1.547 ns	1.447 ns
Shared_2_nested_Rents	287.89 ns	5.087 ns	4.510 ns
Shared_3_nested_Rents	408.50 ns	7.217 ns	6.751 ns

Multi threaded app depends on the nesting level even more. If there's no nesting, results are comparable. Any nesting will drastically point towards using Thruster.

Icon

Rocket Ship designed by Joy Thomas from The Noun Project