Create benchmark tests

[yefremov]

It would be great to have benchmark/performance tests to compare Kafka client implementations and make a decision which one to use.

[mumrah]

I agree, but the problem is that meaningful benchmarks are hard to write. For networked systems like Kafka, you really need multiple servers to do the testing on which I do not have. There is an integration test that produces and consumes 100k messages and it runs pretty fast.

If you wanted to create a simple "local" benchmark suite, I would suggest copying what's in integration.py.

[yefremov]

Thank you for the answer, I'll take a look on integration test.

[mumrah]

@yefremov our tests are back in a working state now. If you were having issues before, give it a shot now. It would still be nice to have some benchmarks.

[dpkp]

pykafka has a few benchmark scripts at https://github.com/Parsely/pykafka/tree/master/benchmark

[dpkp]

here's another potential source for benchmark code: https://github.com/mrafayaleem/kafka-jython/tree/master/benchmarks

[dpkp]

rudimentary benchmarking scripts are now in benchmarks/ -- see #754