Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

--test-mode fails when using uncompressed data #536

Closed
krishkoneru opened this issue Jul 20, 2018 · 0 comments
Closed

--test-mode fails when using uncompressed data #536

krishkoneru opened this issue Jul 20, 2018 · 0 comments
Labels
bug Something's wrong :Track Management New operations, changes in the track format, track download changes and the like

Comments

@krishkoneru
Copy link

Rally version esrally 1.0.0

Invoked command: esrally --target-hosts=${ES_HOSTS} --pipeline=benchmark-only --track-path=/rally-track --test-mode

Configuration file (located in ~/.rally/rally.ini)):

[meta]
config.version = 17

[system]
env.name = test-benchmark

[node]
root.dir = /home/rally/.rally/benchmarks
src.root.dir = /home/rally/.rally/benchmarks/src

[source]
remote.repo.url = https://github.com/elastic/elasticsearch.git
elasticsearch.src.subdir = elasticsearch

[benchmarks]
local.dataset.cache = /home/rally/.rally/benchmarks/data

[reporting]
datastore.type = elasticsearch
datastore.host = aa.bb.cc.dd
datastore.port = 9200
datastore.secure = False
datastore.user =
datastore.password =

[tracks]
default.url = https://github.com/elastic/rally-tracks

[teams]
default.url = https://github.com/elastic/rally-teams

[defaults]
preserve_benchmark_candidate = False

[distributions]
release.cache = true

JVM version:
openjdk version "1.8.0_171"
OpenJDK Runtime Environment (build 1.8.0_171-8u171-b11-0ubuntu0.16.04.1-b11)
OpenJDK 64-Bit Server VM (build 25.171-b11, mixed mode)

OS version:
ubuntu:16.04 docker

Description of the problem including expected versus actual behavior:

Steps to reproduce:

  1. Create a new track with uncompressed data and add support for --test-mode.
  2. Run the track in --test-mode

Provide logs (if relevant):

    ____        ____
   / __ \____ _/ / /_  __
  / /_/ / __ `/ / / / / /
 / _, _/ /_/ / / / /_/ /
/_/ |_|\__,_/_/_/\__, /
                /____/


************************************************************************
************** WARNING: A dark dungeon lies ahead of you  **************
************************************************************************

Rally does not have control over the configuration of the benchmarked
Elasticsearch cluster.

Be aware that results may be misleading due to problems with the setup.
Rally is also not able to gather lots of metrics at all (like CPU usage
of the benchmarked cluster) or may even produce misleading metrics (like
the index size).

************************************************************************
****** Use this pipeline only if you are aware of the tradeoffs.  ******
*************************** Watch your step! ***************************
************************************************************************

[ERROR] Cannot race. Got an unexpected result during benchmarking: [Poison<<esrally.racecontrol.Setup object at 0x7f4f245f0898>>: Traceback (most recent call last):
  File "/home/rally/.pyenv/versions/3.6.5/lib/python3.6/site-packages/thespian/system/actorManager.py", line 155, in _handleOneMessage
    actor_result = self.actorInst.receiveMessage(msg, envelope.sender)
  File "/home/rally/.pyenv/versions/3.6.5/lib/python3.6/site-packages/thespian/actors.py", line 838, in receiveMessage
    r = getattr(klass, methodName)(self, message, sender)
  File "/home/rally/.pyenv/versions/3.6.5/lib/python3.6/site-packages/esrally/racecontrol.py", line 101, in receiveMsg_Setup
    self.setup(msg, sender)
  File "/home/rally/.pyenv/versions/3.6.5/lib/python3.6/site-packages/esrally/racecontrol.py", line 186, in setup
    t = track.load_track(self.cfg)
  File "/home/rally/.pyenv/versions/3.6.5/lib/python3.6/site-packages/esrally/track/loader.py", line 84, in load_track
    return post_process_for_test_mode(current_track)
  File "/home/rally/.pyenv/versions/3.6.5/lib/python3.6/site-packages/esrally/track/loader.py", line 547, in post_process_for_test_mode
    path, ext = io.splitext(corpus.document_file)
AttributeError: 'DocumentCorpus' object has no attribute 'document_file'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/rally/.pyenv/versions/3.6.5/lib/python3.6/site-packages/thespian/system/actorManager.py", line 170, in _handleOneMessage
    actor_result = self.actorInst.receiveMessage(copy.deepcopy(msg), envelope.sender)
  File "/home/rally/.pyenv/versions/3.6.5/lib/python3.6/site-packages/thespian/actors.py", line 838, in receiveMessage
    r = getattr(klass, methodName)(self, message, sender)
  File "/home/rally/.pyenv/versions/3.6.5/lib/python3.6/site-packages/esrally/racecontrol.py", line 101, in receiveMsg_Setup
    self.setup(msg, sender)
  File "/home/rally/.pyenv/versions/3.6.5/lib/python3.6/site-packages/esrally/racecontrol.py", line 186, in setup
    t = track.load_track(self.cfg)
  File "/home/rally/.pyenv/versions/3.6.5/lib/python3.6/site-packages/esrally/track/loader.py", line 84, in load_track
    return post_process_for_test_mode(current_track)
  File "/home/rally/.pyenv/versions/3.6.5/lib/python3.6/site-packages/esrally/track/loader.py", line 547, in post_process_for_test_mode
    path, ext = io.splitext(corpus.document_file)
AttributeError: 'DocumentCorpus' object has no attribute 'document_file'
].

Getting further help:
*********************
* Check the log files in /home/rally/.rally/logs for errors.
* Read the documentation at https://esrally.readthedocs.io/en/1.0.0/
* Ask a question on the forum at https://discuss.elastic.co/c/elasticsearch/rally
* Raise an issue at https://github.com/elastic/rally/issues and include the log files in /home/rally/.rally/logs.

-------------------------------
[INFO] FAILURE (took 1 seconds)
-------------------------------
krishkoneru pushed a commit to krishkoneru/rally that referenced this issue Jul 20, 2018
minor change to use the correct variable.
@danielmitterdorfer danielmitterdorfer added bug Something's wrong :Track Management New operations, changes in the track format, track download changes and the like labels Jul 20, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something's wrong :Track Management New operations, changes in the track format, track download changes and the like
Projects
None yet
Development

No branches or pull requests

2 participants