You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have successfully done all the steps from original knn_lm.
Then I have tried to run your scripts:
python rq/fast_evaluate.py --preset wiki_valid --save_knns # Save the neighbors.
python rq/fast_evaluate.py --preset wiki_valid --save_exact # Save the exact vector distances.
python rq/fast_evaluate.py --preset wiki_valid --exact # Compute perplexity using exact vector distance.
But I got following error:
fast_evaluate.py: error: unrecognized arguments: --save_exact
load dataset
Traceback (most recent call last):
File "rq/fast_evaluate.py", line 233, in
main(args)
File "rq/fast_evaluate.py", line 186, in main
dataset = Dataset(args)
File "/home/hereldav/lm-ensemble/models/knnlm-retrieval-quality/rq/data_structures.py", line 14, in init
self.query = np.memmap(f'{path}/dstore_keys.npy', dtype=np.float16, mode='r', shape=(dstore_size, 1024))
File "/home/hereldav/.conda/envs/knn_lm_py37/lib/python3.7/site-packages/numpy/core/memmap.py", line 225, in new
f_ctx = open(os_fspath(filename), ('r' if mode == 'c' else mode)+'b')
FileNotFoundError: [Errno 2] No such file or directory: '/iesl/local/adrozdov/knnlm_data.valid/dstore_keys.npy'
The text was updated successfully, but these errors were encountered:
Hi,
I have successfully done all the steps from original knn_lm.
Then I have tried to run your scripts:
python rq/fast_evaluate.py --preset wiki_valid --save_knns # Save the neighbors.
python rq/fast_evaluate.py --preset wiki_valid --save_exact # Save the exact vector distances.
python rq/fast_evaluate.py --preset wiki_valid --exact # Compute perplexity using exact vector distance.
But I got following error:
fast_evaluate.py: error: unrecognized arguments: --save_exact
load dataset
Traceback (most recent call last):
File "rq/fast_evaluate.py", line 233, in
main(args)
File "rq/fast_evaluate.py", line 186, in main
dataset = Dataset(args)
File "/home/hereldav/lm-ensemble/models/knnlm-retrieval-quality/rq/data_structures.py", line 14, in init
self.query = np.memmap(f'{path}/dstore_keys.npy', dtype=np.float16, mode='r', shape=(dstore_size, 1024))
File "/home/hereldav/.conda/envs/knn_lm_py37/lib/python3.7/site-packages/numpy/core/memmap.py", line 225, in new
f_ctx = open(os_fspath(filename), ('r' if mode == 'c' else mode)+'b')
FileNotFoundError: [Errno 2] No such file or directory: '/iesl/local/adrozdov/knnlm_data.valid/dstore_keys.npy'
The text was updated successfully, but these errors were encountered: