Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Could not find any metrics for MLD in the data. #5227

Closed
linuzer opened this issue Oct 9, 2018 · 13 comments · Fixed by #5878
Closed

Could not find any metrics for MLD in the data. #5227

linuzer opened this issue Oct 9, 2018 · 13 comments · Fixed by #5878

Comments

@linuzer
Copy link

linuzer commented Oct 9, 2018

I always get the above error on calling:
osrm-routed.exe .\data\portugal-spain.osrm -a MLD

I prepared "portugal-spain.osrm" from "portugal-spain.osm.pbf", which I merged myselfe form "portugal-latest.osm.pbf" with "spain-latest.osm.pbf" using both, "osmium" and "osmosis".
If I use the prepared "portugal-latest.osrm" from the original file "portugal-latest.osm.pbf", everything works. So I guess it has to do with the merge-process. But this and the preperation of the data didn't show any errors - as fas as I can tell.

So I'm running out of ideas what exactly could cause this error.
Anyone has an idea? Or could it be a bug in some way?

Here are the commands I executed:
.\bin\osrm-extract .\data\portugal-spain.osm.pbf -p .\bin\CustomProfile.lua
.\bin\osrm-partition .\data\portugal-spain.osrm
.\bin\osrm-customize .\data\portugal-spain.osrm
.\bin\osrm-routed .\data\portugal-spain.osrm -a MLD

Thanks a lot for any hint!

@danpat
Copy link
Member

danpat commented Oct 9, 2018

@linuzer First thing I'd do would be to look at the size of your portugal-spain.osrm* files - are they significantly smaller than the portugal-latest.osrm files? If so, that indicates some kind of error.

How exactly did you merge the .osm.pbf files together?

@linuzer
Copy link
Author

linuzer commented Oct 9, 2018

@danpat Thanks for the quick response!

The file sizes seem OK, the merged ones are significantly bigger than the single ones.

Here is the exact merge commands (tried both, but no difference):

osmium merge --fsync -O portugal-latest.osm.pbf spain-latest.osm.pbf -o portugal-spain.osm.pbf

osmosis --rbf portugal-sorted.osm.pbf --rbf spain-sorted.osm.pbf --merge --wb portugal-spain.osm.pbf

@danpat
Copy link
Member

danpat commented Oct 9, 2018

@linuzer Hmm, not sure then. Could be something to do with your custom profile, does it work if you use the default car.lua that we ship?

@linuzer
Copy link
Author

linuzer commented Oct 9, 2018

Didn't try that yet, but cerainly I will try!
But what did work is my custom.lua with the original portugal-latest.osrm. Anyway I only adapted the speeds a little bit, no futher "fancy" changes...

Is there something I could do to track further down the error? For example, can I find out what exactly is osrm-routed missing in the file(s)?

@danpat
Copy link
Member

danpat commented Oct 9, 2018

You can examine the contents of the files using tar tvf <filename>.osrm.* - the file format is standard tar format.

Maybe try comparing the internal file list (the output of tar tvf) for both portugal-latest and portugal-spain and see where they differ.

@linuzer
Copy link
Author

linuzer commented Oct 10, 2018

Sorry, I'm a bit confused... What file contents do you mean? From the PBF (that doesn't seem to be a tar)? If I call it like you mentioned:
tar tvf spain-latest.osrm.*
...I get for every file "...not found in the archive"

Some additional peaces of information:
I tried now to extract Spain and Portugal from the europe-latest.osm.pbf (using "osmium extract") with a boundig box, but with the same error.

ThenI tried the preparation with the default car.lua, which did not make any difference.

Finally I tried the spain-latest.osm.pbf (so far I only tried portugal-latest.pbf) and to my suppries here the same error happens. That means, the error has nothing to do with the merge or extract, it seems to be something in the spain-latest.pbf from geofabrik.de that causes the error!

@danpat
Copy link
Member

danpat commented Oct 10, 2018

The main difference is that spain-latest.osm.pbf is about 4x larger than portugal-latest.osm.pbf.

Can you paste the full output of osrm-extract, osrm-partition and osrm-customize here? I suspect one of them has errored, and you haven't noticed.

@linuzer
Copy link
Author

linuzer commented Oct 10, 2018

Thanks for your ongoing help! I apreciate it a lot!

First, here are the contents of the two osrm.* files. I'll put the output of the osrm-* commands in a seperate post.
What I noticed is, there are two files entirely missing in the spain-case:
".osrm.cell_metrics" and ".osrm.mldgr"

Here portugal-latest.osrm.*:

-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/metrics/routability/exclude.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/metrics/routability/exclude/0/weights.meta
-rw-rw-r-- 0/0        12688160 1970-01-01 01:00 /mld/metrics/routability/exclude/0/weights
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/metrics/routability/exclude/0/durations.meta
-rw-rw-r-- 0/0        12688160 1970-01-01 01:00 /mld/metrics/routability/exclude/0/durations
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/metrics/routability/exclude/1/weights.meta
-rw-rw-r-- 0/0        12688160 1970-01-01 01:00 /mld/metrics/routability/exclude/1/weights
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/metrics/routability/exclude/1/durations.meta
-rw-rw-r-- 0/0        12688160 1970-01-01 01:00 /mld/metrics/routability/exclude/1/durations
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/metrics/routability/exclude/2/weights.meta
-rw-rw-r-- 0/0        12688160 1970-01-01 01:00 /mld/metrics/routability/exclude/2/weights
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/metrics/routability/exclude/2/durations.meta
-rw-rw-r-- 0/0        12688160 1970-01-01 01:00 /mld/metrics/routability/exclude/2/durations
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/metrics/routability/exclude/3/weights.meta
-rw-rw-r-- 0/0        12688160 1970-01-01 01:00 /mld/metrics/routability/exclude/3/weights
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/metrics/routability/exclude/3/durations.meta
-rw-rw-r-- 0/0        12688160 1970-01-01 01:00 /mld/metrics/routability/exclude/3/durations
./portugal-latest.osrm.cells
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/cellstorage/source_boundary.meta
-rw-rw-r-- 0/0          517096 1970-01-01 01:00 /mld/cellstorage/source_boundary
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/cellstorage/destination_boundary.meta
-rw-rw-r-- 0/0          736168 1970-01-01 01:00 /mld/cellstorage/destination_boundary
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/cellstorage/cells.meta
-rw-rw-r-- 0/0          198160 1970-01-01 01:00 /mld/cellstorage/cells
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/cellstorage/level_to_cell_offset.meta
-rw-rw-r-- 0/0              40 1970-01-01 01:00 /mld/cellstorage/level_to_cell_offset
./portugal-latest.osrm.cnbg
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /extractor/cnbg.meta
-rw-rw-r-- 0/0        16335008 1970-01-01 01:00 /extractor/cnbg
./portugal-latest.osrm.cnbg_to_ebg
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/cnbg_to_ebg.meta
-rw-rw-r-- 0/0        16335008 1970-01-01 01:00 /common/cnbg_to_ebg
./portugal-latest.osrm.datasource_names
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/data_sources_names.meta
-rw-rw-r-- 0/0           66048 1970-01-01 01:00 /common/data_sources_names
./portugal-latest.osrm.ebg
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/number_of_edge_based_nodes.meta
-rw-rw-r-- 0/0               4 1970-01-01 01:00 /common/number_of_edge_based_nodes
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/edge_based_edge_list.meta
-rw-rw-r-- 0/0        67688520 1970-01-01 01:00 /common/edge_based_edge_list
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/connectivity_checksum.meta
-rw-rw-r-- 0/0               4 1970-01-01 01:00 /common/connectivity_checksum
./portugal-latest.osrm.ebg_nodes
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/ebg_node_data/nodes.meta
-rw-rw-r-- 0/0        21856332 1970-01-01 01:00 /common/ebg_node_data/nodes
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/ebg_node_data/annotations.meta
-rw-rw-r-- 0/0          522784 1970-01-01 01:00 /common/ebg_node_data/annotations
./portugal-latest.osrm.edges
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/connectivity_checksum.meta
-rw-rw-r-- 0/0               4 1970-01-01 01:00 /common/connectivity_checksum
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_data/turn_instructions.meta
-rw-rw-r-- 0/0         3384426 1970-01-01 01:00 /common/turn_data/turn_instructions
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_data/lane_data_ids.meta
-rw-rw-r-- 0/0         6768852 1970-01-01 01:00 /common/turn_data/lane_data_ids
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_data/entry_class_ids.meta
-rw-rw-r-- 0/0         6768852 1970-01-01 01:00 /common/turn_data/entry_class_ids
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_data/pre_turn_bearings.meta
-rw-rw-r-- 0/0         3384426 1970-01-01 01:00 /common/turn_data/pre_turn_bearings
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_data/post_turn_bearings.meta
-rw-rw-r-- 0/0         3384426 1970-01-01 01:00 /common/turn_data/post_turn_bearings
./portugal-latest.osrm.enw
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /extractor/edge_based_node_weights.meta
-rw-rw-r-- 0/0         7285444 1970-01-01 01:00 /extractor/edge_based_node_weights
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /extractor/edge_based_node_durations.meta
-rw-rw-r-- 0/0         7285444 1970-01-01 01:00 /extractor/edge_based_node_durations
./portugal-latest.osrm.fileIndex
./portugal-latest.osrm.geometry
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/index.meta
-rw-rw-r-- 0/0         4083756 1970-01-01 01:00 /common/segment_data/index
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/nodes.meta
-rw-rw-r-- 0/0        25419776 1970-01-01 01:00 /common/segment_data/nodes
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/forward_weights/number_of_elements.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/forward_weights/packed.meta
-rw-rw-r-- 0/0        17476272 1970-01-01 01:00 /common/segment_data/forward_weights/packed
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/reverse_weights/number_of_elements.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/reverse_weights/packed.meta
-rw-rw-r-- 0/0        17476272 1970-01-01 01:00 /common/segment_data/reverse_weights/packed
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/forward_durations/number_of_elements.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/forward_durations/packed.meta
-rw-rw-r-- 0/0        17476272 1970-01-01 01:00 /common/segment_data/forward_durations/packed
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/reverse_durations/number_of_elements.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/reverse_durations/packed.meta
-rw-rw-r-- 0/0        17476272 1970-01-01 01:00 /common/segment_data/reverse_durations/packed
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/forward_data_sources.meta
-rw-rw-r-- 0/0         6354944 1970-01-01 01:00 /common/segment_data/forward_data_sources
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/reverse_data_sources.meta
-rw-rw-r-- 0/0         6354944 1970-01-01 01:00 /common/segment_data/reverse_data_sources
./portugal-latest.osrm.icd
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/intersection_bearings/bearing_values.meta
-rw-rw-r-- 0/0          108414 1970-01-01 01:00 /common/intersection_bearings/bearing_values
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/intersection_bearings/node_to_class_id.meta
-rw-rw-r-- 0/0        20348920 1970-01-01 01:00 /common/intersection_bearings/node_to_class_id
-rw-rw-r-- 0/0               4 1970-01-01 01:00 /common/intersection_bearings/class_id_to_ranges/sum_lengths.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/intersection_bearings/class_id_to_ranges/block_offsets.meta
-rw-rw-r-- 0/0            3432 1970-01-01 01:00 /common/intersection_bearings/class_id_to_ranges/block_offsets
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/intersection_bearings/class_id_to_ranges/diff_blocks.meta
-rw-rw-r-- 0/0           13728 1970-01-01 01:00 /common/intersection_bearings/class_id_to_ranges/diff_blocks
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/entry_classes.meta
-rw-rw-r-- 0/0             336 1970-01-01 01:00 /common/entry_classes
./portugal-latest.osrm.maneuver_overrides
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/maneuver_overrides/overrides.meta
-rw-rw-r-- 0/0               0 1970-01-01 01:00 /common/maneuver_overrides/overrides
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/maneuver_overrides/node_sequences.meta
-rw-rw-r-- 0/0               0 1970-01-01 01:00 /common/maneuver_overrides/node_sequences
./portugal-latest.osrm.mldgr
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/connectivity_checksum.meta
-rw-rw-r-- 0/0               4 1970-01-01 01:00 /mld/connectivity_checksum
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelgraph/node_array.meta
-rw-rw-r-- 0/0         7285448 1970-01-01 01:00 /mld/multilevelgraph/node_array
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelgraph/node_weights.meta
-rw-rw-r-- 0/0         7285444 1970-01-01 01:00 /mld/multilevelgraph/node_weights
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelgraph/node_durations.meta
-rw-rw-r-- 0/0         7285444 1970-01-01 01:00 /mld/multilevelgraph/node_durations
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelgraph/edge_array.meta
-rw-rw-r-- 0/0        54110576 1970-01-01 01:00 /mld/multilevelgraph/edge_array
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelgraph/is_forward_edge.meta
-rw-rw-r-- 0/0          845480 1970-01-01 01:00 /mld/multilevelgraph/is_forward_edge
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelgraph/is_backward_edge.meta
-rw-rw-r-- 0/0          845480 1970-01-01 01:00 /mld/multilevelgraph/is_backward_edge
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelgraph/node_to_edge_offset.meta
-rw-rw-r-- 0/0          845401 1970-01-01 01:00 /mld/multilevelgraph/node_to_edge_offset
./portugal-latest.osrm.names
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/names/blocks.meta
-rw-rw-r-- 0/0          146856 1970-01-01 01:00 /common/names/blocks
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/names/values.meta
-rw-rw-r-- 0/0         1438990 1970-01-01 01:00 /common/names/values
./portugal-latest.osrm.nbg_nodes
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/nbn_data/coordinates.meta
-rw-rw-r-- 0/0        40697840 1970-01-01 01:00 /common/nbn_data/coordinates
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/nbn_data/osm_node_ids/number_of_elements.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/nbn_data/osm_node_ids/packed.meta
-rw-rw-r-- 0/0        20984832 1970-01-01 01:00 /common/nbn_data/osm_node_ids/packed
./portugal-latest.osrm.partition
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelpartition/level_data.meta
-rw-rw-r-- 0/0             272 1970-01-01 01:00 /mld/multilevelpartition/level_data
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelpartition/partition.meta
-rw-rw-r-- 0/0        14570896 1970-01-01 01:00 /mld/multilevelpartition/partition
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelpartition/cell_to_children.meta
-rw-rw-r-- 0/0            2908 1970-01-01 01:00 /mld/multilevelpartition/cell_to_children
./portugal-latest.osrm.properties
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/properties.meta
-rw-rw-r-- 0/0            2344 1970-01-01 01:00 /common/properties
./portugal-latest.osrm.ramIndex
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/rtree/search_tree.meta
-rw-rw-r-- 0/0          421808 1970-01-01 01:00 /common/rtree/search_tree
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/rtree/search_tree_level_starts.meta
-rw-rw-r-- 0/0              40 1970-01-01 01:00 /common/rtree/search_tree_level_starts
./portugal-latest.osrm.restrictions
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/conditional_restrictions.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/conditional_restrictions
./portugal-latest.osrm.tld
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_lanes/data.meta
-rw-rw-r-- 0/0            1344 1970-01-01 01:00 /common/turn_lanes/data
./portugal-latest.osrm.tls
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_lanes/offsets.meta
-rw-rw-r-- 0/0             984 1970-01-01 01:00 /common/turn_lanes/offsets
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_lanes/masks.meta
-rw-rw-r-- 0/0            1568 1970-01-01 01:00 /common/turn_lanes/masks
./portugal-latest.osrm.turn_duration_penalties
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_penalty/duration.meta
-rw-rw-r-- 0/0         6768852 1970-01-01 01:00 /common/turn_penalty/duration
./portugal-latest.osrm.turn_penalties_index
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0        40613112 1970-01-01 01:00 /extractor/turn_index
./portugal-latest.osrm.turn_weight_penalties
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_penalty/weight.meta
-rw-rw-r-- 0/0         6768852 1970-01-01 01:00 /common/turn_penalty/weight

And here the contents of spain-latest.osrm.*:

./spain-latest.osrm.cells
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/cellstorage/source_boundary.meta
-rw-rw-r-- 0/0         1655948 1970-01-01 01:00 /mld/cellstorage/source_boundary
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/cellstorage/destination_boundary.meta
-rw-rw-r-- 0/0         2279876 1970-01-01 01:00 /mld/cellstorage/destination_boundary
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/cellstorage/cells.meta
-rw-rw-r-- 0/0          679300 1970-01-01 01:00 /mld/cellstorage/cells
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/cellstorage/level_to_cell_offset.meta
-rw-rw-r-- 0/0              40 1970-01-01 01:00 /mld/cellstorage/level_to_cell_offset
./spain-latest.osrm.cnbg
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /extractor/cnbg.meta
-rw-rw-r-- 0/0        58023808 1970-01-01 01:00 /extractor/cnbg
./spain-latest.osrm.cnbg_to_ebg
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/cnbg_to_ebg.meta
-rw-rw-r-- 0/0        58023808 1970-01-01 01:00 /common/cnbg_to_ebg
./spain-latest.osrm.datasource_names
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/data_sources_names.meta
-rw-rw-r-- 0/0           66048 1970-01-01 01:00 /common/data_sources_names
./spain-latest.osrm.ebg
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/number_of_edge_based_nodes.meta
-rw-rw-r-- 0/0               4 1970-01-01 01:00 /common/number_of_edge_based_nodes
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/edge_based_edge_list.meta
-rw-rw-r-- 0/0       231479680 1970-01-01 01:00 /common/edge_based_edge_list
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/connectivity_checksum.meta
-rw-rw-r-- 0/0               4 1970-01-01 01:00 /common/connectivity_checksum
./spain-latest.osrm.ebg_nodes
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/ebg_node_data/nodes.meta
-rw-rw-r-- 0/0        74440716 1970-01-01 01:00 /common/ebg_node_data/nodes
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/ebg_node_data/annotations.meta
-rw-rw-r-- 0/0         2239224 1970-01-01 01:00 /common/ebg_node_data/annotations
./spain-latest.osrm.edges
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/connectivity_checksum.meta
-rw-rw-r-- 0/0               4 1970-01-01 01:00 /common/connectivity_checksum
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_data/turn_instructions.meta
-rw-rw-r-- 0/0        11573984 1970-01-01 01:00 /common/turn_data/turn_instructions
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_data/lane_data_ids.meta
-rw-rw-r-- 0/0        23147968 1970-01-01 01:00 /common/turn_data/lane_data_ids
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_data/entry_class_ids.meta
-rw-rw-r-- 0/0        23147968 1970-01-01 01:00 /common/turn_data/entry_class_ids
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_data/pre_turn_bearings.meta
-rw-rw-r-- 0/0        11573984 1970-01-01 01:00 /common/turn_data/pre_turn_bearings
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_data/post_turn_bearings.meta
-rw-rw-r-- 0/0        11573984 1970-01-01 01:00 /common/turn_data/post_turn_bearings
./spain-latest.osrm.enw
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /extractor/edge_based_node_weights.meta
-rw-rw-r-- 0/0        24813572 1970-01-01 01:00 /extractor/edge_based_node_weights
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /extractor/edge_based_node_durations.meta
-rw-rw-r-- 0/0        24813572 1970-01-01 01:00 /extractor/edge_based_node_durations
./spain-latest.osrm.fileIndex
./spain-latest.osrm.geometry
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/index.meta
-rw-rw-r-- 0/0        14505956 1970-01-01 01:00 /common/segment_data/index
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/nodes.meta
-rw-rw-r-- 0/0        82950824 1970-01-01 01:00 /common/segment_data/nodes
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/forward_weights/number_of_elements.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/forward_weights/packed.meta
-rw-rw-r-- 0/0        57028752 1970-01-01 01:00 /common/segment_data/forward_weights/packed
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/reverse_weights/number_of_elements.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/reverse_weights/packed.meta
-rw-rw-r-- 0/0        57028752 1970-01-01 01:00 /common/segment_data/reverse_weights/packed
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/forward_durations/number_of_elements.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/forward_durations/packed.meta
-rw-rw-r-- 0/0        57028752 1970-01-01 01:00 /common/segment_data/forward_durations/packed
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/reverse_durations/number_of_elements.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/reverse_durations/packed.meta
-rw-rw-r-- 0/0        57028752 1970-01-01 01:00 /common/segment_data/reverse_durations/packed
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/forward_data_sources.meta
-rw-rw-r-- 0/0        20737706 1970-01-01 01:00 /common/segment_data/forward_data_sources
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/segment_data/reverse_data_sources.meta
-rw-rw-r-- 0/0        20737706 1970-01-01 01:00 /common/segment_data/reverse_data_sources
./spain-latest.osrm.icd
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/intersection_bearings/bearing_values.meta
-rw-rw-r-- 0/0          270122 1970-01-01 01:00 /common/intersection_bearings/bearing_values
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/intersection_bearings/node_to_class_id.meta
-rw-rw-r-- 0/0        64581704 1970-01-01 01:00 /common/intersection_bearings/node_to_class_id
-rw-rw-r-- 0/0               4 1970-01-01 01:00 /common/intersection_bearings/class_id_to_ranges/sum_lengths.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/intersection_bearings/class_id_to_ranges/block_offsets.meta
-rw-rw-r-- 0/0            8676 1970-01-01 01:00 /common/intersection_bearings/class_id_to_ranges/block_offsets
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/intersection_bearings/class_id_to_ranges/diff_blocks.meta
-rw-rw-r-- 0/0           34704 1970-01-01 01:00 /common/intersection_bearings/class_id_to_ranges/diff_blocks
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/entry_classes.meta
-rw-rw-r-- 0/0             476 1970-01-01 01:00 /common/entry_classes
./spain-latest.osrm.maneuver_overrides
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/maneuver_overrides/overrides.meta
-rw-rw-r-- 0/0               0 1970-01-01 01:00 /common/maneuver_overrides/overrides
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/maneuver_overrides/node_sequences.meta
-rw-rw-r-- 0/0               0 1970-01-01 01:00 /common/maneuver_overrides/node_sequences
./spain-latest.osrm.names
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/names/blocks.meta
-rw-rw-r-- 0/0          636520 1970-01-01 01:00 /common/names/blocks
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/names/values.meta
-rw-rw-r-- 0/0         5958409 1970-01-01 01:00 /common/names/values
./spain-latest.osrm.nbg_nodes
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/nbn_data/coordinates.meta
-rw-rw-r-- 0/0       129163408 1970-01-01 01:00 /common/nbn_data/coordinates
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/nbn_data/osm_node_ids/number_of_elements.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/nbn_data/osm_node_ids/packed.meta
-rw-rw-r-- 0/0        66600072 1970-01-01 01:00 /common/nbn_data/osm_node_ids/packed
./spain-latest.osrm.partition
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelpartition/level_data.meta
-rw-rw-r-- 0/0             272 1970-01-01 01:00 /mld/multilevelpartition/level_data
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelpartition/partition.meta
-rw-rw-r-- 0/0        49627152 1970-01-01 01:00 /mld/multilevelpartition/partition
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /mld/multilevelpartition/cell_to_children.meta
-rw-rw-r-- 0/0            9812 1970-01-01 01:00 /mld/multilevelpartition/cell_to_children
./spain-latest.osrm.properties
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/properties.meta
-rw-rw-r-- 0/0            2344 1970-01-01 01:00 /common/properties
./spain-latest.osrm.ramIndex
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/rtree/search_tree.meta
-rw-rw-r-- 0/0         1352576 1970-01-01 01:00 /common/rtree/search_tree
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/rtree/search_tree_level_starts.meta
-rw-rw-r-- 0/0              40 1970-01-01 01:00 /common/rtree/search_tree_level_starts
./spain-latest.osrm.restrictions
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/conditional_restrictions.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/conditional_restrictions
./spain-latest.osrm.tld
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_lanes/data.meta
-rw-rw-r-- 0/0            2216 1970-01-01 01:00 /common/turn_lanes/data
./spain-latest.osrm.tls
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_lanes/offsets.meta
-rw-rw-r-- 0/0            1716 1970-01-01 01:00 /common/turn_lanes/offsets
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_lanes/masks.meta
-rw-rw-r-- 0/0            2872 1970-01-01 01:00 /common/turn_lanes/masks
./spain-latest.osrm.turn_duration_penalties
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_penalty/duration.meta
-rw-rw-r-- 0/0        23147968 1970-01-01 01:00 /common/turn_penalty/duration
./spain-latest.osrm.turn_penalties_index
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0       138887808 1970-01-01 01:00 /extractor/turn_index
./spain-latest.osrm.turn_weight_penalties
-rw-rw-r-- 0/0               8 1970-01-01 01:00 osrm_fingerprint.meta
-rw-rw-r-- 0/0               8 1970-01-01 01:00 /common/turn_penalty/weight.meta
-rw-rw-r-- 0/0        23147968 1970-01-01 01:00 /common/turn_penalty/weight

@linuzer
Copy link
Author

linuzer commented Oct 10, 2018

Here is the output of the three commands. I'm running all of this in Windows, which I hope does not make a difference, but explains the wired characters at the end of each line...

D:\Data\OSRM\Span-Port>"Prepare OSRM-small.bat"

D:\Data\OSRM\Span-Port>´╗┐
Der Befehl "´╗┐" ist entweder falsch geschrieben oder
konnte nicht gefunden werden.

D:\Data\OSRM\Span-Port>.\bin\osrm-extract .\data\spain-latest.osm.pbf -p .\bin\car.lua
[info] Parsed 0 location-dependent features with 0 GeoJSON polygons�[0m
[info] Using script .\bin\car.lua�[0m
[info] Input file: spain-latest.osm.pbf�[0m
[info] Profile: car.lua�[0m
[info] Threads: 8�[0m
[info] Parsing in progress..�[0m
[info] input file generated by osmium/1.8.0�[0m
[info] timestamp: 2018-10-09T20:14:03Z�[0m
[info] Using profile api version 4�[0m
[info] Found 3 turn restriction tags:�[0m
[info]   motorcar�[0m
[info]   motor_vehicle�[0m
[info]   vehicle�[0m
[info] Parse relations ...�[0m
[info] Parse ways and nodes ...�[0m
[info] Using profile api version 4�[0m
[info] Using profile api version 4�[0m
[info] Using profile api version 4�[0m
[info] Using profile api version 4�[0m
[info] Using profile api version 4�[0m
[info] Using profile api version 4�[0m
[info] Using profile api version 4�[0m
[info] Parsing finished after 76.3749 seconds�[0m
[info] Raw input contains 84355682 nodes, 6956023 ways, and 8729 relations, 65006 restrictions�[0m
[info] Sorting used nodes        ... ok, after 0.257503s�[0m
[info] Erasing duplicate nodes   ... ok, after 0.037285s�[0m
[info] Sorting all nodes         ... ok, after 0.837936s�[0m
[info] Building node id map      ... ok, after 0.402869s�[0m
[info] Confirming/Writing used nodes     ... ok, after 1.58784s�[0m
[info] Writing barrier nodes     ... ok, after 0s�[0m
[info] Writing traffic light nodes     ... ok, after 0s�[0m
[info] Processed 16145426 nodes�[0m
[info] Sorting edges by start    ... ok, after 1.30338s�[0m
[info] Setting start coords      ... ok, after 1.25384s�[0m
[info] Sorting edges by target   ... ok, after 0.742432s�[0m
[info] Computing edge weights    ... ok, after 2.76353s�[0m
[info] Sorting edges by renumbered start ... ok, after 0.796486s�[0m
[info] Writing used edges       ... ok, after 4.69177s -- Processed 17120248 edges�[0m
[info] Writing way meta-data     ... ok, after 0.006348s -- Metadata contains << 1901069 entries.�[0m
[info] Sorting used ways         ... ok, after 0.007076s�[0m
[info] Collecting start/end information on 0 maneuver overrides...ok, after 0.012006s�[0m
[info] Collecting start/end information on 0 maneuver overrides...ok, after 0s�[0m
[info] Collecting start/end information on 65006 restrictions...ok, after 0.114139s�[0m
[info] Collecting start/end information on 65006 restrictions...ok, after 0.138496s�[0m
[info] writing street name index ... ok, after 0.175355s�[0m
[info] extraction finished after 92.1106s�[0m
[info] Generating edge-expanded graph representation�[0m
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100%�[0m
[info] Node compression ratio: 0.165795�[0m
[info] Edge compression ratio: 0.212136�[0m
[info]  graph compression removed 1621166 annotations of 1901069 in 4.63438 seconds�[0m
[info] Find segregated edges in node-based graph ...�[0m
[info] ok, after 13.3433s�[0m
[info] Segregated edges count = 56449�[0m
[info] Writing nodes for nodes-based and edges-based graphs ...�[0m
[info] Geometry successfully removed:
  compressed edges: 7253000
  compressed geometries: 34222436
  longest chain length: 1766
  cmpr ratio: 0.211937
  avg chain length: 4.71838�[0m
[info] Generating edge expanded nodes ... �[0m
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100%�[0m
[info] Expanding via-way turn restrictions ... �[0m
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100%�[0m
[info] Generated 6203393 nodes (251 of which are duplicates)  and 17095091 segments in edge-expanded graph�[0m
[info] Generating edge-expanded edges �[0m
[info] . 10% . 20% . 30% . 40% . 50% �[33m[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 8267311, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=42.260089&mlon=-8.78844�[0m
. 60% . 70% . 80% .�[33m[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 14360473, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=41.485241&mlon=2.078185�[0m
 90% .�[33m[warn] Turn is a u turn but not turning to the first connected edge of the intersection. Node ID: 15396061, OSM link: http://www.openstreetmap.org/?zoom=18&mlat=39.103878&mlon=-5.329603�[0m
�[0m
[info] Sorting and writing 0 maneuver overrides...�[0m
[info] done.�[0m
[info] Renumbering turns�[0m
[info] Writing 0 conditional turn penalties...�[0m
[info] Generated 17095091 edge based node segments�[0m
[info] Node-based graph contains 6171792 edges�[0m
[info] Edge-expanded graph ...�[0m
[info]   contains 11573984 edges�[0m
[info] Timing statistics for edge-expanded graph:�[0m
[info] Renumbering edges: 0.313709s�[0m
[info] Generating nodes: 6.96556s�[0m
[info] Generating edges: 26.4825s�[0m
[info] Generating guidance turns �[0m
[info] . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% .�[0m
[info] done.�[0m
[info] Created 119 entry classes and 36862 Bearing Classes�[0m
[info] Handled: 6207 of 27793 lanes: 22.333 %.�[0m
[info] Assigned 13574880 turn instruction types:�[0m
[info]   new name: 523028 (3.85%)�[0m
[info]   continue: 729410 (5.37%)�[0m
[info]   turn: 5318520 (39.18%)�[0m
[info]   merge: 21492 (0.16%)�[0m
[info]   on ramp: 16746 (0.12%)�[0m
[info]   off ramp: 19549 (0.14%)�[0m
[info]   fork: 152085 (1.12%)�[0m
[info]   end of road: 1860469 (13.71%)�[0m
[info]   notification: 114 (0.00%)�[0m
[info]   enter roundabout: 99183 (0.73%)�[0m
[info]   enter and exit roundabout: 268 (0.00%)�[0m
[info]   enter rotary: 7797 (0.06%)�[0m
[info]   enter and exit rotary: 21 (0.00%)�[0m
[info]   enter roundabout turn: 18931 (0.14%)�[0m
[info]   (noturn): 419508 (3.09%)�[0m
[info]   (suppressed): 4077753 (30.04%)�[0m
[info]   roundabout: 322 (0.00%)�[0m
[info]   exit roundabout: 118111 (0.87%)�[0m
[info]   rotary: 21 (0.00%)�[0m
[info]   exit rotary: 8959 (0.07%)�[0m
[info]   exit roundabout turn: 19354 (0.14%)�[0m
[info]   (stay on roundabout): 140786 (1.04%)�[0m
[info]   (sliproad): 22453 (0.17%)�[0m
[info] Assigned 13574880 turn instruction modifiers:�[0m
[info]   uturn: 467167 (3.44%)�[0m
[info]   sharp right: 344935 (2.54%)�[0m
[info]   right: 3491334 (25.72%)�[0m
[info]   slight right: 624345 (4.60%)�[0m
[info]   straight: 4359016 (32.11%)�[0m
[info]   slight left: 594118 (4.38%)�[0m
[info]   left: 3272565 (24.11%)�[0m
[info]   sharp left: 421400 (3.10%)�[0m
[info] Guidance turn annotations took 112.865s�[0m
[info] Writing Intersection Classification Data�[0m
[info] ok, after 0.565804s�[0m
[info] Writing Turns and Lane Data...�[0m
[info] ok, after 0.255093s�[0m
[info] Saving edge-based node weights to file.�[0m
[info] Done writing. (0.639107)�[0m
[info] Computing strictly connected components ...�[0m
[info] Found 22532 SCC (2 large, 22530 small)�[0m
[info] SCC run took: 1.02113s�[0m
[info] Building r-tree ...�[0m
[info] Constructing r-tree of 17095091 segments build on-top of 16145426 coordinates�[0m
[info] finished r-tree construction in 3.26469 seconds�[0m
[info] Writing edge-based-graph edges       ... �[0m
[info] ok, after 2.11741s�[0m
[info] Processed 11573984 edges�[0m
[info] Expansion: 77807 nodes/sec and 29895 edges/sec�[0m
[info] To prepare the data for routing, run: ./osrm-contract ".\data\spain-latest.osrm"�[0m
[info] RAM: peak bytes used: <not implemented on Windows>�[0m

D:\Data\OSRM\Span-Port>.\bin\osrm-partition .\data\spain-latest.osrm
[info] Computing recursive bisection�[0m
[info] Loaded compressed node based graph: 7252976 edges, 16145426 nodes�[0m
[info]  running partition: 128 1.2 0.25 10 1000 # max_cell_size balance boundary cuts small_component_size�[0m
[info] Found 13479152 SCC (1 large, 13479151 small)�[0m
[info] SCC run took: 1.18456s�[0m
[info] Full bisection done in 91.5427s�[0m
[info] Loaded node based graph to edge based graph mapping�[0m
[info] Loaded edge based graph for mapping partition ids: 23129246 edges, 6203393 nodes�[0m
[info] Fixed 1851 unconnected nodes�[0m
[info] Edge-based-graph annotation:�[0m
[info]   level 1 #cells 31664 bit size 15�[0m
[info]   level 2 #cells 2301 bit size 12�[0m
[info]   level 3 #cells 143 bit size 8�[0m
[info]   level 4 #cells 6 bit size 3�[0m
[info] Renumbered data in 11.5195 seconds�[0m
[info] MultiLevelPartition constructed in 0.870208 seconds�[0m
[info] CellStorage constructed in 0.669133 seconds�[0m
[info] MLD data writing took 6.39756 seconds�[0m
[info] Cells statistics per level�[0m
[info] Level 1 #cells 31664 #boundary nodes 569386, sources: avg. 11, destinations: avg. 15, entries: 7405361 (59242888 bytes)�[0m
[info] Level 2 #cells 2301 #boundary nodes 75789, sources: avg. 21, destinations: avg. 27, entries: 1643626 (13149008 bytes)�[0m

D:\Data\OSRM\Span-Port>.\bin\osrm-customize .\data\spain-latest.osrm
[info] Loaded edge based graph: 23129246 edges, 6203393 nodes�[0m
[info] Loading partition data took 4.40721 seconds�[0m
[info] Cells customization took 12.1062 seconds�[0m
[info] Cells statistics per level�[0m
[info] Level 1 #cells 31664 #boundary nodes 569386, sources: avg. 11, destinations: avg. 15, entries: 7405361 (59242888 bytes)�[0m
[info] Level 2 #cells 2301 #boundary nodes 75789, sources: avg. 21, destinations: avg. 27, entries: 1643626 (13149008 bytes)�[0m

D:\Data\OSRM\Span-Port>.\bin\osrm-datastore --dataset-name=spain-latest .\data\spain-latest.osrm
[info] Data layout has a size of 1894 bytes�[0m
[info] Allocating shared memory of 480570151 bytes�[0m
[info] Data layout has a size of 664 bytes�[0m
[info] Allocating shared memory of 413410552 bytes�[0m
[info] All data loaded. Notify all client about new data in:�[0m
[info] spain-latest/static      0�[0m
[info] spain-latest/updatable   1�[0m
[info] Marking old shared memory region 6 for removal... �[0m
[info] ok.�[0m
[info] Waiting for clients to detach... �[0m
[info]  ok.�[0m
[info] Marking old shared memory region 7 for removal... �[0m
[info] ok.�[0m
[info] Waiting for clients to detach... �[0m
[info]  ok.�[0m
[info] All clients switched.�[0m

@danpat
Copy link
Member

danpat commented Oct 10, 2018

@linuzer It looks like the osrm-partition and osrm-customzie tools aren't finishing properly (which would explain missing files). The last line printed by the tool after success should be RAM: peak bytes used: <not implemented on Windows> (you can see this at the end of the osrm-extract tool run).

Compare the output of osrm-partition for portugal-latest.osrm - I suspect it's working properly there.

Unfortunately I don't have much ability to debug a problem like this on Windows - maybe check your free memory?

You should also check the return code from osrm-partition - I suspect it's nonzero (see https://stackoverflow.com/questions/334879/how-do-i-get-the-application-exit-code-from-a-windows-command-line for some details on how to do that).

@linuzer
Copy link
Author

linuzer commented Oct 11, 2018

You were right, the osrm-partition and osrm-customize seems to escape premature.
The return code for both is the same: -1073741676

The whole process worked already very stable on Windows using much bigger extracts, like germany-latest. I also verified again the memory consumption, but this does not seem to be a problem. I have 32 GB on that machine and the usage comes never over 9 GB with the spain file. Unfortunately I'm fixed to Windows, since I need to use the .net binding of OSRM.

Does the return-code tell you anything?

@danpat
Copy link
Member

danpat commented Oct 11, 2018

Unfortunately no. I'll give spain-latest.osm.pbf a go locally on my MacOS machine and see if it works. Hold tight.

@linuzer
Copy link
Author

linuzer commented Oct 15, 2018

@danpat: Were you able to reproduce the error with spain-latest on your Mac-Machine?

I also tried several things, which confuses me a bit:

Tried the same spain-latest with the (same) 5.18.0 release on an Ubuntu-VM ... and it worked!

Then I recompiled on Windows the whole osrm.net library (which in turn downloads precompiled OSRM-libraries and DLLs in version 5.18.0): No success, same error.

Then I compiled OSRM on Windows by myself (that worked), but same error.

Then I tried the CH-algorithm toolchain (osrm-extract and osrm-contract): And this worked! Unfortunately I could have had that CH-idea already a lot earlier, but I didn't -- so now I can not tell, if it is a problem with the MLD-code, especially inside osrm-partition, or something related with the precompiled Windows-binaries I used so far.

So for me I have right now a workaround using the CH-algorithm, but all this is still quite confusing to me...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants