-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathREADME
457 lines (423 loc) · 24.4 KB
/
README
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
-------------------------------------------------------------------------------
MB-SYSTEM README FILE:
-------------------------------------------------------------------------------
Version: $Id: README 2114 2013-06-07 07:46:19Z caress $
-------------------------------------------------------------------------------
This file contains general information regarding the MB-System open
source software package for the processing and display of swath sonar data.
This file is located at the top of the MB-System source code distribution
directory structure.
The copyright and licensing terms are contained in the file "COPYING".
The GNU GPL version 3 license used for MB-System can be found in the file "GPL".
The software authors are listed in the file "AUTHORS".
A log of source code changes is in the file "CHANGELOG".
Installation instructions are found in the file "NOTES".
-------------------------------------------------------------------------------
MB-SYSTEM VERSION 5 DESCRIPTION:
-------------------------------------------------------------------------------
MB-System is a software package consisting of programs which manipulate,
process, list, or display swath sonar bathymetry, amplitude, and sidescan data.
This software is distributed freely (and for free) in the form of source code
for Unix platforms. The heart of the system is an input/output library called
MBIO which allows programs to work transparently with any of a number of
supported swath sonar data formats. This approach has allowed the creation
of "generic" utilities which can be applied in a uniform manner to sonar data
from a variety of sources. Most of the programs are command-line tools, but the
package does include graphical tools for editing swath bathymetry, editing
navigation, modeling bathymetry calculation, and adjusting survey navigation.
-------------------------------------------------------------------------------
MB-SYSTEM PROGRAMS
-------------------------------------------------------------------------------
hsdump(1) - hsdump lists the information contained in Hydrosweep
DS data files
mb7k2jstar(1) - extracts subbottom profiler and/or sidescan sonar
data from Reson 7k format data files into Edgetech
Jstar format data files
mb7k2ss(1) - extracts sidescan sonar data from Reson 7k format
data, bins and lays the sidescan onto the seafloor,
and outputs files in the MBF_MBLDEOIH formst
(MBIO format id 71)
mb7kpreprocess(1) - performs preprocessing of Reson 7k multibeam data in
the 7k format (MBIO format 88)
mbabsorption(1) - calculates the absorption of sound in sea water in
dB/km as a function of frequency, temperature,
salinity, sound speed, and depth
mbareaclean(1) - Tool to automatically flag bad beams in swath sonar
bathymetry data within a specified area
mbauvloglist(1) - Lists table data from an MBARI AUV mission log file
mbauvnavusbl(1) - Adjusts inertial navigation of a submerged
platform/vehicle to be consistent with more
accurate but less precise surface tracking (USBL)
navigation
mbbackangle(1) - Generates tables of the average amplitude or
sidescan values in swath sonar data as a function
of the grazing angle with the seafloor
mbclean(1) - Tool to automatically flag bad beams in swath sonar
bathymetry data
mbcontour(1) - GMT compatible utility for color fill or color
shaded relief swath plots of swath sonar data using
Postscript
mbcopy(1) - Copy swath sonar bathymetry data files
mbctdlist(1) - List CTD data in swath sonar data files
mbdatalist(1) - parses recursive datalist files and outputs the
complete list of data files, formats, and file
weights
mbdefaults(1) - Set or list default mbio parameters for reading and
writing swath sonar data
mbedit(1) - Interactive editor used to flag bad bathymetry
values in swath sonar bathymetry data
mbeditviz(1) - 3D visualization-based editing of swath bathymetry
soundings
mbextractsegy(1) - extracts subbottom profiler, center beam reflection,
or seismic reflection data from swath data
supported by MB-System and rewrites it as a SEGY
file
mbfilter(1) - Apply some simple filter functions to sidescan or
beam amplitude data from swath sonar data files
mbformat(1) - List information about swath sonar data formats
supported by the MBIO library
mbgetesf(1) - Extract swath bathymetry data flags into an edit
save file
mbgrdtiff(1) - generates a geographically located TIFF image from a
GMT grid file
mbgrdviz(1) - Simple interactive 2D/3D visualization of GMT grids
mbgrid(1) - Grid bathymetry, amplitude, or sidescan data from
swath sonar data files
mbhistogram(1) - Generate a histogram of bathymetry, amplitude, or
sidescan values from swath sonar data files
mbinfo(1) - Output some basic statistics of swath sonar data
files
mbio(3) - Format independent input/output library for swath
mapping sonar data
mblevitus(1) - Create a water velocity profile which is
representative of the mean annual water column for
a specified 1 degree by 1 degree region
mblist(1) - List data in swath data files
mbm_arc2grd(1) - Macro to convert an ArcView ASCII grid to a GMT grid
file in the GMT NetCDF grid format
mbm_copy(1) - Apply mbcopy to all files referenced through a
datalist, using the MB-System file suffix convention
to name the output files
mbm_dslnavfix(1) - Translate WHOI DSL AMS-120 navigation from UTM
eastings and northings to longitude and latitude
mbm_fmtvel(1) - Extract sound velocity info from Hydrosweep data
files and create output in tabular format
mbm_grd2arc(1) - Macro to convert a GMT grid file in the GMT NetCDF
grid format to an ArcView ASCII grid
mbm_grd2geovrml(1) - Create and execute commands which generate a
TerraVision tileset and GeoVRML terrain set that
can be combined with other geospatial data for
viewing in a web browser
mbm_grd3dplot(1) - Create an executable shellscript which will generate
a GMT 3D perspective plot of gridded data in a GMT
grd file
mbm_grdcut(1) - Macro to extract a specified subarea of a GMT GRD
grid file as another GRD file
mbm_grdinfo(1) - Macro to get information regarding a GMT grd file
when the region of interest is a subset of the area
covered in the input file
mbm_grdplot(1) - Create an executable shellscript which will generate
a GMT map of gridded data in a GMT grd file
mbm_grdtiff(1) - Create an executable shellscript which will generate
a TIFF image of gridded data in a GMT grd file
mbm_grid(1) - Create an executable shellscript which will generate
a grid (bathymetry or topography) or mosaic
(amplitude or sidescan) of swath sonar swath data
mbm_histplot(1) - Create an executable shellscript which will generate
a GMT histogram plot of a dataset
mbm_makedatalist(1) - Macro to generate a datalist of the swath files in a
specified directory
mbm_plot(1) - Create an executable shellscript which will generate
a GMT plot of swath sonar swath data
mbm_route2mission(1) - Macro to convert an mbgrdviz route file into an MBARI
AUV mission script
mbm_stat(1) - Extract beam statistics from output generated by
mbinfo
mbm_utm(1) - Macro to perform forward and inverse UTM projections
of ASCII data triples
mbm_vrefcheck(1) - Macro to generate plot of crosstrack seafloor slope
from a swath sonar file. The noise in this time
series largely reflects noise in the vertical
reference used by the sonar
mbm_xbt(1) - Calculate sound speed from XBT data
mbm_xyplot(1) - Create an executable shellscript which will generate
a GMT plot of xy data
mbmask(1), mbdumpesf(1) - Output text version of beam edits from a binary edit
save file
mbmosaic(1) - Mosaic amplitude or sidescan data from swath mapping
sonar data files
mbnavadjust(1) - Package that solves for optimal navigation by
matching bathymetry of overlapping swaths
mbnavedit(1) - Interactive navigation editor for swath sonar data
mbnavlist(1) - List navigation data in swath sonar data files
mbneptune2esf(1) - Tool to import beam flags from Simrad's Neptune
system
mbotps(1) - Predicts tides using the OSU Tidal Prediction
Software (OTPS) distribution
mbprocess(1) - this program performs a variety of swath data
processing functions in a single step (producing a
single output swath data file), including merging
navigation, recalculating bathymetry from travel
time and angle data by raytracing through a layered
water sound velocity model, applying changes to
ship draft, roll bias and pitch bias, applying
tides, and applying bathymetry edits from edit save
files
mbps(1) - Generates a PostScript perspective plot of a piece of
swath sonar data
mbrollbias(1) - Assess roll bias of swath sonar sonar systems
mbrolltimelag(1) - Calculates cross correlation between the apparent
bottom slope in swath bathymetry data and the roll
time series used by the sonar in order to assess
attitude time lag problems
mbsegygrid(1) - Generate time vs. trace number grids of seismic data
from segy files
mbsegyinfo(1) - Output some basic statistics of segy format seismic
data files
mbsegylist(1) - List selected header values in segy format seismic
data files
mbsegypsd(1) - Calculates the power spectral densisty function
(PSD) of each trace in a segy file, outputting the
PSD estimates as a GMT grid file with trace number
along the x axis and frequency along the y axis
mbset(1) - Sets values in mbprocess parameter files
mbstripNaN(1) - filter to remove NaN nodes
mbsvplist(1) - List water sound velocity profiles in swath sonar
data files
mbswath(1) - GMT compatible utility for color fill or color shaded
relief swath plots of swath sonar data using
Postscript
mbsystem(1) - A set of utilities for manipulating and processing
swath sonar bathymetry, amplitude, and sidescan data
mbtime(1) - Translate between calendar time values and unix time
mbvelocitytool(1) - Interactive water sound velocity profile editor
-------------------------------------------------------------------------------
THE VERSION 5 DATA PROCESSING STRUCTURE
-------------------------------------------------------------------------------
MB-System version 5 features utilities implementing a parallel processing
scheme that simplifies the processing of most swath data. This scheme is
centered around the program mbprocess, which can accomplish the following
processing tasks in a single step:
- Merge edited navigation generated by mbnavedit.
- Apply bathymetry edit flags from mbedit
and mbclean
- Recalculate bathymetry from raw travel time and
angle data by raytracing through water sound speed
models from mbvelocitytool or mbsvplist.
- Apply changes to roll bias, pitch bias, heading
bias, and draft values.
- Recalculate sidescan from raw backscatter samples
(Simrad multibeam data only).
- Correct sidescan for amplitude vs grazing angle
patterns.
- Apply tides to bathymetry.
The actions of mbprocess are controlled by text parameter files. Each mbprocess
parameter file is named by adding a ".par" suffix to the associated input swath
data file and contains single line commands that set processing modes and
parameters. Tools such as mbedit, mbnavedit, and mbclean all generate and/or
modify parameter files in addition to generating parallel files used by
mbprocess. The program mbset can also be used to create and modify mbprocess
parameter files.
One example of a possible data processing scheme is presented here:
1) Run mbdatalist to create ancillary
data files containing statistics
(".inf"), quickly read bathymetry
(".fbt"), and quickly read navigation
(".fnv"). These files are used to
speed common operations such as swath
plotting and gridding.
Input: mbari_1998_524.mb57
Output: mbari_1998_524.mb57.inf
mbari_1998_524.mb57.fbt
mbari_1998_524.mb57.fnv
2) Run mbclean to identify
the obvious bathymetric artifacts
and output a list of the edit events.
The parameter file is created and
set to apply bathymetry flags from
the ".esf" file.
Input: mbari_1998_524.mb57
Output: mbari_1998_524.mb57.esf
mbari_1998_524.mb57.par
3) Run mbedit to interactively
identify bathymetric artifacts
and output a list of the edit events.
The existing edits from mbclean
are loaded and applied prior to editing.
The parameter file is updated and
set to apply bathymetry flags from
the ".esf" file.
Input: mbari_1998_524.mb57
mbari_1998_524.mb57.esf
mbari_1998_524.mb57.par
Output: mbari_1998_524.mb57.esf
mbari_1998_524.mb57.par
4) Run mbnavedit to interactively
clean the navigation. The edited
navigation is output to the ".nve" file.
The parameter file is updated and
set to merge the navigation from
the ".nve" file.
Input: mbari_1998_524.mb57
mbari_1998_524.mb57.par
Output: mbari_1998_524.mb57.nve
mbari_1998_524.mb57.par
5) Run mbvelocitytool to generate an
an appropriate sound velocity profile
(SVP) for recalculating the bathymetry.
The SVP is output to the ".svp" file.
The parameter file is updated and
set to recalculate the bathymetry by
raytracing through the SVP model from
the ".svp" file.
Input: mbari_1998_524.mb57
mbari_1998_524.mb57.par
Output: mbari_1998_524.mb57.svp
mbari_1998_524.mb57.par
6) Run mbbackangle to generate an
a set of amplitude vs grazing angle
tables at regular intervals in the
data. These tables are placed into
a single ".sga" file. The parameter
file is updated and set to correct
the sidescan by interpolating the
amplitude vs grazing angle table for
each ping.
Input: mbari_1998_524.mb57
mbari_1998_524.mb57.par
Output: mbari_1998_524.mb57.sga
mbari_1998_524.mb57.par
7) Run mbset to set the parameter file
so that mbprocess will recalculate
the sidescan (this is for Simrad
multibeam data only) while ignoring
sidescan samples from beams now flagged
as bad.
Input: mbari_1998_524.mb57.par
Output: mbari_1998_524.mb57.par
8) Run mbprocess to apply the bathymetric
edits, merge the cleaned navigation,
recalculate the bathymetry, recalculate
the sidescan, and correct the sidescan.
The processed swath data is written to
an output swath data file. The usual
ancillary data files containing statistics,
quickly read bathymetry, and quickly
read navigation are also created.
Input: mbari_1998_524.mb57
mbari_1998_524.mb57.esf
mbari_1998_524.mb57.nve
mbari_1998_524.mb57.svp
mbari_1998_524.mb57.aga
mbari_1998_524.mb57.par
Output: mbari_1998_524p.mb57
mbari_1998_524p.mb57.inf
mbari_1998_524p.mb57.fbt
mbari_1998_524p.mb57.fnv
The result of this processing is a single output swath data file. Moreover, the
processed output can be easily updated if, for example, additional bathymetry
editing is required. If the mbedit program is used again, it will load the
existing edit events from the ".esf" file and then update the ".esf" file. To
incorporate the updated bathymetry edits, one just runs mbprocess again. One
can similarly change the SVP file without impacting on the bathymetry
editing or navigation editing components of the processing.
-------------------------------------------------------------------------------
OTHER REQUIRED AND SUGGESTED SOFTWARE AND DATA
-------------------------------------------------------------------------------
MB-System requires a number of other software packages and databases to be
fully functional. These are:
- GMT version 4.5 or later: MB-System makes use of the Generic Mapping Tools
(GMT) libraries and programs for much of its graphics. GMT also includes a
detailed global coastline database. GMT has been developed by Professor Paul
Wessel of SOEST (School of Ocean and Earth Science and Technology at the
Univeristy of Hawaii) and Dr. Walter H. F. Smith of NOAA. The GMT source code
is available from the GMT web page.
- NetCDF version 3.5.1 or later: Both GMT and MB-System require the NCAR netCDF
library.
- Perl version 5.0 or later: Perl is a fast, well documented scripting language
used widely in the Linux/Unix world. MB-System contains a number of perl
scripts used both for installation and to ease common tasks. Most of the
current Unix operating systems include perl. If you need to obtain the perl
source code, first check with your local system administrator - you will
probably find perl already available locally. The perl source code can be
obtained from the GNU software archives of the Free Software Foundation.
- Perl Parallel-Forkmanager module: this Perl module is required for the
parallel processing macros mbm_multicopy, mbm_multidatalist, and
mbm_multiprocess to work. An easily installed package is available from from
www.cpan.org.
- X11: The interactive graphical utilities in MB-System (MBedit, MBnavedit,
MBvelocitytool, MBgrdviz, MBeditviz) use and require the X11 windowing system.
- Motif: The interactive graphical utilities in MB-System (MBedit, MBnavedit,
MBvelocitytool, MBgrdviz, MBeditviz) use version 2 of the Motif widget set,
and Motif libraries are required for these utilities to be built and to run.
Most current Unix/Linux operating systems include the required Motif
libraries, either in the original proprietary form (Motif), or the
not-quite-open-source form (OpenMotif). If you do not have these libraries,
the OpenMotif 2 source is available through Motifzone. An old alternative
open source Motif-compatible distribution called LessTif does not work with
the new OpenGL based MB-System programs (MBgrdviz, MBeditviz) and should be
avoided.
- FFTW: The "Fastest Fourier Transform in the West" package is used by the
sonagram calculation program MBbsegypsd to calculate, well, Fast Fourier
Transforms. FFTW is commonly used and thus available on or for most current
Unix operating systems.
- OTPSnc: The Oregon State Ocean Tide Prediction Software package is required
for the tidal modeling program MBotps (which in fact is just a convenient
front end for the old-style-batch interface of OTPS). The OTPSnc package can
be obtained from the tidal modeling group at Oregon State University.
MB-System produces Postscript based graphics. Most current Unix operating
systems provide a program which serves as a screen-based Postscript viewer. If
you do not have a Postscript viewer, one option is to obtain one of several
Ghostscript-based packages from the Free Software Foundation.
- ghostview: Open source screen Postscript viewer. The source code can be
obtained from the GNU software archives of the Free Software Foundation.
- gv: Open source screen Postscript viewer. This package is a bit more
sophisticated than ghostview and can handle poster-sized plots. The source
code can be obtained from the GNU software archives of the Free Software
Foundation.
Users of MacOs X should note that many of the above packages can be painlessly
installed using the fink package available from the Fink Project.
-------------------------------------------------------------------------------
DOCUMENTATION:
-------------------------------------------------------------------------------
The html documentation consists of a number of html documents and images in the
directory mbsystem/share/doc/mbsystem/html. This documentation also comprises
the MB-System web site available from the Lamont web site at:
http://www.ldeo.columbia.edu
and the MBARI web site at:
http://www.mbari.org
Users can access the documentation in their own MB-System installation by using
a web browser and accessing the file:
file:/usr/local/mbsystem/share/doc/mbsystem/html/index.html
(here it is assumed that MB-System has been installed in /usr/local). The
documentation includes some general information about MB-System (e.g. who
wrote, how to get it, how to install it) and a complete set of manual
pages.
-------------------------------------------------------------------------------
MB-SYSTEM DISCUSSION LIST
-------------------------------------------------------------------------------
We maintain an MB-System discussion email list to facillitate communication
among MB-System developers and users. We encourage users with questions and/or
problems to use this list rather than emailing the developers directly. One
must subscribe to the list in order to post messages, but the message archive is
publically viewable and searchable over a web interface. The maximum message
size in this list is 100K.
The web interface to the list is at:
http://listserver.mbari.org/sympa/info/mbsystem
To subscribe to the list go to:
http://listserver.mbari.org/sympa/subscribe/mbsystem
To read the archives go to:
http://listserver.mbari.org/sympa/arc/mbsystem
-------------------------------------------------------------------------------
SUGGESTIONS:
-------------------------------------------------------------------------------
We are interested in your suggestions. Please post in the discussion list
rather than emailing the authors directly.
-------------------------------------------------------------------------------
BUGS:
-------------------------------------------------------------------------------
There are undoubtably bugs in this software. Although we make no promises about
how rapidly problems will be fixed, we strongly encourage users to notify us of
bugs (and fixes!!). We will continue to support this software for the forseeable
future.
-------------------------------------------------------------------------------