Rust add external parsers 3

[chifflier]

Make sure these boxes are signed before submitting your Pull Request -- thank you.

• I have read the contributing guide lines at https://redmine.openinfosecfoundation.org/projects/suricata/wiki/Contributing
• I have signed the Open Information Security Foundation contribution agreement at https://suricata-ids.org/about/contribution-agreement/
• I have updated the user guide (in doc/userguide/) to reflect the changes made (if applicable)

Describe changes:

• This PR adds the '--enable-rust-experimental' configure flag, for (embedded) rust app layers with external dependencies and/or experimental status
• It adds support for the NTP protocol, implemented in Rust. The decoding logic is embedded, only the raw parser is an external rust crate (https://github.com/rusticata/ntp-parser)
• The parser is mostly used as an example, and does protocol validation for NTP version 3 and 4.
• Some event rules have been added, to detect malformed NTP data
• This is meant to be an example parser, before working on similar integration for IKEv2 (and later, SNMP, SSH alternative parser, etc.)
• All comments from Rust add external parsers 1 #2792 have been merged: directories, debug statements, build warnings, rules sids
• Same for Rust add external parsers 2 #2794 : s/external/experimental/; s/tcp/udp/, add reference to SIDs

Thanks,
Pierre

[inliniac]

I'm trying to compile this branch with --enable-rust (so not enabling your configure flag), but I get:

make[2]: Entering directory '/home/victor/sync/devel/suricata-rust/rust'
cd ../rust && CARGO_TARGET_DIR=/home/victor/devel/suricata-rust/rust/target \
	/usr/bin/python ./gen-c-headers.py && \
	cargo build   --features "lua "
Writing ./gen/c-headers/rust-log-gen.h
Writing ./gen/c-headers/rust-core-gen.h
    Updating registry `https://github.com/rust-lang/crates.io-index`
error: failed to load source for a dependency on `ntp-parser`

Caused by:
  Unable to update registry https://github.com/rust-lang/crates.io-index

[chifflier]

Hm, not entirely sure, but:

Unable to update registry https://github.com/rust-lang/crates.io-index

Seems to be the cause of the problem. Network problem ?

[inliniac]

Ok the problem was that I had some permission issues in my ~/.cargo dir. I suspect they were caused by a 'sudo' action as some files were owned by root.

[inliniac]

https://redmine.openinfosecfoundation.org/issues/2163
https://redmine.openinfosecfoundation.org/issues/2164

[inliniac]

Merged through #2814, thanks Pierre!