[utils] Add micro-mordred

[valeriocos]

This code proposes a tiny version of mordred to execute just once raw, merge identities, enrich, panels tasks of mordred on a given set of backends (declared in a cfg file passed as input). The micro-mordred overcomes the current limitations of the p2o script in ELK, which is not able to execute multiple studies for the input backend and requires constant changes to align its logic with the ELK one. The micro-mordred isn't supposed to require constant changes, since there is not gap between its logic and the mordred one.

In order to execute the micro-mordred on git and github, an example of the command is shown below:
micro --raw --identities --enrich --panels --cfg ./setup.cfg --backends git github:issue github:pull.

[coveralls]

Pull Request Test Coverage Report for Build 468

• 0 of 0 changed or added relevant lines in 0 files are covered.
• No unchanged relevant lines lost coverage.
• Overall coverage remained the same at 52.613%

---

Totals
Change from base Build 464:	0.0%
Covered Lines:	1037
Relevant Lines:	1971

---

💛 - Coveralls

[aswanipranjal]

@valeriocos I tried this with the github data source. These are the steps that are required to get the studies for github:

• Step1: Generate the enriched index for issues category
• Step2: Generate the enriched index for pull_requests category
• Step3: run the studies for github

The steps Step1 and Step2 cannot be run simultaneously because currently, we can supply only one backend to the --backend flag in micro.py

For studies related to the github backend, we need the indices from both: issues and pull_request category because the enrich_onion study is done for both the categories simultaneously in grimoire-elk/enriched/github.py.

And to generate the enriched pull_requests only index too, we will need both the indices, thus we will need two backend sections.

Can you please modify the code so that we are able to run multiple backends simultaneously?
I tried it, something like this:

def micro_mordred(cfg_path, backend_sections, raw, arthur, enrich):
   
    config = Config(cfg_path)

    if raw:
        for backend in backend_sections:
            get_raw(config, backend, arthur)

    if enrich:
        for backend in backend_sections:
            get_enrich(config, backend)


def get_params_parser():
    """Parse command line arguments"""
...
parser.add_argument("--backend", dest='backend_sections', default=[],
                        nargs='*', help="Backend section to execute")

Please comment if this makes sense?

[valeriocos]

Thank you @aswanipranjal for the suggestions! I have just modified the PR, which now includes the changes you proposed (the example has been modified accordingly as well).

Let me know if you have any other suggestion or feedback.

[aswanipranjal]

Thank you @valeriocos. This works perfectly for me.

@sduenas please review?

[jgbarah]

@aswanipranjal @valeriocos could you please explain the rationale for why we need this, instead of just using sirmordred (maybe with some new option)?

[valeriocos]

That's a good idea and probably the correct evolution of micro-morded. However, for the moment I would keep the micro-modred and sirmordred separated (since I don't know how much work is needed to modify sirmordred to include the micro-mordred option).

[aswanipranjal]

@valeriocos @sduenas @jgbarah is there any progress on merging this PR?

[valeriocos]

This PR needs #198 before merging

[sduenas]

LGTM