[EXAMPLE] Add CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and Augmentation example

[plaguss]

Is your feature request related to a problem? Please describe.
We could create an example replicating this paper, we have most of the pieces and seems quite interesting:
CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and Augmentation

Describe the solution you'd like
Add a replica/example of the paper in the documentation (maybe adding relevant steps/tasks if applies).

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

[bikash119]

hi @plaguss : Can I take this up?

[plaguss]

Hi @bikash119, sure! Other than the special prompts this task would need, it would need a data sampler, specifically from a vector database. Instead of that, for testing I think it would be easier if you play around with a simpler sampler. You can use something like the one in this PR: https://github.com/argilla-io/distilabel/pull/925/files#diff-528f40365aa1e97bc8332703af9a49626c919e5e42145eb12e443fc4021fc1a2. It's not merged yet, but you can copy that.

[bikash119]

hi @plaguss , Thank you for pointing the resources. As I go through the code, I am trying to internalize the code. Nothing with the code, just that I am bit slow here.
On another node, as CRAFT needs a vector storage to query the corpus based on few-shots, do you think it will be beneficial to put effort in looking at sqlite-vec and if possible incorporating it as a step in CRAFT task.
Please let me know your thoughts.

[plaguss]

Hi! We are still working on the best way of building this. For example, #1006 is still a work in progress, but I would say say LanceDB is a good choice. If you find a way of extending this to other possible databases that would be perfect, but put much effort on that. I would suggest to take a look at the implementation in the PR to see if that would work here for CRAFT, otherwise we will have to update it 😄

[bikash119]

Thank you @plaguss for the direction. Will continue with data sampler for CRAFT. Is it possible to ping you on discord, if that sounds ok?

[plaguss]

Sure!