Skip to content
#

mappers

Star

Here are 3 public repositories matching this topic...

Language: Python
Filter by language
All 55 Java 14 C# 11 Kotlin 9 PHP 7 Python 3 TypeScript 3 C++ 1 Go 1 JavaScript 1 Ruby 1
smashed

allenai / smashed

Star 31

SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.

nlp natural-language-processing pipeline text transformers pytorch dataset transformer dict prefix datasets preprocessing mappers huggingface in-context-learning torchdata prompting prefix-tuning
  • Updated May 24, 2024
  • Python

DeepanshuDabas03 / K-Means_Map-Reduce

Star 0

This project implements a distributed K-means clustering algorithm using a custom-built MapReduce framework. It is designed to handle potentially large datasets by distributing the clustering workload across multiple processes or machines. Uses gRPC for the communication between mapper, reducer, master

python master fault-tolerance logging grpc map-reduce convergence reducers kmeans-clustering mappers
  • Updated Apr 24, 2024
  • Python

Improve this page

Add a description, image, and links to the mappers topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the mappers topic, visit your repo's landing page and select "manage topics."

Learn more